Skip to content

Added Negative prompt to the Background generation #96

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
riggaroo merged 8 commits into from
Aug 12, 2025
Merged

Added Negative prompt to the Background generation #96

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
4bc6e09
Refactor image generation prompt
riggaroo Aug 11, 2025
56de0d3
Remove clip
riggaroo Aug 11, 2025
25f9354
Add more background generation instructions.
riggaroo Aug 11, 2025
cd705ee
Only add the clip when its not an AI Background
riggaroo Aug 11, 2025
b1b8476
Fetch instructions from Firebase
riggaroo Aug 11, 2025
1d16d20
Test config
riggaroo Aug 11, 2025
5147241
Test config
riggaroo Aug 11, 2025
c1f6843
PR Feedback
riggaroo Aug 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,11 @@ fontName="Roboto Flex"

For Googlers, get this info from go/androidify-api-setup

## Availability
Due to the background vibe feature using
`gemini-2.0-flash-preview-image-generation`, its not currently supported in a number of countries in Europe, Middle East & Africa.
See [this](https://ai.google.dev/gemini-api/docs/models#gemini-2.0-flash-preview-image-generation) doc for more information.

## Contributing

See [Contributing](CONTRIBUTING.md).
Expand Down
6 changes: 6 additions & 0 deletions core/network/src/main/java/com/android/developers/androidify/RemoteConfigDataSource.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,8 @@ interface RemoteConfigDataSource {
fun getFineTunedModelName(): String

fun getImageGenerationEditsModelName(): String

fun getBotBackgroundInstructionPrompt(): String
}

@Singleton
Expand Down Expand Up @@ -100,4 +102,8 @@ class RemoteConfigDataSourceImpl @Inject constructor() : RemoteConfigDataSource
override fun getImageGenerationEditsModelName(): String {
return remoteConfig.getString("image_generation_model_edits")
}

override fun getBotBackgroundInstructionPrompt(): String {
return remoteConfig.getString("bot_background_instruction_prompt")
}
}
12 changes: 6 additions & 6 deletions .../network/src/main/java/com/android/developers/androidify/vertexai/FirebaseAiDataSource.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -85,12 +85,12 @@ class FirebaseAiDataSourceImpl @Inject constructor(
return Firebase.ai(backend = GenerativeBackend.vertexAI()).imagenModel(
remoteConfigDataSource.imageModelName(),
safetySettings =
ImagenSafetySettings(
safetyFilterLevel = ImagenSafetyFilterLevel.BLOCK_LOW_AND_ABOVE,
// Uses `ALLOW_ADULT` filter since `ALLOW_ALL` requires a special approval
// See https://cloud.google.com/vertex-ai/generative-ai/docs/image/responsible-ai-imagen#person-face-gen
personFilterLevel = ImagenPersonFilterLevel.ALLOW_ADULT,
),
ImagenSafetySettings(
safetyFilterLevel = ImagenSafetyFilterLevel.BLOCK_LOW_AND_ABOVE,
// Uses `ALLOW_ADULT` filter since `ALLOW_ALL` requires a special approval
// See https://cloud.google.com/vertex-ai/generative-ai/docs/image/responsible-ai-imagen#person-face-gen
personFilterLevel = ImagenPersonFilterLevel.ALLOW_ADULT,
),
)
}

Expand Down
23 changes: 20 additions & 3 deletions core/network/src/main/res/xml/remote_config_defaults.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,25 @@
-->
<defaults>
<entry>
<key>image_generation_model_edits</key>
<value>gemini-2.0-flash-preview-image-generation</value>
<key>bot_background_instruction_prompt</key>
<value>Add the input image android bot as the main subject to the result,
it should be the most prominent element of the resultant image, large and
filling the foreground - more than 50% of the resultant frame,
standing in the center of the frame with the central
focus, and the background just underneath the content.

Always include the input Android Bot in the final result image as the subject of the image.
It should be prominently featured in the foreground, center of the frame, without any adjustments other
than the lighting of the surrounding environment. There should only be one of the bots in the image.
style="3d animation style, simplified shapes, mouthless character, realistic physics simulation"

Do not alter the input Android Bot image, do not change its shape or add any hands, eyes, mouths etc. Do not change the characters color scheme.

The background is described as follows:</value>
</entry>
<entry>
<key>use_imagen</key>
<value>true</value>
<value>false</value>
</entry>
<entry>
<key>prompt_image_validation</key>
Expand Down Expand Up @@ -127,6 +140,10 @@
<key>promo_video_link</key>
<value>https://services.google.com/fh/files/misc/androidfy_storyboard_b_v07.mp4</value>
</entry>
<entry>
<key>image_generation_model_edits</key>
<value>gemini-2.0-flash-preview-image-generation</value>
</entry>
<entry>
<key>text_model_name</key>
<value>gemini-2.5-flash</value>
Expand Down
4 changes: 4 additions & 0 deletions ...esting/src/main/java/com/android/developers/testing/network/TestRemoteConfigDataSource.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,4 +71,8 @@ class TestRemoteConfigDataSource(private val useGeminiNano: Boolean) : RemoteCon
override fun getImageGenerationEditsModelName(): String {
return "test_image_model"
}

override fun getBotBackgroundInstructionPrompt(): String {
return "bot_background_instruction_prompt"
}
}
4 changes: 2 additions & 2 deletions .../src/main/java/com/android/developers/testing/repository/FakeImageGenerationRepository.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,9 +58,9 @@ class FakeImageGenerationRepository : ImageGenerationRepository {
return imageUri
}

override suspend fun generateImageWithEdit(
override suspend fun addBackgroundToBot(
image: Bitmap,
editPrompt: String,
backgroundPrompt: String,
): Bitmap {
return createBitmap(1, 1)
}
Expand Down
11 changes: 8 additions & 3 deletions data/src/main/java/com/android/developers/androidify/data/ImageGenerationRepository.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ import android.graphics.Bitmap
import android.graphics.BitmapFactory
import android.net.Uri
import android.util.Log
import com.android.developers.androidify.RemoteConfigDataSource
import com.android.developers.androidify.model.ValidatedDescription
import com.android.developers.androidify.model.ValidatedImage
import com.android.developers.androidify.util.LocalFileProvider
Expand All @@ -35,7 +36,8 @@ interface ImageGenerationRepository {
suspend fun saveImage(imageBitmap: Bitmap): Uri
suspend fun saveImageToExternalStorage(imageBitmap: Bitmap): Uri
suspend fun saveImageToExternalStorage(imageUri: Uri): Uri
suspend fun generateImageWithEdit(image: Bitmap, editPrompt: String): Bitmap

suspend fun addBackgroundToBot(image: Bitmap, backgroundPrompt: String) : Bitmap
}

@Singleton
Expand All @@ -44,6 +46,7 @@ internal class ImageGenerationRepositoryImpl @Inject constructor(
private val internetConnectivityManager: InternetConnectivityManager,
private val geminiNanoDataSource: GeminiNanoGenerationDataSource,
private val firebaseAiDataSource: FirebaseAiDataSource,
private val remoteConfigDataSource: RemoteConfigDataSource
) : ImageGenerationRepository {

override suspend fun initialize() {
Expand Down Expand Up @@ -126,7 +129,9 @@ internal class ImageGenerationRepositoryImpl @Inject constructor(
}
}

override suspend fun generateImageWithEdit(image: Bitmap, editPrompt: String): Bitmap {
return firebaseAiDataSource.generateImageWithEdit(image, editPrompt)
override suspend fun addBackgroundToBot(image: Bitmap, backgroundPrompt: String): Bitmap {
val backgroundBotInstructions = remoteConfigDataSource.getBotBackgroundInstructionPrompt() +
"\"" + backgroundPrompt + "\""
return firebaseAiDataSource.generateImageWithEdit(image, backgroundBotInstructions)
}
}
5 changes: 2 additions & 3 deletions ...lts/src/main/java/com/android/developers/androidify/customize/CustomizeExportViewModel.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,9 +147,8 @@ class CustomizeExportViewModel @Inject constructor(

_state.update { it.copy(showImageEditProgress = true) }
try {
val bitmap = imageGenerationRepository.generateImageWithEdit(
image,
"Add the input image android bot as the main subject to the result, it should be the most prominent element of the resultant image, large and filling the foreground, standing in the center of the frame with the central focus, and the background just underneath the content. The background is described as follows: \"" + backgroundOption.prompt + "\"",
val bitmap = imageGenerationRepository.addBackgroundToBot(
image, backgroundOption.prompt,
)
_state.update {
it.copy(
Expand Down
3 changes: 2 additions & 1 deletion feature/results/src/main/java/com/android/developers/androidify/customize/ImageRenderer.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -158,7 +158,8 @@ fun BackgroundLayout(
.then(safeAnimateBounds)
.rotate(rotationAnimation),
) {
val clip = if (exportImageCanvas.selectedBackgroundOption == BackgroundOption.None) {
val clip = if (exportImageCanvas.selectedBackgroundOption == BackgroundOption.None
|| exportImageCanvas.selectedBackgroundOption.aiBackground) {
Modifier
} else {
Modifier.clip(RoundedCornerShape(6))
Expand Down