Generative ai now Matches your photo or sketch, Structure Reference in Adobe Firefly

How to use Structure Reference in Adobe Firefly

A new Edition has been added to Adobe Firefly. This is called Structure Reference. It allows you to upload a photo or a sketch to help guide the image generation. It works very well and helps us greatly in getting the ai to generate what we actually want.

Start by going to the Adobe Firefly website. You have to have a valid Creative Cloud or Adobe Stock account to use firefly.

Chose generate under Text to image

This will take you to the gallery page. You will see a box at the bottom that says prompt.

I’ll type in something very generic. “Woman taking selfies with phone”

You can see 4 images are generated.You will notice with Firefly Model 2, the people look a lot more realistic than before.  (Click on the top right to download any of them).

Suppose we have a specific pose in mind?

On the left you will see Structure. A new option is the ability to upload a reference image. Click upload image.

Lets choose this image from Adobe stock.

You will see the reference image in the prompt box.

Choose Generate

Notice now it generates images closer to the reference image.

There is a strength slider which is at the middle.

If we increate the strength, the reference image has more weight.

Noice the clothing and pose are the same, they are even holding a flower. There are different people and the colors are different. The structure copies the layout and composition.

First add “isolated background” to the prompt (to generate with a simple colored background).
Then reduce the strength to the minimum and choose generate

Notice the images are still similar to the reference, but not as close. The clothing and hair is different, the poses are slightly different and they aren’t holding flowers.

We also get the isolated background.

Concept are using a sketch

Here I typed in a prompt for a spaceship concept

Under structure, there is an option to browse gallery

There is a small gallery of reference images supplied by Adobe that you can use. (Hopefully they will add more)

Choose the Line Drawing of the Cardinal

Generate and now the spaceships look like birds. Very cool

Using a sketch as a reference for a photo real render

Now we know we ca use a drawing, let’s build on this.

I generated some castles with a prompt

Load in a Structure reference

Here is sketch I made of a fictitious castle.

And look at that the generated images a photo realistic versions of my sketch.

See how the parts match

Even the same number and shape of walls and battlements.

Creating a fantasy robot.

Let’s try another one. Here is a pen and ink Robot I sketched. I’ve been learning to sketch robots from a book called How to Draw Robots or something like that, I forget the exact name right now.

When generating the robots in the art setting, it makes drawings of my robot.

Change to Photo under Content type and modify the prompt a little and we get a very cool looking robot.

That’s basically the new feature in Firefly. I think this is going to be very useful to make backgrounds and props for composites as well as helping with concept art.

I hope you found this tutorial useful.

Check out the 700 other free tutorials here at the CAFE

Colin

The post Generative ai now Matches your photo or sketch, Structure Reference in Adobe Firefly appeared first on PhotoshopCAFE.

Photoshop CAFE