create account

Learning how to use In-Painting in Stable Diffusion to enhance existing images by holoz0r

View this thread on: hive.blogpeakd.comecency.com
· @holoz0r ·
$11.14
Learning how to use In-Painting in Stable Diffusion to enhance existing images
Time to learn how to use in painting properly to correct images that have previously been generated. My starting image is where I left off last post, with an image of my favoured fool for my tarot card collection inspired images. 

Here's the starting image. 

https://files.peakd.com/file/peakd-hive/holoz0r/23xAVkxYkwm1yEdYLiEguaEmUC1HssAk7w26vK6Cft9ottusbVB5csG1AVS4hMCt25ZsG.png

There are many things that I want to fix within this image, I'll annoate / circle them and work through these one by one... 


![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/23yJGF7ErqNcs9aHvak7oLrDepmECXhYnpkDz99nHgYNzFCFCW99LPexygcqnGcThu1w8.png)

These are probably things that I will work on in an out of order fashion... 

First, to remove the extra hand at the character's hip, number three, I simply used inpainting within the img2img tab of the Stable Diffusion web ui with a simple prompt of "hand", as a negative prompt. This made the hand disappear. 

The next step was to remove the stick coming out of the character's head. That should be easy enough to do, again with a negative prompt of stick. 2 out of 5 done already. 

For number four, I want the hand to be holding a white rose, as per the actual tarot card of the fool. I add a positive prompt, after painting over the area, and then this is the progress so far: 


![00118-2978259995-.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4XsKYaqtWzEEV1WwAJUvsp2QVbLCRUkkeBKBo6rKjS687ztrhEvn4buhQ8u8.png)

Next up is number two, which is to fix the deformed hand on the stick. Again, I paint over the impacted area, and use a negative prompt like... 

> extra fingers, mutated hands, ((poorly drawn hands))

Then, I've got just the one thing to fix, the slightly erroneous proportions on the torso of the character. 

Here is where I find myself now... with In Painting having added more detail to the stick as a result of my prompt. That's awesome to see! 
![00124-2049114788-.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4ZGVrDopgyy1EnSY14SvqAHqe8h6HyLnmLA4tvknSGFexQeGPcviGLZyWmMz.png)

I used the negative prompt "deformed torso", and it gave me an interesting result, changing the nature of the image by changing the outfit. 

![00123-61263647-.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4XsKYN88TDEeTrrKy6aiu2cMDLNtjbr7ZmshfLvrNS2BC7FFApdFVEnYZxmr.png)

This is not exactly what I wanted to see come into the image, so I might generate a few more iterations (which will be using different seeds, just like image generation) - and we'll see what happens... 


![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/EoeD3NYBH3i9se8AYvTT7iV8KVZdzWoJjcazNqygfeEzLT2RRncjxsXGNSfTJ1UrJwk.png)


The progression to the final image makes the final output probably be the most desirable yet, in terms of portraying the character, but I might try a few more quick iterations in order to see if I get any other results that are better. I'll do 5 more versions. 


![00129-1951879055-.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xefHzcPNj7gkFERpQpWwkDisVVkCtZTmnpXLhVYoyJbBgrxWcHLBXutGDhibEWw3jic.png)

Looking at the enlarged version, there's a few new problems. The underarm and shoulder appears to be the wrong way round on the arm that is closest to the camera, which will need to be fixed. So, I'm iterating through some more negative prompts to try and fix this, like so: 

The black part in the image below is what the negative prompt is to be applied to: 


![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/23tGbqb5yvXWKZ2ixMNijPNkEsc7xYk7P6N37f5oE4pUMZMtfUPCnDTLoPP7i9sCyMm12.png)

The best outcome after a series of further iterations is the following image: 


![00147-4003635483-.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xVGdcGBqpcKXemoEnjJyJq63RHGgJTqMLRJM4DxkubYrLuZChCGNJE2x2nASYp3DvEn.png)

There is still some deformity here, but I am realising it is not with the torso, but instead with the arm closest to the camera. So, now that I've found an outfit that I like... it is time to try and fix the "holding a rose" element of the image again. Here goes nothing, from this starting point: 

![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xKtYeisYcEPVEf5UjAWzricmLeVxa1gKBdpziYme5X2FVX4zedE9HCfbAhsSEY6Dj9r.png)

And featured here, what I am doing with the Stable Diffusion In Painting and positive (top) and negative (bottom) prompts.


![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/23tGcNPdbjEpf7wHnDKoEG9EXpfHWdM8cn3Vemsj3RyQ7FC4BaTTYsiKHg8xSoiYMbTiH.png)

After several... hundred iterations, I'm getting closer to having a more realistically proportioned character, but there is still a significant amount of work to be done to have the rose being held. 

https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy6AXVgP1kF3qWBBFMBkvx2MhqkF5Tsw89nvv255PicPfYb5u6Szeyxc5cSB5z.png


With a pass of face restoration... 


![image.png](https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy6AXVgP1kF3qWBBFMBkvx2MhqkF5Tsw89nvv255PicPfYb5u6Szeyxc5cSB5z.png)

I think this is at the point where once it is shrunk down to a card, it will be of passable quality. That, and it is very late, and I feel very done. 

On the bright side, I've learned new skills about how InPainting works within Stable Diffusion and in particular with the web-gui I'm using. 

I'm pretty happy at this point, even if I'm really tired. :D 

<hr>

<center><h4>Want more content from me?</h4></center>

<a href="https://peakd.com/ccc/holoz0r/holoz0rs-a-z-of-steam-a-complete-archive-to-date">Witness my futile efforts to play my Steam Game collection in alphabetical order</a>.

Are you aware that I love photography? <a href="https://peakd.com/ccc/holoz0r/photographic-works-and-ramblings-of-holoz0r">Check out my work in a collection.</a>



<hr>
<div class="pull-right">https://files.peakd.com/file/peakd-hive/holoz0r/AK2BjKGGLBFTBPhtsWKMnsmFFJDQrhXbbM35f6dRxoT4fEqqegsPLWdwizYRNxw.png</div><a href="https://splinterlands.com?ref=holoz0r">If you haven't started playing Splinterlands, you should do that immediately. It's very good fun.</a><br/><br/>

If you want to see my Splinterlands antics and rants live, Find me on <a href="https://www.twitch.tv/holoz0r">Twitch</a><br/>

If you prefer sleeping in your designated time zone, <a href="https://www.youtube.com/channel/UCuupHoy5KyWOjRbqIY5F4HA">go watch replays on YouTube</a>.

<hr>

<center>Thanks as always for your time!</center>
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 399 others
properties (23)
authorholoz0r
permlinklearning-how-to-use-in-painting-in-stable-diffusion-to-enhance-existing-images
categoryhive-122472
json_metadata{"app":"peakd/2022.10.3","format":"markdown","tags":["art","creative","paintingwithai","stablediffusion","palnet","neoxian"],"users":[],"image":["https://files.peakd.com/file/peakd-hive/holoz0r/23xAVkxYkwm1yEdYLiEguaEmUC1HssAk7w26vK6Cft9ottusbVB5csG1AVS4hMCt25ZsG.png","https://files.peakd.com/file/peakd-hive/holoz0r/23yJGF7ErqNcs9aHvak7oLrDepmECXhYnpkDz99nHgYNzFCFCW99LPexygcqnGcThu1w8.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4XsKYaqtWzEEV1WwAJUvsp2QVbLCRUkkeBKBo6rKjS687ztrhEvn4buhQ8u8.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4ZGVrDopgyy1EnSY14SvqAHqe8h6HyLnmLA4tvknSGFexQeGPcviGLZyWmMz.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy4XsKYN88TDEeTrrKy6aiu2cMDLNtjbr7ZmshfLvrNS2BC7FFApdFVEnYZxmr.png","https://files.peakd.com/file/peakd-hive/holoz0r/EoeD3NYBH3i9se8AYvTT7iV8KVZdzWoJjcazNqygfeEzLT2RRncjxsXGNSfTJ1UrJwk.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xefHzcPNj7gkFERpQpWwkDisVVkCtZTmnpXLhVYoyJbBgrxWcHLBXutGDhibEWw3jic.png","https://files.peakd.com/file/peakd-hive/holoz0r/23tGbqb5yvXWKZ2ixMNijPNkEsc7xYk7P6N37f5oE4pUMZMtfUPCnDTLoPP7i9sCyMm12.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xVGdcGBqpcKXemoEnjJyJq63RHGgJTqMLRJM4DxkubYrLuZChCGNJE2x2nASYp3DvEn.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xKtYeisYcEPVEf5UjAWzricmLeVxa1gKBdpziYme5X2FVX4zedE9HCfbAhsSEY6Dj9r.png","https://files.peakd.com/file/peakd-hive/holoz0r/23tGcNPdbjEpf7wHnDKoEG9EXpfHWdM8cn3Vemsj3RyQ7FC4BaTTYsiKHg8xSoiYMbTiH.png","https://files.peakd.com/file/peakd-hive/holoz0r/23xVHHmCy6AXVgP1kF3qWBBFMBkvx2MhqkF5Tsw89nvv255PicPfYb5u6Szeyxc5cSB5z.png","https://files.peakd.com/file/peakd-hive/holoz0r/AK2BjKGGLBFTBPhtsWKMnsmFFJDQrhXbbM35f6dRxoT4fEqqegsPLWdwizYRNxw.png"]}
created2022-11-06 13:25:00
last_update2022-11-06 13:25:00
depth0
children6
last_payout2022-11-13 13:25:00
cashout_time1969-12-31 23:59:59
total_payout_value5.610 HBD
curator_payout_value5.532 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length6,462
author_reputation546,434,273,569,493
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,110,270
net_rshares24,904,176,421,705
author_curate_reward""
vote details (463)
@marco77290 ·
ohh .. i haven't tried this technique yet but it's spectacular you get great results thanks a lot for sharing
properties (22)
authormarco77290
permlinkre-holoz0r-rkxi93
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-06 13:46:18
last_update2022-11-06 13:46:18
depth1
children1
last_payout2022-11-13 13:46:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length109
author_reputation3,973,903,015,285
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,110,707
net_rshares0
@holoz0r ·
$0.83
properties (23)
authorholoz0r
permlinkre-marco77290-rky19h
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-06 20:36:54
last_update2022-11-06 20:36:54
depth2
children0
last_payout2022-11-13 20:36:54
cashout_time1969-12-31 23:59:59
total_payout_value0.414 HBD
curator_payout_value0.413 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length11
author_reputation546,434,273,569,493
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,120,229
net_rshares1,829,214,142,858
author_curate_reward""
vote details (6)
@mattclarke · (edited)
Is she cross-eyed? I can't concentrate on anything else.
properties (22)
authormattclarke
permlinkre-holoz0r-rky9sr
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-06 23:41:15
last_update2022-11-07 01:16:39
depth1
children1
last_payout2022-11-13 23:41:15
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length56
author_reputation127,950,098,933,264
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,124,058
net_rshares0
@holoz0r ·
Possibly. It won't matter when shrunk down to size. It can be our little secret, though. 
properties (22)
authorholoz0r
permlinkre-mattclarke-rkybk0
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-07 00:19:27
last_update2022-11-07 00:19:27
depth2
children0
last_payout2022-11-14 00:19:27
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length89
author_reputation546,434,273,569,493
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,124,824
net_rshares0
@ryivhnn ·
That seems to have worked out alright. Insane amount of tweaking 😳
properties (22)
authorryivhnn
permlinkre-holoz0r-rkyr86
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-07 05:57:45
last_update2022-11-07 05:57:45
depth1
children1
last_payout2022-11-14 05:57:45
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length66
author_reputation211,465,504,945,558
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,130,791
net_rshares0
@holoz0r ·
$0.76
It is a great process, thinking of maybe even reworking some of my photography in this manner!
👍  , , , , ,
properties (23)
authorholoz0r
permlinkre-ryivhnn-rkyug1
categoryhive-122472
json_metadata{"tags":["hive-122472"],"app":"peakd/2022.10.3"}
created2022-11-07 07:07:12
last_update2022-11-07 07:07:12
depth2
children0
last_payout2022-11-14 07:07:12
cashout_time1969-12-31 23:59:59
total_payout_value0.382 HBD
curator_payout_value0.381 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length94
author_reputation546,434,273,569,493
root_title"Learning how to use In-Painting in Stable Diffusion to enhance existing images"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id118,131,827
net_rshares1,712,633,637,478
author_curate_reward""
vote details (6)