create account

Zed's choice : behind the scene explanation of a picture creation - full detailed example by dbddv01

View this thread on: hive.blogpeakd.comecency.com
· @dbddv01 ·
$42.68
Zed's choice : behind the scene explanation of a picture creation - full detailed example
To fulfill some member's curiosity ;-) , i will here explain in details how i created the basic following picture from my last post of [the draft comic]( https://hive.blog/hive-158694/@dbddv01/zed-s-choice-or-pg-11-to-13-or-draft-comic-book-created-with-ai-drawing-tools) that i'm currently creating in order to explore the recent AI graphic tools released on the net.

Like a kind of tutorial, i will describe all the steps i performed to get the following case :


![0final.png](https://images.hive.blog/DQmNoXNkS2ZyMjWw6yoFbTqoQ9TSMKqYAftSqmhZNGQyjPE/0final.png)
The pictures fits into a page describing a journey trough a desertic area.
I was looking for some desertic landscape with an old road picture. (Later on, I looked also for pictures showing truck, animals or small devastated building in order to enhance the story's universe). 

##### Producing init images.
I usually start by creating init images. I mean small pictures i can use to feed other AI program like ICGAN, VQGAN or CLIP Diffusion *(links provided at the end of the post)*. For this purpose i usually start using Mini Dall-e algorythm because it is only driven by a textual prompt that will trigger picture creation. 

For our case, i wrote the following prompt : *" A lost desert road, a painting trending on Artstation"*.  After a couple of tries, i collected the following ones :" 


![001.png](https://images.hive.blog/DQmPaofmBwGfTPjRUvkTr1sYE4paETuNS5xA1jeuZmejjsp/001.png)

##### Derivation with IC-GAN
I focused my attention on the picture with a red square and submit it to IC-GAN. 

![002 picked.jpeg](https://images.hive.blog/DQmehFVTiFR1fDAKqAUJfKtEvUZYxMTD2pKbZUbpKEGVjgt/002%20picked.jpeg)

In IC-GAN, you don't have any textual prompt,  you just submit this picture as init image. Here without any sub-class specification. ICGAN created indeed a first derivation as folllows : 


![002b.png](https://images.hive.blog/DQmNXwrb7LCivZJmecsf7d54wFzWiA6pSQMTqujdyHRt9hs/002b.png)

And i decided to re-use it to get more similar picture because it was closer to the desertic atmosphere i was looking for. I created a dozens pictures from wich i picked up three children picture as depicted by the arrows in the screenshot hereunder :

![002a.png](https://images.hive.blog/DQmdirER5z9Bt7zFPLGgHZ24cT9i7vRYkMFpdhGwAgowxUK/002a.png)

We are still working with very small 256x246px size, by zooming  you see that they are still blurry, with a soft photographic painting style, so they need more fine-tuning. The most interesting is the coherence they have togheter, useful for storyline building.

##### Giving more details and drawing style by using CLIP+Diffusion.

Back to our initial case, i submitted the last picture of the set here above,  to a CLIP guided diffusion process. And from this diffusion run, I kept the following picture : 


![004.png](https://images.hive.blog/DQmTQyrXsJZdj2Jy2YPtJCd4eabNYWQfBZv5kDxmHB9xK5b/004.png)
Still same small size, but with more details, less blurry. Some track in the sand are appearing.

Here another set for a closer look at some of the refining possibilities :


![diffusion.png](https://images.hive.blog/DQmTphwwuF2wcuQMJsn4Qoep5BWqEbYpi8raT4bFHAd6FHV/diffusion.png)


Clip diffusion allows an init picture and a text prompt, you should see the parenthood from the previous set, but with some more detail and painting effect as i prompted the algorythm with "*driving on a desert road with a city at the horizon, painted by Enki Bilal*" (pic1). "*driving on a desert road, painted by Enki Bilal*" (pic2) "*a lost desert track, painted by Enki Bilal*" (pic3) "*A road in the country, by Enki Bila*l" (pic 4 - 70 steps, 5 - 35 steps, 6 - 15 steps) "*a road going nowhere, painted by Enki Bila*l" (pic 7 and 8).

With an init picture, Clip Diffusion keeps the global geometry but goes step by step in creating details by sticking to your textual information. As such it creates a city in the first picture, a kind of truck shape at the end of the road of pic 2, and a quite cool landscape at pic3. Note that pic1 and pic3 have the same parent picture dealing with our main example, and all the others share the same initial parent from the ICGAN session.

This is a very short sample, i have a dozen more pictures created like that quite similar in order to create a library.

##### Preparation of the scenario

Usually at this stage, i begin to brainstorm the arrangement of the picture into some comic  templates in order to identify coherence, possible sequences, and hypothetic additional storyline. Therefore i use a pc software named ComicLife. It allows basic creation of comic page by providing page templates and baloons in a drag and drop way of  doing. 

Here the main interface screenshot :


![wip.png](https://images.hive.blog/DQmedxUjFdXh3jUABjYg4U1krJLvdcJFpbPQ3KoyNtCET7K/wip.png)

And here a work in progress, collecting and assembling the images.

![assemblageinwork.png](https://images.hive.blog/DQmXvfhVXtKe8bCRwCLrTigNhUNVstCNUSvQ7dRzjAkNNYo/assemblageinwork.png)

##### Giving final style with VQGAN+CLIP

VQGAN allows textual prompt and init images. It creates very oniric pictures with strong painting styles (depending on the model). It can dramatically modify your init picture. That's why i apply some basic textual prompts and stop the process after 100 iterations and save a couple of frames  of each creation in order to choose later on the best fitted picture. VQGAN enables larger size of picture production (512by512px) in free google colab. Even when upscaled they remain quite beautiful with some acceptable level of details. 

In our case, i use the previous diffusion output as init image  : 

![004.png](https://images.hive.blog/DQmTQyrXsJZdj2Jy2YPtJCd4eabNYWQfBZv5kDxmHB9xK5b/004.png)

With a prompt named "A desertic lost road painted by Enki Bilal". 
Here below, you see the picture it created after 20, 50, 70 and 90 steps.

![005 step 20.png](https://images.hive.blog/DQmZeVfRr2fow4qqvfY52z5wuv11ZZhzyg3BUmWh66eFb8w/005%20step%2020.png)
20

![005 step 50.png](https://images.hive.blog/DQmNbcaSnnaNC7YSMTwJ7mnJfLDdCMB8CvrH17ZQR8pt2f7/005%20step%2050.png)
50

![005 step 60.png](https://images.hive.blog/DQmNbcaSnnaNC7YSMTwJ7mnJfLDdCMB8CvrH17ZQR8pt2f7/005%20step%2060.png)
70

![005 step 90.png](https://images.hive.blog/DQmXCdCtB9Q3YPANPPQBwXf2g7fwC1MqCCdPyvDJB1ULWfg/005%20step%2090.png)
90

I could have let it runned during more steps, but it would have given too much psychedelic and repetitive patterns.  I was basically satisfied with the picture at 70 steps. At 90 steps i found the object appearing on the road too difficult to integrate in the story. 

I finally upscale it for the sake of using pictures with affordable size (1280x1280px) to integrate it into the final page. 


![006  upscale.png](https://images.hive.blog/DQmQH9xtNAppBxLYjz5Ga1e7PNKbWZjH28fhGhi2oqmrNsU/006%20%20upscale.png)
Upscaled

And finally placed into the page (the fourth box) : 


![Page_12.png](https://images.hive.blog/DQmdBHaVokduQsVuAi25Kj1ZXPVoetPBH9EtmgAcFf6z7yP/Page_12.png)

###### Additional note.
- This is not a proven process, just my stage of experiments.
- I doubt being able to really keep a similar graphic style in a long run distance, but i have ideas to integrate this fact in the storyline.
- New tools and updates are coming these last weeks and may bring improvement on that field.
- Using real pictures as init images is still to explore to bring more pattern diversity.

Thanks for having read so far. If you were curious, i hope this was informative.


------

##### Processing Note: 

New scripts, algorythms and models have been recently released these last two weeks on this very dynamic scene and i will probably abuse them shortly to continue this project. ( new keywords here are , ***rudalle*, *v-diffusion-jax v2* and *Arbitrary Neural Style Transfer*** to name a few .) 


The general rules of my creative processes is explained in some previous posts : I use a couple of AI graphic tools like [IC-GAN](https://hive.blog/hive-158694/@dbddv01/ic-gan-a-new-ai-generative-picture-engine-from-facebook), VQGAN+CLIP, CLIP guided diffusion etc. More info [here](https://hive.blog/hive-158694/@jotakrevs/alien-sea-ai-video-art-and-human-experiences--notebook-updates-enspa) and [here](https://hive.blog/hive-177949/@kaliyuga/kaliyugas-library-of-ai-google-colab-notebooks). I use them in pipelines as explained [here](https://hive.blog/hive-158694/@dbddv01/trying-to-draw-bodies-and-characters-with-ai-tools-examples-of-approaches) to produce pictures i can use to build this draft comic book experiment. Beyond my own cultural backgrounds to sketch the scenario i also use some AI nlp tools as inspiration source by discussing with [chatbots](https://hive.blog/hive-158694/@dbddv01/faces-avatars-and-portraits-8-auto-portraits-by-aibot-an-interview-how-to-make-a-chatbot), or prompting them to create [characters templates](https://hive.blog/hive-158694/@dbddv01/faces-avatars-and-portraits-6-the-cyborg-named-zed) and other ideas. 

If you are curious, I would also recommend consulting the posts shared in the [Latent Space Community](https://hive.blog/created/hive-177949) - a child of -  the Alien Art Hive Community.

From my creative process, i also now offer some exclusive collectible visual artworks produced during the "making of" this experiments, which from my perspective, could be art piece on their own. A new piece has just been released. See therefore my **NFTshowroom [Gallery](https://nftshowroom.com/dbddv01/gallery).**

Don't hesitate to drop comments or questions, and all my gratitude to the Alien Art Hive Community for your support and comments so far. 

--------------

###### My previous posts are [here](https://hive.blog/@dbddv01/posts).
###### Now also some periodical chirping news via https://twitter.com/Dbddv01
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 104 others
properties (23)
authordbddv01
permlinkzed-s-choice-behind-the-scene-explanation-of-a-picture-creation-full-detailed-example
categoryhive-158694
json_metadata"{"tags":["art","comics","tutorial","ai","ocdb","sketchbook","drawing"],"image":["https://images.hive.blog/DQmQH9xtNAppBxLYjz5Ga1e7PNKbWZjH28fhGhi2oqmrNsU/006%20%20upscale.png","https://images.hive.blog/DQmNoXNkS2ZyMjWw6yoFbTqoQ9TSMKqYAftSqmhZNGQyjPE/0final.png","https://images.hive.blog/DQmPaofmBwGfTPjRUvkTr1sYE4paETuNS5xA1jeuZmejjsp/001.png","https://images.hive.blog/DQmehFVTiFR1fDAKqAUJfKtEvUZYxMTD2pKbZUbpKEGVjgt/002%20picked.jpeg","https://images.hive.blog/DQmNXwrb7LCivZJmecsf7d54wFzWiA6pSQMTqujdyHRt9hs/002b.png","https://images.hive.blog/DQmdirER5z9Bt7zFPLGgHZ24cT9i7vRYkMFpdhGwAgowxUK/002a.png","https://images.hive.blog/DQmTQyrXsJZdj2Jy2YPtJCd4eabNYWQfBZv5kDxmHB9xK5b/004.png","https://images.hive.blog/DQmTphwwuF2wcuQMJsn4Qoep5BWqEbYpi8raT4bFHAd6FHV/diffusion.png","https://images.hive.blog/DQmedxUjFdXh3jUABjYg4U1krJLvdcJFpbPQ3KoyNtCET7K/wip.png","https://images.hive.blog/DQmXvfhVXtKe8bCRwCLrTigNhUNVstCNUSvQ7dRzjAkNNYo/assemblageinwork.png","https://images.hive.blog/DQmZeVfRr2fow4qqvfY52z5wuv11ZZhzyg3BUmWh66eFb8w/005%20step%2020.png","https://images.hive.blog/DQmNbcaSnnaNC7YSMTwJ7mnJfLDdCMB8CvrH17ZQR8pt2f7/005%20step%2050.png","https://images.hive.blog/DQmNbcaSnnaNC7YSMTwJ7mnJfLDdCMB8CvrH17ZQR8pt2f7/005%20step%2060.png","https://images.hive.blog/DQmXCdCtB9Q3YPANPPQBwXf2g7fwC1MqCCdPyvDJB1ULWfg/005%20step%2090.png","https://images.hive.blog/DQmdBHaVokduQsVuAi25Kj1ZXPVoetPBH9EtmgAcFf6z7yP/Page_12.png"],"links":["https://hive.blog/hive-158694/@dbddv01/zed-s-choice-or-pg-11-to-13-or-draft-comic-book-created-with-ai-drawing-tools"],"app":"hiveblog/0.1","format":"markdown","description":"Detailed behind the scene explanation of my comic picture creation with artificial intelligence algorythm "}"
created2021-11-24 23:32:39
last_update2021-11-24 23:32:39
depth0
children6
last_payout1969-12-31 23:59:59
cashout_time2021-12-01 23:32:39
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value42.677 HBD
promoted0.000 HBD
body_length9,833
author_reputation8,277,971,816,956
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,990,201
net_rshares19,427,712,450,426
author_curate_reward""
vote details (168)
@discovery-it ·
<div class="pull-left">https://cdn.steemitimages.com/DQmTAn3c753LR7bHCLPo96g9UvRMaPFwaMYn8VQZa85xczC/discovery_logo_colore%20-%20Copia.png</div><br> This post was shared and voted inside the discord by the curators team of <a href="https://discord.gg/cMMp943"> discovery-it</a> <br>Join our community! <a href = "https://hive.blog/trending/hive-193212"> hive-193212</a><br>Discovery-it is also a Witness, vote for us <a href = "https://hivesigner.com/sign/account-witness-vote?witness=discovery-it&approve=true"> here</a>  <br>Delegate to us for passive income. Check our <a href = "https://hive.blog/hive-193212/@discovery-it/delegations-program-80-fee-back"> 80% fee-back Program</a> <hr>
properties (22)
authordiscovery-it
permlinkre-dbddv01-gzbm8a2e54
categoryhive-158694
json_metadata"{"app": "beem/0.24.26"}"
created2021-11-25 01:27:12
last_update2021-11-25 01:27:12
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 01:27:12
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length690
author_reputation18,119,966,633,181
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,991,872
net_rshares0
@hivebuzz ·
Congratulations @dbddv01! You have completed the following achievement on the Hive blockchain and have been rewarded with new badge(s):

<table><tr><td><img src="https://images.hive.blog/60x70/http://hivebuzz.me/@dbddv01/upvoted.png?202111250359"></td><td>You received more than 4250 upvotes.<br>Your next target is to reach 4500 upvotes.</td></tr>
</table>

<sub>_You can view your badges on [your board](https://hivebuzz.me/@dbddv01) and compare yourself to others in the [Ranking](https://hivebuzz.me/ranking)_</sub>
<sub>_If you no longer want to receive notifications, reply to this comment with the word_ `STOP`</sub>



**Check out the last post from @hivebuzz:**
<table><tr><td><a href="/hivebuzz/@hivebuzz/pum-202111-21"><img src="https://images.hive.blog/64x128/https://i.imgur.com/Q5WIQfE.png"></a></td><td><a href="/hivebuzz/@hivebuzz/pum-202111-21">Hive Power Up Month - Feedback from Day 21</a></td></tr></table>
properties (22)
authorhivebuzz
permlinkhivebuzz-notify-dbddv01-20211125t041118
categoryhive-158694
json_metadata{"image":["http://hivebuzz.me/notify.t6.png"]}
created2021-11-25 04:11:18
last_update2021-11-25 04:11:18
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 04:11:18
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length926
author_reputation94,138,173,687,360
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,994,188
net_rshares0
@jilt ·
!PIZZA
properties (22)
authorjilt
permlinkre-dbddv01-20211125t112923905z
categoryhive-158694
json_metadata{"tags":["hive-158694","art","comics","tutorial","ai","ocdb","sketchbook","drawing"],"app":"ecency/3.0.23-mobile","format":"markdown+html"}
created2021-11-25 10:29:24
last_update2021-11-25 10:29:24
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 10:29:24
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length6
author_reputation15,466,263,197,448
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,999,598
net_rshares0
@lallo ·
I love this creation, thank for sharing all the step...very interesting and inspiring :)

!discovery 36
!PIZZA
properties (22)
authorlallo
permlinkre-dbddv01-r33tcp
categoryhive-158694
json_metadata{"tags":["hive-158694"],"app":"peakd/2021.09.1"}
created2021-11-25 01:26:57
last_update2021-11-25 01:26:57
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 01:26:57
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length110
author_reputation14,887,353,106,969
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,991,863
net_rshares0
@lavista ·
Very detailed description of your workflow, thank you :)
properties (22)
authorlavista
permlinkre-dbddv01-r34eog
categoryhive-158694
json_metadata{"tags":["hive-158694"],"app":"peakd/2021.09.1"}
created2021-11-25 09:07:30
last_update2021-11-25 09:07:30
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 09:07:30
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length56
author_reputation10,014,103,460,862
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,998,406
net_rshares0
@pizzabot · (edited)
RE: Zed's choice : behind the scene explanation of a picture creation - full detailed example
<center>PIZZA! PIZZA! 

PIZZA Holders sent <strong>$PIZZA</strong> tips in this post's comments:
lallo tipped dbddv01 (x1)
@jilt<sub>(4/10)</sub> tipped @dbddv01 (x1)

<sub>You can now send $PIZZA tips in <a href="https://discord.gg/hivepizza">Discord</a> via tip.cc!</sub></center>
properties (22)
authorpizzabot
permlinkre-zed-s-choice-behind-the-scene-explanation-of-a-picture-creation-full-detailed-example-20211125t012757z
categoryhive-158694
json_metadata"{"app": "beem/0.24.26"}"
created2021-11-25 01:27:57
last_update2021-11-25 10:30:30
depth1
children0
last_payout1969-12-31 23:59:59
cashout_time2021-12-02 01:27:57
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length282
author_reputation1,209,201,841,151
root_title"Zed's choice : behind the scene explanation of a picture creation - full detailed example"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id107,991,883
net_rshares0