This version of Stable Diffusion has been fine tuned from CompVis/stable-diffusion-v1-3-original to accept CLIP image embedding rather than text embeddings. This allows the creation of "image variations" similar to DALLE-2 using Stable Diffusion. This version of the weights has been ported to huggingface Diffusers, to use this with the Diffusers library requires the Lambda Diffusers repo.
Let's get started and learn how to use Stable Diffusion Image Variations using lambda diffusers!
To run this tutorial we will use Google Colab and Google Drive
Download the necessary files:
install the required libs:
Load the pipeline.
download the intial image:
1. we load the image
2. run the model
3. save the output images
Here we resize the images then concat them horizontally and show them
As you can see here we have different variations of the intial image