AI Art With ControlNet

In this blog, we show you how to use an input image as condition and generate an image with similar structure (canny edge) using ControlNet.

Edge Detection

Edge detection can be done simple with few lines of code using OpenCV.

image = cv2.Canny(image,low_threshold, high_threshold)
image = image[:, :, None]
image = np.concatenate([image, image, image], axis=2)
canny_image = Image.fromarray(image)

Sketch Of A Living Room - Input Image For ControlNet Generator

Generate AI Art With Condition Image (Canny Edge)

The generation of AI artwork with ControlNet is quite simple with few lines of code as below:

output = pipe(
    prompt,
    canny_image,    
    generator=generator,
    num_inference_steps=50,
)

AI Generated Design Prototypes Using ControlNet

Detail code at: https://github.com/tsnguyenducphuong/ai-art-public

About AI Illustwitter, an amazing AI-powered Creative Design App: It so simple and quick to generate high quality, super resolution (8K, 8192x8192 pixels) images within seconds from text description on mobile devices. It can be used to generate AI artworks, nice images for design prototypes, illustrated images for social media posts, news.
There is no limit what kind of images can be generated from text using AI Illustwitter. The artwork can then be shared via AR-vatar and viewed in Augmented Reality.
In addition, you will enjoy the advanced AI-powered Image Editing features to named a few: Generative Fill, Generative Expand, Magic Move, AI Upscaler (upscale to 4X, 16X, and 64X to 8K 8192x8192 pixels images all in one go!), background remover, change background easily using text description and last but not least the magic AI Layering and automatic Repositioning in which intricate image is break down into separate layers and automatically reposition objects, transforming the way we approach image editing. AI Illustwitter is available to download from Apple Store and Google Play. Check it out!

Author: AI Illustwitter

Next article to read:

PNG 2 SVG

In the ever-evolving world of digital design, efficiency and versatility are keys. One of the most common challenges designers face is converting raster images, like PNGs, into scalable vector graphics (SVGs). Fortunately, AI-powered tools are stepping in to simplify this process, enabling designers to unlock new creative possibiliti1es without sacrificing quality. Read more about AI Illustwitter at: https://ai-illustwitter.art

2nd November 2024

5 min read

Magic 3D

Whether you're creating content for social media, preparing e-commerce product's catalog, or creating marketing materials, a beautiful 3D animation video can significantly impact the perception of your product. The right animation video can catch user's attention for your product. With AI Illustwitter Magic 3D tool, now you can create beautiful 3D animation of your product from a single image...All with a simple click. Read more about AI Illustwitter at: https://ai-illustwitter.art

22nd October 2024

5 min read

Magic Background

Creative expression. Whether you're creating content for social media, preparing e-commerce product's catalog, or creating marketing materials, the image's background can significantly impact the perception of your image. The right background can set the tone for your image. With AI Illustwitter Magic Background tool, now you can remove the background, create realistic shadow, generate blur background, change background image, or convert to negative background color...All with a simple click. Read more about AI Illustwitter at: https://ai-illustwitter.art

30th September 2024

5 min read

Magic Overlay

Remember the time using tool like Photoshop to combine multiple images into one frame? That could be a time-consuming task for creating layer masks, multiple layers and arrange them over your original base image. Now with AI Illustwitter Magic Fill and Magic Overlay, adding new objects or place it in the middle layer is just a simple click. Read more about Magic Overlay at: https://ai-illustwitter.art

24th September 2024

5 min read