AI Art With ControlNet

In this blog, we show you how to use an input image as condition and generate an image with similar structure (canny edge) using ControlNet.

Edge Detection

Edge detection can be done simple with few lines of code using OpenCV.

image = cv2.Canny(image,low_threshold, high_threshold)
image = image[:, :, None]
image = np.concatenate([image, image, image], axis=2)
canny_image = Image.fromarray(image)

Sketch Of A Living Room - Input Image For ControlNet Generator

Generate AI Art With Condition Image (Canny Edge)

The generation of AI artwork with ControlNet is quite simple with few lines of code as below:

output = pipe(
    prompt,
    canny_image,    
    generator=generator,
    num_inference_steps=50,
)

AI Generated Design Prototypes Using ControlNet

Detail code at: https://github.com/tsnguyenducphuong/ai-art-public

About AI Illustwitter, an amazing AI-powered Creative Design App: It so simple and quick to generate high quality, super resolution (8K, 8192x8192 pixels) images within seconds from text description on mobile devices. It can be used to generate AI artworks, nice images for design prototypes, illustrated images for social media posts, news.
There is no limit what kind of images can be generated from text using AI Illustwitter. The artwork can then be shared via AR-vatar and viewed in Augmented Reality.
In addition, you will enjoy the advanced AI-powered Image Editing features to named a few: Generative Fill, Generative Expand, Magic Move, AI Upscaler (upscale to 4X, 16X, and 64X to 8K 8192x8192 pixels images all in one go!), background remover, change background easily using text description and last but not least the magic AI Layering and automatic Repositioning in which intricate image is break down into separate layers and automatically reposition objects, transforming the way we approach image editing. AI Illustwitter is available to download from Apple Store and Google Play. Check it out!

Author: AI Illustwitter

Next article to read:

Magic Background

Creative expression. Whether you're creating content for social media, preparing e-commerce product's catalog, or creating marketing materials, the image's background can significantly impact the perception of your image. The right background can set the tone for your image. With AI Illustwitter Magic Background tool, now you can remove the background, create realistic shadow, generate blur background, change background image, or convert to negative background color...All with a simple click. Read more about AI Illustwitter at: https://ai-illustwitter.art

30th September 2024

5 min read

Magic Overlay

Remember the time using tool like Photoshop to combine multiple images into one frame? That could be a time-consuming task for creating layer masks, multiple layers and arrange them over your original base image. Now with AI Illustwitter Magic Fill and Magic Overlay, adding new objects or place it in the middle layer is just a simple click. Read more about Magic Overlay at: https://ai-illustwitter.art

24th September 2024

5 min read

Magic Fill

AI Illustwitter Magic Fill is an advanced photo editing tool that uses AI to seamlessly fill in or replace parts of an image. Think of it as a digital brush with a magic touch, when you fill or remove, Magic Fill analyzes the surrounding area and magically generates new content to fill the gap. This tool creates a natural, coherent look that is often indistinguishable from the original photo. Read more about AI Illustwitter at: https://ai-illustwitter.art

14th September 2024

5 min read

Magic Relight

In this article, I introduce you a powerful tool for adding professional light to your photos/images in real-time. The AI Illustwitter Photo Editor tool, so called Magic Relight let you add studio lights to your existing photos without hassle.

10th September 2024

5 min read