Technology

|

By Lottie

|

July 2023

The Game-Changing Solution For Sketch-to-Image Conversion Made by Stability AI

Image

AI-startup Stability AI, creators of the image-creating model Stable Diffusion, is launching a fresh service, Stable Doodle, which transforms hand-drawn sketches into high-quality images. The latest offering uses the recent Stable Diffusion model to examine sketches and generate an aesthetically attractive artistic interpretation.

Beginning today, Stable Doodle is accessible through ClipDrop, a platform that Stability AI acquired in March as part of its acquisition of Init ML, a startup established by former Google employees. Stability AI indicates in a blog post that the service is suitable for both experts and beginners, requiring only rudimentary sketching abilities and internet connectivity to create impressive imagery within moments.

While the market has many sketch-to-image AI tools, Stable Doodle distinguishes itself with its ability to offer more accuracy in image generation. Stable Diffusion XL, the engine behind Stable Doodle, collaborates with a "conditional control solution," T2I-Adapter, created by Tencent's R&D division, the Applied Research Center (ARC). This solution enables the Stable Diffusion XL to accept sketch input and guides it to improve the refining of the final artwork.

Along with the initial sketch, Stable Doodle takes a prompt to steer the image creation process, such as "An isometric style comfy chair" or "A cat in a jeans jacket in digital art style". However, there are certain limitations, with only 14 art styles supported at its launch.

Penguin and house art created in Stable Doodle.
Penguin and house art created in Stable Doodle.

Along with the initial sketch, Stable Doodle takes a prompt to steer the image creation process, such as "An isometric style comfy chair" or "A cat in a jeans jacket in digital art style". (We even had a go with the new AI tool which converted our doodles into wonderful works of art and origami figures.) However, there are certain limitations, with only 14 art styles supported at its launch.

Stability AI foresees Stable Doodle as a boon to professionals like designers and illustrators, helping them save precious time and enhance their work efficiency. However, they warn that the final image's quality depends on the initial sketch's detail, the prompt's descriptiveness, and the depicted scene's complexity.

Enjoying what you're reading?

See our work

"The software facilitates immediate transformation of sketched ideas into tangible designs for clientele, presentation material, websites, or even logo creation," the company suggests. "Moving forward, Stable Doodle will allow users to import a sketch and cater to specific verticals, including real estate applications, for instance."

Following a commercial slowdown, Stability AI is exploring new revenue streams with tools like Stable Doodle. The service is free, but there are limitations. Semafor reported in April that Stability AI was rapidly depleting cash reserves, prompting a search for executive help to boost sales.

Recently, Stability AI secured $25 million via a convertible note, bringing its total funding to over $125 million. However, it has yet to secure new funding at a higher valuation. The startup, last valued at $1 billion, is reportedly aiming to increase its valuation fourfold in the coming months.

Enjoyed This Tech Insight?

Don't miss out on the latest trends and developments by subscribing to our Tech Roundup Newsletter where every two weeks, we share the biggest tech headlines from around the world.

Make sure to subscribe here!