Diving into 3D: Stability AI Unveils AI-Based 3D Model Creation Platform

Stability AI, the company responsible for the text-to-image AI model Stable Diffusion, is venturing into generative AI's potential next frontier — 3D model creation tools with the launch of Stable 3D. This AI-powered application generates textured 3D objects compatible with modeling and game development platforms, including Blender, Maya, Unreal Engine, and Unity.

Stable 3D, which is currently available in private preview for select customers who contact Stability, promises to enable non-experts to generate "draft-quality" 3D models in mere minutes. The company highlights the potential value of the tool for graphic designers, digital artists, and game developers, who can find 3D content creation a complex, often time-consuming task. It positions Stable 3D as a tool that can empower independent creators to generate thousands of 3D objects daily at minimal cost.

Like its counterparts in the market, Stable 3D allows users to describe a desired 3D model in natural language or upload an image or illustration to convert into a model. The output 3D models are produced in the “.obj” file format, making them compatible with most standard 3D modeling tools.

The data used to train Stable 3D has not yet been disclosed by Stability resulting in potential IP concerns, especially for commercial users. Infringements could occur if any copyrighted data were utilized without the necessary licensing. The company was previously sued by Getty and several artists for allegedly using their work to train Stable Diffusion without obtaining appropriate permissions or making necessary payments. Stability AI has established a partnership with Spawning in response to these issues to honor "opt-out" requests from artists.

Stability AI is stepping into the quickly evolving and already competitive market of AI-powered 3D model generation, standing alongside platforms and startups such as 3DFY, Scenario, Kaedim, Auctoria, Mirage, Luma, Hypothetic as well as established players like Autodesk and Nvidia. Both incumbents and tech giants like Meta and OpenAI have also explored 3D asset generation.

As it ventures into the crowded 3D model generation arena, Stability AI may be seeking to diversify or pivot from its original focus, particularly regarding the competition it faces from other generative AI platforms like Midjourney and OpenAI.

The company is also diversifying by launching new features for its online AI-powered photo editing suite, including a model fine-tuning feature and a “sky replacer” tool. These join Stability AI’s expanding product portfolio, including the music-generating suite Stable Audio, the doodle-creating app Stable Doodle, and a ChatGPT-like chatbot. Yet, these innovations come amid reported financial struggles and allegations of not paying wages and payroll taxes on time. Despite its challenges, Stability AI has raised significant funding and continues to seek a higher valuation.