New artificial intelligence model Stability AI creates 3D movies from photos
By ForGeeks Stability AI has unveiled its new artificial intelligence model, Stable Virtual Camera, which the company says can turn 2D images into “immersive” videos with realistic depth and perspective.
Stability AI has unveiled its new artificial intelligence model, Stable Virtual Camera, which the company says can turn 2D images into “immersive” videos with realistic depth and perspective.
Virtual cameras are powerful tools widely used in digital filmmaking and 3D animation to capture and navigate scenes in real time. With Stable Virtual Camera Stability AI aims to integrate generative AI, giving users more control and customization options, according to the company’s blog.
With Stable Virtual Camera Stability AI aims to integrate generative AI, giving users more control and customization options, according to the company blog.
Stable Virtual Camera can create “new views” of scenes from one or more images (up to 32) with user-defined camera angles. The model is capable of generating videos that follow “dynamic” camera paths or preset paths such as “Spiral,” “Dolly Zoom,” “Move,” and “Pan.”
The model can generate videos that follow “dynamic” camera paths or preset paths such as “Spiral,” “Dolly Zoom,” “Move,” and “Pan.”
The current version of Stable Virtual Camera, which is under research testing, can create 1:1 (square), 9:16 (portrait) and 16:9 (landscape) videos up to 1,000 frames long. However, Stability warns that in some cases, especially with images of people, animals or “dynamic textures” such as water, the quality may be lower than expected.
And it’s not as good as expected.
“Complex scenes, confusing camera paths, intersecting objects or surfaces, and irregularly shaped objects can cause flickering artifacts,” Stability notes on its blog, adding that this is especially true when the target viewpoints differ significantly from the original images.
Stability AI, which is in a difficult financial situation, is the creator of the popular Stable Diffusion image generation model. Last year, the company attracted new investment from investors such as Eric Schmidt and Napster founder Sean Parker in a bid to get the business out of the doldrums. Stability’s co-founder and former CEO, Emad Mostak, reportedly ran the company poorly, leading to financial difficulties, employee layoffs and the collapse of a partnership with Canva, causing investors to worry about the company’s future.
