OpenAI has launched Sora, a new AI model that, while having no direct relation to the Kingdom Hearts character, is capable of letting users create what the AI research and deployment company has described as “realistic and imaginative” scenes simply through text. The model can be used to generate videos of up to a minute long, including movie trailers, CG sequences, and more.
Sample videos:
Prompt: “A movie trailer featuring the adventures of the 30 year old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors.” pic.twitter.com/0JzpwPUGPB
— OpenAI (@OpenAI) February 15, 2024
Critics/fans say:
- “Who is the spaceman in this video – where did the likeness come from ? Did OpenAi seek permission to monetise the works?”
- “Goodbye Hollywood”
- “HOLYFFFFFF
- “The hand at :09 LMFAO”
- “Can you make one of a spaceman surfing”
Sora is available to:
…red teamers to assess critical areas for harms or risks. We are also granting access to a number of visual artists, designers, and filmmakers to gain feedback on how to advance the model to be most helpful for creative professionals.
OpenAI on Sora’s capabilities:
Sora is able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background. The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world.
OpenAI on Sora’s weaknesses:
It may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.
The model may also confuse spatial details of a prompt, for example, mixing up left and right, and may struggle with precise descriptions of events that take place over time, like following a specific camera trajectory.