One of the most highly-anticipated AI-related products has just arrived: OpenAI's AI video generator Sora launchedon Monday as part of the company's 12 Days of OpenAIevent.
OpenAI has provided sneak peeks at Sora's output in the past. But,Michael Maien how different is it at launch? OpenAI has certainly been hard at work to update and improve its AI video generator in preparation for its public launch.
YouTuber Marques Brownlee had a first look at Sora, releasing his video review of the latest OpenAI product hours before OpenAI even officially announced the launch. What did Brownlee think?
According to Brownlee, his Sora testing found that the AI video generator excels at creating landscapes. AI generated overhead, drone-like shots of nature or famous landscapes look just like real-life stock footage. Of course, as Brownlee points out, if you are specifically well-versed in how the surroundings of a landmark look, one might be able to spot the differences. However, there's not too much that looks distinctly AI-generated in these types of Sora-created clips.
SEE ALSO: How to try OpenAI's Sora right nowPerhaps the type of video Sora is best able to create, according to Brownlee, are abstract videos. Background or screensaver type abstract art can be made quite well by Sora even with specific instructions.
Brownlee also found that Sora-generated certain types of animated content, like stop-motion or claymation type animation, look passable at times as the sometimes jerky movements that still plague AI video look like stylistic choices.
SEE ALSO: 7 wild Sora videos blowing up social media after its launchMost surprisingly, Brownlee found that Sora was able to handle very specific animated text visuals. Words often show up as garbled text in other AI image and video generation models. With Sora, Brownlee found that as long as the text was specific, say a few words on title card, Sora was able to generate the visual with correct spelling.
Sora, however, still presents many of the same problems that all AI video generators that came before it have struggled with.
SEE ALSO: OpenAI's Sora is officially hereThe first thing Brownlee mentions is object permanence. Sora has issues with displaying, say, a specific object in an individual's hand throughout the runtime of the video. Sometimes the object will move or just suddenly disappear. Just like with AI text, Sora's AI video suffers from hallucinations.
Which brings Brownlee to Sora's biggest problem: Physics in general. Photorealistic video seems to be quite challenging for Sora because it can't just seem to get movement down right. A person simply walking will start slowing down or speeding up in unnatural ways. Body parts or objects will suddenly warp into something completely different at times as well.
And, while Brownlee did mention those improvements with text, unless you are getting very specific, Sora still garbles the spelling of any sort of background text like you might see on buildings or street signs.
Sora is very much an ongoing work, as OpenAI shared during the launch. While it may offer a step up from other AI video generators, it's clear that there are just some areas where all AI video models are going to find challenging.
Topics Artificial Intelligence OpenAI
Is that 'Hawkeye' baddie the MCU's way into Netflix's Marvel shows?In praise of YouTubers who don't say a word'Bachelor in Paradise' is under fire for queerbaiting viewersBernie Sanders just hopped on the Cardi B bandwagon'The Humans' is a horror movie for those who fear Thanksgiving family timeUnfortunately, you can't hook up with the Doncaster CouncilDonald Trump suggests he may pardon Jack Johnson and you know whyArt student made Owen Wilson's 'wow' into an absolute work of art17 times Rob Delaney's Twitter game was absolutely off the chartsIt's OK to play a basic 'Dungeons and Dragons' characterReddit dude's Photoshopped birthday party is the ultimate 'tag yourself'Chrissy Teigen misses her Neopets very muchThe only student to walk out for gun control last month rallied his classmates for ColumbineFormer Google employees sue, claim company violated 'Don't be evil' mandateYes, you can microwave a Turkey if you absolutely mustNorwegian government has asked high school graduates to please not have sex on roundaboutsFreeform and 'Nightline' team up for Parkland shooting documentaryHow to stop iPhone photo 'Memories' alertsImagine what the rest of the "Hawkeye" Captain America musical looks likeKanye West has finally returned to Twitter to share some more sage advice 'Golden' is an insightful and necessary post Michelle Williams' 'All the Money in the World' pay gap is a bummer Allison Williams on the importance of the Time's Up movement Jeopardy names Mike Richards and Mayim Bialik as future hosts Samsung announces the Galaxy Z Flip 3 5G Judge slams USA Gymnastics doctor for saying victim statements about abuse hurt his mental health People think Millie Bobby Brown is a doppelgänger for young Natalie Portman How to use 'Shake to Undo' typing on iPhone PornHub had a spike in traffic after Hawaii missile alert all clear How to watch Samsung's Galaxy Unpacked 2021: foldable phone edition Issa Rae had a really awkward moment when paparazzi confused her with another black woman Paul Thomas Anderson doesn't really care for this horrible photo of him and Maya Rudolph NASA's Hubble Space Telescope spots a gem of a spiral galaxy This nerdy PowerPoint party theme is kind of genius All the fiercest signs from the Time's Up rally in London Tide Pod pizza marks the saturation point for a dumb viral meme Who is Captain Britain? The secret history of the MCU's new superhero Rian Johnson shuts down fan backlash about Luke Skywalker's big trick Facebook shut down political ad research, daring the U.S. to regulate How scientists are preparing wheat for climate change