One of the most highly-anticipated AI-related products has just arrived: OpenAI's AI video generator Sora launchedon Monday as part of the company's 12 Days of OpenAIevent.
OpenAI has provided sneak peeks at Sora's output in the past. But, how different is it at launch? OpenAI has certainly been hard at work to update and improve its AI video generator in preparation for its public launch.
YouTuber Marques Brownlee had a first look at Sora, releasing his video review of the latest OpenAI product hours before OpenAI even officially announced the launch. What did Brownlee think?
According to Brownlee, his Sora testing found that the AI video generator excels at creating landscapes. AI generated overhead, drone-like shots of nature or famous landscapes look just like real-life stock footage. Of course, as Brownlee points out, if you are specifically well-versed in how the surroundings of a landmark look, one might be able to spot the differences. However, there's not too much that looks distinctly AI-generated in these types of Sora-created clips.
SEE ALSO: How to try OpenAI's Sora right nowPerhaps the type of video Sora is best able to create, according to Brownlee, are abstract videos. Background or screensaver type abstract art can be made quite well by Sora even with specific instructions.
Brownlee also found that Sora-generated certain types of animated content, like stop-motion or claymation type animation, look passable at times as the sometimes jerky movements that still plague AI video look like stylistic choices.
SEE ALSO: 7 wild Sora videos blowing up social media after its launchMost surprisingly, Brownlee found that Sora was able to handle very specific animated text visuals. Words often show up as garbled text in other AI image and video generation models. With Sora, Brownlee found that as long as the text was specific, say a few words on title card, Sora was able to generate the visual with correct spelling.
Sora, however, still presents many of the same problems that all AI video generators that came before it have struggled with.
SEE ALSO: OpenAI's Sora is officially hereThe first thing Brownlee mentions is object permanence. Sora has issues with displaying, say, a specific object in an individual's hand throughout the runtime of the video. Sometimes the object will move or just suddenly disappear. Just like with AI text, Sora's AI video suffers from hallucinations.
Which brings Brownlee to Sora's biggest problem: Physics in general. Photorealistic video seems to be quite challenging for Sora because it can't just seem to get movement down right. A person simply walking will start slowing down or speeding up in unnatural ways. Body parts or objects will suddenly warp into something completely different at times as well.
And, while Brownlee did mention those improvements with text, unless you are getting very specific, Sora still garbles the spelling of any sort of background text like you might see on buildings or street signs.
Sora is very much an ongoing work, as OpenAI shared during the launch. While it may offer a step up from other AI video generators, it's clear that there are just some areas where all AI video models are going to find challenging.
Copyright © 2023 Powered by
OpenAI's Sora review: Marques Brownlee breaks down the AI video model-纤悉无遗网
sitemap
文章
46
浏览
252
获赞
8443
Proposed tax on WhatsApp calls causes massive protests in Lebanon
After word got around in Lebanon that the government was planning to tax WhatsApp calls, thousands oYouTube ads are about to get a little less skippable
You might soon be seeing less of that “skip ad” button over on YouTube.In a video titledTwitter CEO Jack Dorsey tweets opening testimony during congressional hearing
This morning, Twitter CEO Jack Dorsey and Facebook COO Sheryl Sandberg appeared before the U.S. SenaOne of the most popular Ethereum apps sure looks like a Ponzi scheme
They're not even trying to hide it anymore. One of the most popular apps built on the Ethereum block17 times Anthony Hopkins' Twitter feed was the most wholesome place on the internet
There aren't many places on the internet that can be classified as "unequivocally wholesome".Sir AntBlackBerry announces cheaper Key2 LE starting at $399
As decent as the BlackBerry Key 2 is, it's really not worth spending $650 on when there are better pJ.K. Rowling's latest Trump burn is one of her most brutal so far
When it comes to shutting down the President on Twitter, J.K. Rowling is something of a wizard.She'sHands on with Sony's Xperia XZ3
Every Android phone maker at IFA 2018 seems to be shamelessly copying the iPhone X. Every company exCreepy wooden Melania Trump statue now overlooks her hometown
Melania Trump may have left her Slovenian hometown of Sevnica, but thanks to conceptual artist AlesIf these renders are for real, the iPad has never been so beautiful
We're less then ten days away from Apple's Sept.12 event, at which the company is likely to announceTrump blames his support of Russia on a double negative and no one's buying it
Do you know the difference between the words "would" and "wouldn't?" No? That's okay! You can stillThis actual black mirror could help you lose weight
The mirror wakes up suddenly, one glowing blue-white circle appearing like the eye of Sauron on itsTwitter's panicked response to the bitcoin scam locked out many users
Twitter's barn door has been fully, and aggressively closed — it just so happens to have slammRussell Crowe gets annoyed with all those LinkedIn requests, too
Celebrities are just like us! They get annoyed with LinkedIn emails, too.Don't believe us? Just askTrump supporters boycott Walmart for selling 'Impeach 45' merch
Donald Trump supporters are nothappy with Walmart.On Tuesday, The International Business Times repor