YouTube Launches New AI Tools for Shorts Creators

The firm introduced new generative AI features for Shorts makers on Tuesday during its Made on YouTube live event. Along with a new remixing tool, a “Edit with AI” function, and other features, YouTube is introducing a customised version of Google’s Veo 3 text-to-video generative AI model to Shorts.

YouTube claims that Veo 3 Fast, a customised version of Veo 3, makes it simple to create video clips by producing outputs with reduced latency at 480p. For the first time, users can now do so with sound.

The United States, the United Kingdom, Canada, Australia, and New Zealand are all implementing this upgrade. In the future, YouTube intends to extend its operation to additional locations.

The ability to apply motion from a video to a picture is one of the new Veo features that YouTube is adding to Shorts. A static image could be animated, for instance, by having the subject do a dance from a video. According to the corporation, this is made feasible by technology that records and transmits movement between subjects.

With Veo, creators may now incorporate other styles, like origami or pop art, into their videos. Additionally, producers can now include text descriptions for objects like props or characters.

The upcoming months will see the rollout of these new features.

The new remixing tool allows authors to create memorable soundtracks for other shorts by transforming the language from eligible videos.

“You can get inspiration on YouTube, the biggest creative playground in the world, where trends are created. In a blog post, Dina Berrada, Director of Product, Shorts and Generative AI Creation at YouTube, said, “Imagine hearing a line of dialogue that sparks an idea — a funny phrase, a memorable quote, or a one-of-a-kind sound — and you want to remix it into a new sound.” “You will be able to accomplish that with our new Speech to Song remixing tool.”

According to YouTube, the soundtrack is produced by Google’s AI music model Lyria 2. The song’s creators can add their own vibes, such as “fun,” “danceable,” or “chill.”

The company claims that it will shortly test this tool and in the upcoming weeks, expand its availability to additional American producers.

Creators can create initial drafts from their raw video with the new Edit with AI capability. By selecting and organising the best moments, adding music, and implementing transitions, it turns unprocessed camera roll footage into a first draft. In Hindi or English, it can even add a voice-over that responds to the action in the video. According to YouTube, the feature’s goal is to provide filmmakers with a beginning point for their shorts.

In the upcoming weeks, YouTube will roll out the Edit with AI tool in a few areas. The feature is already being tested on Shorts and in the YouTube Create app.

Also, in the upcoming weeks, more users will be able to access additional tools like Speech to Song, which creates soundtracks from dialogue in qualified videos, and Edit with AI, which turns raw footage into a first draft video. In the upcoming months, YouTube plans to begin testing Veo features that allow Shorts to have motion and objects.

Additionally, a number of new YouTube Studio features were revealed, including one that broadens the scope of similarity identification. Through the tool, users will be able to identify and request the removal of any unauthorised videos that feature their face. Currently, all YouTube Partner Program creators can access it as an open beta.

The AI-powered conversational chat feature Ask Studio (available in the US only) and the feature to add collaborators to a video and have it show up for all of their audiences (which is scheduled to launch globally) are two more updates coming to YouTube Studio in the upcoming weeks. By the end of the year, most users will have access to A/B testing for titles and new Inspiration Tab updates, and YouTube stated that a limited test of an auto-dubbing with lip-synch tool is underway.