ElevenLabs Unveils Music Generation Model That Can Switch Genres Mid-Track

In a significant advancement for voice AI technology, ElevenLabs has introduced Music v2, a cutting-edge music generation model capable of switching genres mid-track. This innovative tool is designed to handle the complexities of both vocals and composition, marking a substantial upgrade from its predecessor. The new model, which arrives nearly 10 months after the launch of the first version, boasts impressive capabilities.

It can transition from opera to heavy metal and back, deliver rapid-fire rap without sacrificing coherence, and incorporate non-musical sound effects into a track. Artists can now select specific sections of a song and recreate them using prompts, all without altering other parts of the track. This level of control extends to building songs by sections, such as intro, verse, and chorus, which can then be stitched together.

ElevenLabs also emphasizes that Music v2 performs more reliably across languages, lyrics, vocals, and arrangements. This development comes as AI labs are racing to release professional-grade music generation models. Notably, Google, Stability AI, and Suno have recently unveiled their own models, capable of generating longer and more complex tracks.

Google's Flow Music tool, for instance, allows users to easily create covers, edit songs by sections, and generate music videos. A critical aspect of ElevenLabs' Music v2 is its foundation on licensed data, cleared for commercial use. This enables users to freely utilize the tracks, avoiding the copyright issues that have plagued other AI music startups like Suno and Udio.

By securing the necessary deals with labels, ElevenLabs is positioning itself as a leader in the AI music generation space. The new model is currently available on ElevenLabs' ElevenCreative tool, aimed at marketing and branding teams, as well as its newly launched ElevenMusic platform for creating AI-generated songs. Availability on ElevenAPI is slated to follow shortly, further expanding access to this groundbreaking technology.