Meta’s AudioCraft AI Can Generate Music And Sound Effects From Text Prompts: How It Works – News18

Reported By: Shaurya Sharma

Reported By: Shaurya Sharma

Last Updated: August 03, 2023, 12:29 IST

Menlo Park, California, USA

Meta AudioCraft wants text-based prompts to create music. (Image: Meta)

Ever considered a ChatGPT-like device, however for producing music? Meta has achieved precisely that with its AudioCraft generative AI device. Read on to know the way it works.

Creating unique soundtracks for tasks of every kind is a time-consuming and costly course of that requires the experience and abilities of an artist. But what if an AI-powered device may create a customized soundtrack suited to your undertaking with just some prompts? Meta has achieved precisely that with its AudioCraft generative AI device. Meta guarantees that customers can create “high-quality, realistic audio and music from text” with the device household.

Meta notes that whereas AI generated photographs have taken off—AI-generated audio continues to be lagging behind, however with the brand new AudioCraft device household, customers will be capable of create “music, sound, compression, and generation—all in the same place.”

Image: Meta

The device is split into three fashions: AudioGen, MusicGen, and EnCodec. AudioGen generates audio from textual content prompts based mostly on public sound results, whereas MusicGen does the identical factor however with music licensed by Meta. The EnCodec decoder—alternatively—permits for increased high quality music era with fewer artifacts.

Users Can Generate a Slew of Sound Effects 

Meta additionally claims to be releasing pre-trained AudioGen fashions, which is able to let customers create environmental sounds and sound results—equivalent to a canine barking, vehicles honking, or footsteps on a wood flooring.

“The AudioCraft family of models are capable of producing high-quality audio with long-term consistency, and they’re easy to use,” Meta stated.

“With AudioCraft, we simplify the overall design of generative models for audio compared to prior work in the field—giving people the full recipe to play with the existing models that Meta has been developing over the past several years while also empowering them to push the limits and develop their own models,” it added.

Meta Has Made AudioCraft Tool Family Models Open Source

Meta can also be making its audio era instruments open supply, like its Llama 2 LLM, in order that researchers and builders can create their very own fashions. Meta claims that by open sourcing the fashions, it might probably assist advance the sector of AI-generated audio.

Shaurya SharmaShaurya Sharma, Sub Editor at News18, stories on shopper and gaming expertise. He has been serving to individuals work out their tech to make knowledgeable cho…Read More

Source: www.news18.com

Like this post? Please share to your friends: