Futureverse Unveils JEN-1: Revolutionary AI Model for Real-time Text-to-Music Generation
In Brief
Futureverse, a pioneering AI and metaverse technology company, has introduced JEN-1, an AI model designed for text-to-music generation.
JEN-1 represents a remarkable leap forward in music AI by achieving unprecedented levels of text-music alignment and music quality, all while maintaining remarkable computational efficiency.
Futureverse, an AI and metaverse technology and content company, has announced the launch of JEN-1, a new AI model for text-to-music generation. JEN-1 is a significant advancement in music AI, as it is the first model to achieve state-of-the-art performance in text-music alignment and music quality while maintaining computational efficiency.
“We extensively evaluate JEN-1 against state-of-the-art baselines across objective metrics and human evaluations. Results demonstrate JEN-1 produces music of perceptually higher quality (85.7/100) compared to the current best methods (83.8/100),” Futureverse wrote.
Creating music from text is difficult because of the intricate nature of musical arrangements and the need for a high sampling rate. According to Futureverse’s paper, JEN-1 can overcome these challenges as its diffusion model is based on autoregressive and non-autoregressive training. This allows JEN-1 to generate music that is realistic and creative.
Because of its computational efficiency, it is possible to use JEN-1 to generate music in real-time, which opens up new possibilities for music production, live performance, and virtual reality.
The AI model uses a special autoencoder and diffusion model to directly produce detailed stereo audio at a high sampling rate of 48kHz. Moreover, JEN-1 avoids the usual quality loss when converting audio features. The model is trained in multiple tasks, including generating music, continuing music sequences, and filling in missing parts, making it versatile.
JEN-1 also cleverly combines autoregressive and non-autoregressive methods to balance the trade-off between capturing dependencies in music and generating it efficiently. In addition, the AI model employs smart learning techniques and is trained to handle various musical aspects at once.
JEN-1 Versus MusicLM, MusicGen, and Other AI Models
Futureverse compares JEN-1 with the current state-of-the-art models, such as MusicLM from Google and MusicGen from Meta, and demonstrates that its approach produces better results in fidelity and realism.
The evaluation was based on the performance of different models on the MusicCaps test set, which is a dataset of music and text pairs. Futureverse used both quantitative and qualitative measures to evaluate the models. Quantitative measures included the FAD (Fidelity-Awareness-Disentanglement) score and the CLAP (Continuity-and-Local-Anomaly-Penalties) score. Qualitative measures included human assessments of the quality and alignment of the generated music.
The results showed that JEN-1 outperformed the other models on quantitative and qualitative measures. JEN-1 had the highest FAD and CLAP scores and received the highest scores from human assessors. In addition, JEN-1 was more computationally efficient than the other models, with only 22.6% of the parameters of MusicGen and 57.7% of the parameters of Noise2Music.
JEN-1 is a sign of the growing potential of AI in the music industry. AI is already used to create music, but JEN-1 is a significant step forward. It is the first model to achieve state-of-the-art performance on both quantitative and qualitative measures, and it is also more computationally efficient than previous models.
Read more:
- Top 20 AI Text-to-Music samples with prompts by Mubert
- Google AI Announced the First-ever Text-to-Music Generator AudioLM
- MusicLM: a new text-to-music and image-to-music AI model from Google
- Futureverse Joins Forces with Outlier Ventures for The Futureverse Base Camp Accelerator Program
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
More articles
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
