Zeroscope: A Free and Open-Source Text-to-Video Model
In Brief
Zeroscope is a new open-source text-to-video model that improves upon Modelscope’s foundation, offering higher resolution and a 16:9 aspect ratio.
Available in two versions, it uses offset noise to enhance data distribution and generates diverse realistic videos.
A new player has emerged in the field of text-to-video technology, and it’s completely free and open source. Zeroscope, a Gen-2 competitor, aims to transform written words into dynamic visuals.
Zeroscope builds upon the foundation laid by Modelscope and offers significant improvements. With a focus on higher resolution and a closer 16:9 aspect ratio, Zeroscope provides a more refined and professional video creation experience. Zeroscope comes without the limitations of watermarked content.
The model is available in two versions: Zeroscope_v2 567w, optimized for rapid content creation at a resolution of 576×320 pixels, and Zeroscope_v2 XL, which upscales videos to a high-definition resolution of 1024×576. The smaller model requires 7.9 GB of VRam, making it accessible for many standard graphics cards.
Zeroscope’s training involved introducing offset noise to thousands of video clips and tagged frames. This technique enhances the model’s understanding of data distribution, enabling it to generate a more diverse range of realistic videos based on textual descriptions.
Developer “Cerspense” sees Zeroscope as a direct competitor to Runway ML’s Gen-2, the commercial text-to-video model. With fine-tuning and the removal of watermarks, Zeroscope offers a viable open-source alternative, completely free for public use.
Runway’s Gen-2 remains the leading commercially available option, but Zeroscope’s arrival marks the first high-quality open-source model.
Read more about AI:
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet.
More articlesDamir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet.