Can Baidu’s AI Chatbot Ernie Outperform OpenAI’s ChatGPT?
In Brief
Baidu’s ChatGPT-style service outperformed OpenAI’s chatbot on multiple measures, according to the company.
The latest AI model from Baidu, Ernie 3.5, surpassed ChatGPT (GPT-3.5) in comprehensive ability scores and outperformed GPT-4 in Chinese language tests.
Baidu’s CTO, Haifeng Wang, highlighted the improvements in Ernie 3.5’s efficacy, functionality, and performance in creative writing, Q&A, reasoning, code generation, training, and inference performance.
China’s leading search engine Baidu announced that its ChatGPT-style service outperformed OpenAI’s chatbot on several measures. The company said its latest Ernie AI model, Ernie 3.5, had exceeded ChatGPT (GPT-3.5) in comprehensive ability scores and outperformed GPT-4 in Chinese language tests.
One test used to evaluate Ernie 3.5 was based on standard exams for college admission or professional certification, such as law. In the test released by Microsoft, Ernie 3.5 outperformed ChatGPT and GPT-4 in Chinese, but lagged behind GPT-4 in English while still ahead of ChatGPT.
Another test was in Chinese and consisted of more than 13,000 multiple-choice questions from over 50 different domains. Ernie 3.5 scored higher than ChatGPT and GPT-4 in this test.
A third test, developed by US universities, included questions from various fields, such as science and humanities. Ernie 3.5 scored lower than both ChatGPT and GPT-4 in this test.
In a statement, Haifeng Wang (CTO of Baidu) said:
“Just three months after the beta release of Ernie Bot, Baidu’s large language model (LLM) built on Ernie 3.0, Ernie 3.5 has achieved broad enhancements in efficacy, functionality, and performance. These improvements are evident in creative writing, Q&A, reasoning, and code generation, as well as in training performance and inference performance.”
According to Baidu, its new model has improved training and inference, which enables it to achieve more rapid and cost-effective updates. Baidu also announced that its new model would support external plugins. Plugins are additional applications that allow Baidu’s AI to handle more specialized situations, such as condensing lengthy text and producing more accurate answers.
In March, Baidu became the first major Chinese tech company to introduce an AI product, the Ernie Bot, as a competitor to ChatGPT in AI language models. Other prominent Chinese technology companies, such as Alibaba, Tencent, and SenseTime, have also unveiled their own AI models.
In May, Baidu announced a $145 million VC fund through Baidu Ventures (BV) to support AI-focused startups in China. Baidu Ventures aims to become a leading VC in the AI era and has already invested in over 100 tech companies. In addition, Baidu plans to hold a competition for developers to build applications using its ERNIE language model.
Read more:
- Best 3 Chinese AI Chatbots in 2023: Ernie Bot, Tongyi Qianwen, HunyuanAide
- ChatGPT Defeats the Chinese Chatbot Ernie in All AI Benchmarks
- Secoo Group to Combine OpenAI’s GPT-4 and Baidu’s ERNIE Bot Technologies to Boost Luxury Retail Platform
- GPT-4-Based ChatGPT Outperforms GPT-3 by a Factor of 57
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
More articles
Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on agnec@mpost.io.
