Alibaba’s Qwen2 AI Model Surpasses Meta’s Llama 3

Alibaba Group Holding has unveiled Qwen2, the latest iteration of its open-source AI models, claiming it surpasses Meta Platforms’ Llama 3 in various tasks. This significant update aims to establish Alibaba as a leading force in the global AI race.

Enhanced Multilingual Capabilities
Qwen2 features five variations, with the high-end Qwen2-72B model outperforming Meta’s Llama 3-70B in benchmark tests. These tests include mathematics, coding, natural and social sciences, engineering, and the humanities. One of the standout features of Qwen2 is its multilingual pre-training, which now includes 27 languages, such as Hindi, Bengali, Urdu, Chinese, and English. This broad linguistic support allows for handling diverse linguistic contexts and addressing code-switching issues more effectively.

Technological Advancements
The Qwen2 models, ranging from Qwen2-0.5B to Qwen2-72B, offer between 490 million and 72.7 billion parameters. Notably, Qwen2-7B-Instruct and Qwen2-72B-Instruct can handle up to 128K tokens, making them adept at processing and understanding long text sequences. The models also feature technical enhancements like Group Query Attention (GQA) for faster speed, reduced memory usage, and optimized embeddings for smaller models.

Performance and Safety
Qwen2-72B, the largest model in the series, excels in natural language understanding, coding proficiency, mathematical skills, and multilingual abilities. Despite having fewer parameters than its predecessor, Qwen1.5-110B, it demonstrates the effectiveness of new training methodologies. Regarding safety, Qwen2-72B-Instruct performs comparably to GPT-4, significantly reducing harmful responses across various categories of queries.

Industry Impact and Future Plans
The launch of Qwen2 reflects Alibaba’s confidence in its AI capabilities, with the company investing heavily in AI research and development. Other Chinese tech giants, such as Tencent Holdings, are also advancing their AI models, sparking a domestic price war. Tencent’s recently announced Yuanbao chatbot, powered by its Hunyuan LLM, has been integrated into over 600 business scenarios to boost efficiency.

AI Integration in Business
Alibaba is leveraging its AI advancements to transform businesses. For instance, Alibaba.com, the company’s business-to-business cross-border sourcing platform, has introduced AI-powered tools to connect sellers and buyers more effectively. This approach aims to boost sales and enhance user experiences.

The release of Qwen2, with its superior performance and multilingual capabilities, positions Alibaba at the forefront of the AI industry. The company plans to expand its AI models, integrating vision and audio understanding to enhance multimodal capabilities. As the AI race intensifies, Alibaba’s strategic advancements signify a pivotal shift in the global tech landscape.

Source: AIM

---

Like this article?  Keep up to date with AI news, apps, tools and get tips and tricks on how to improve with AI.  Sign up to our Free AI Newsletter

Also, come check out our free AI training portal and community of business owners, entrepreneurs, executives and creators. Level up your business with AI ! New courses added weekly. 

You can also follow us on X