(Menarfin——AETOSWire) The Falcon 40B, the UAE’s first large-scale open source AI model with 40 billion parameters launched last week by the Abu Dhabi Institute of Technology and Innovation (TII), soared to the top of Hugging Face’s latest Open Large Language Model (Master of Laws) list. Hugging Face, an American company that seeks to democratize artificial intelligence through open source and open science, is considered the world’s leading independent validator of AI models.The Falcon 40B managed to beat established models such as Meta’s LLaMA (including its 65B model), Stability AI’s StableLM, and Together’s RedPajama for the coveted ranking. The index draws on four key benchmarks from the Eleuther AI Language Model Evaluation Tool, a comprehensive framework for evaluating generative language models: the AI2 Reasoning Challenge (25-shot), a set of elementary school science questions; HellaSwag (10-shot), a set of MMLU (5-shot), a commonsense reasoning test that is easy for humans but challenging for SOTA models; MMLU (5-shot), a test that measures the multi-task accuracy of text models; TruthfulQA (0-shot), a A test that measures whether a language model is realistic in generating answers to questions.
Hugging Face’s Open LLM Leaderboard is an objective evaluation tool open to the AI ​​community that tracks, ranks, and evaluates LLMs and chatbots as they are released.
Falcon 40B was trained on 1 trillion tokens, marking an important turning point for the UAE towards AI leadership, enabling the model’s weights to be widely used for research and commercial exploitation. The new ranking confirms the model’s strength in making AI more transparent, inclusive, and accessible for the benefit of humanity.
With this latest development, TII has managed to secure the UAE a place in generating AI models, enabling it to join the exclusive list of countries committed to driving innovation and collaboration in AI.
TII is already working on the next version of its Falcon – 180B AI model. To learn more about the current open source Falcon 40B AI model, visit: falconllm.tii.ae. The initial announcement about Falcon 40B can be found here: Emirates Institute for Technology Innovation launches open-source ‘falcon 40b’ large-scale language model for research and commercial exploitation.
For more information, please visit
permalink
