UAE’s ChatGPT competitor launches in Abu Dhabi with 40 billion parameters – News

Large language models can be used to create chatbots, virtual assistants, and for language translation, content generation, and sentiment analysis

The UAE now has its own homegrown competitor, ChatGPT.

The Technology Innovation Institute (TII), the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has launched “Falcon LLM,” a fundamental large language model (LLM) with 40 billion parameters that outperforms ChatGPT3.

The AI ​​Intercentric Unit of the AI ​​and Digital Sciences Research Center (AIDRC) is the team that built Noor, the world’s largest Arabic language model, and they built Falcon LLM, trained on 1 trillion tokens.

The model uses only 75% of the training computation of GPT-3, 40% of Chinchilla, and 80% of PaLM-62B.

Today, recent advances in large-scale language models have demonstrated their ability to generate creative text, solve complex problems, and bring enormous benefits to billions of people. LLM can be used in a wide range of applications, such as chatbots, virtual assistants, language translation, content generation, and sentiment analysis.

They can help businesses streamline customer service operations by providing efficient and effective responses to customer inquiries. This deep technology enables companies and countries to save huge amounts of money—from improving efficiency to reducing labor costs and identifying new revenue streams—simply by implementing them in a business or sector. Additionally, on-premises LLM is ideal for organizations that need to process and manage confidential or proprietary data in real time. This is critical to protecting data privacy to maintain a competitive advantage.

Commenting on this LLM breakthrough, Dr. Ray O. Johnson, CEO of TII said, “2023 is proving to be the year of artificial intelligence. Falcon LLM is a milestone announcement for us, but it’s just the beginning. By the end of the year, we will share news of a significant increase in capabilities in the field.”We know this is the beginning of an important journey,” Johnson continued, “and we will continue to provide the region with our own AI National AI strategy is aligned. “

Professor Mérouane Debbah, Principal Investigator at the AI ​​and Digital Sciences Research Centre, said: “We are excited to advance the world’s understanding of the power and benefits of these LLMs, which will have important implications in fields as diverse as education, healthcare, film production and CGI. This is an important milestone in the field as the country’s economy continues to grow and diversify. The Falcon LLM model is just the beginning of a new journey.”

Dr Ebtesam Almazroui, Director of the AI ​​Inter-Centre Unit at AIDRC and head of the LL.M. program, who played a key role in building the LL.M. Its emphasis on innovation and technology.The development of the model is part of our national economic vision and strategic plan “We the UAE 2031”.

“We are pleased to announce the breakthrough achievement of our Falcon LLM 40B model, which significantly outperforms models such as BLOOM and GPT-3, even at a fraction of the size. Thanks to a state-of-the-art data pipeline, Falcon LLM also improves new generation models. For example, it has comparable performance to Chinchilla (from DeepMind) and PaLM-62B (from Google), and is much cheaper to train in comparison.”

“Falcon LLM was trained on the scaling laws of Hoffmann et al., and the model remained relatively modest in size with unprecedented data quality. We sincerely congratulate the entire team for their tireless efforts in this pioneering endeavor. With the Falcon LLM 40B as our The flagship LLM model, we believe the UAE will continue to lead the knowledge economy, driving progress and prosperity.”