UAE's TII Changes The Game For AI Language Models With New Architecture 

KUALA LUMPUR, Aug 13 (Bernama) -- The Technology Innovation Institute (TII), a global scientific research centre and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B.

The new model is the number one globally performing open source State Space Language Model (SSLM), as independently verified by Hugging Face, according to a statement.

TII Chief Executive, Dr Najwa Aaraj said the company continued to push the boundaries of technology with its Falcon series of artificial intelligence (AI) models.

bootstrap slideshow

“The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives,” she said.

Meanwhile, ATRC Secretary General and Adviser to the United Arab Emirates (UAE) President for Strategic Research and Advanced Technology Affairs, Faisal Al Bannai said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development.”

As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture, in which SSLMs have a low memory cost and do not require additional memory to generate arbitrary long blocks of text.

bootstrap slideshow

This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.

For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B and Llama 3 8B, as well as Mistral’s 7B on the newly introduced benchmarks from Hugging Face.

Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the first model on Hugging Face’s new tougher benchmark leaderboard.

-- BERNAMA