Connect with us
Finance Digest is a leading online platform for finance and business news, providing insights on banking, finance, technology, investing,trading, insurance, fintech, and more. The platform covers a diverse range of topics, including banking, insurance, investment, wealth management, fintech, and regulatory issues. The website publishes news, press releases, opinion and advertorials on various financial organizations, products and services which are commissioned from various Companies, Organizations, PR agencies, Bloggers etc. These commissioned articles are commercial in nature. This is not to be considered as financial advice and should be considered only for information purposes. It does not reflect the views or opinion of our website and is not to be considered an endorsement or a recommendation. We cannot guarantee the accuracy or applicability of any information provided with respect to your individual or personal circumstances. Please seek Professional advice from a qualified professional before making any financial decisions. We link to various third-party websites, affiliate sales networks, and to our advertising partners websites. When you view or click on certain links available on our articles, our partners may compensate us for displaying the content to you or make a purchase or fill a form. This will not incur any additional charges to you. To make things simpler for you to identity or distinguish advertised or sponsored articles or links, you may consider all articles or links hosted on our site as a commercial article placement. We will not be responsible for any loss you may suffer as a result of any omission or inaccuracy on the website.
NEWS

Meta unveils biggest Llama 3 AI model, touting language and math gains

Published On :

 

By Katie Paul

NEW YORK (Reuters) -Meta Platforms released the biggest version of its mostly free Llama 3 artificial intelligence models on Tuesday, boasting multilingual skills and general performance metrics that nip at the heels of paid models from rivals like OpenAI.

The new Llama 3 model can converse in eight languages, write higher-quality computer code and solve more complex math problems than previous versions, the Facebook parent company said in blog posts and a research paper announcing the release.

With 405 billion parameters, or variables that the algorithm takes into account to generate responses to user queries, it dwarfs the previous version released last year though is still smaller than leading models offered by competitors.

OpenAI’s GPT-4 model, by contrast, is reported to have one trillion parameters and Amazon is preparing a model with 2 trillion parameters.

Promoting Llama 3 across multiple channels, Chief Executive Mark Zuckerberg said he expected future Llama models would overtake proprietary competitors by next year. The Meta AI chatbot powered by those models was on track to become the most popular AI assistant by the end of this year, with hundreds of millions of people using it already, he said.

The release comes as tech companies are racing to show that their growing portfolios of resource-hungry large language models can deliver significant enough gains in known problem areas like advanced reasoning to justify the gargantuan sums that have been invested in them.

Meta’s own top AI scientist has said he believes such models will hit up against limits on reasoning and that other types of AI systems will be needed to produce breakthroughs.

In addition to its flagship 405 billion parameter model, Meta is also releasing updated versions of its lighter-weight 8 billion and 70 billion parameter Llama 3 models initially introduced in the spring, the company said.

All three new models are multilingual and can handle larger user requests via an expanded “context window,” which Meta’s head of generative AI, Ahmad Al-Dahle, said would improve the experience of generating computer code in particular.

“That was the number one feedback we got from the community,” Al-Dahle told Reuters in an interview, noting that bigger context windows give the models something akin to a longer memory that aids in processing multi-step requests.

Separately, Al-Dahle said his team had been able to improve the Llama 3 model’s performance on tasks such as solving math problems by using AI to generate some of the data on which they were trained.

Meta releases its Llama models largely free-of-charge for use by developers, a strategy Zuckerberg says will pay off in the form of innovative products, less dependence on would-be competitors and greater engagement on the company’s core social networks. Some investors have raised their eyebrows at the costs entailed, however.

The company also stands to benefit if developers opt to use its free models over paid ones, which would undercut the business models of its rivals. With its announcement, Meta touted gains on key math and knowledge tests that may make that prospect more appealing.

Although measuring progress on AI development is notoriously difficult, test results provided by Meta appeared to suggest that its largest Llama 3 model was nearly matching and in some cases besting Anthropic’s Claude 3.5 Sonnet and OpenAI’s GPT-4o, which are widely regarded as the two most powerful frontier models on the market.

On the MATH benchmark of competition level math word problems, for example, Meta’s model posted a score of 73.8, compared to GPT-4o’s 76.6 and Claude 3.5 Sonnet’s 71.1.

The model scored 88.6 on MMLU, a benchmark that covers dozens of subjects across math, science and the humanities, while GPT-4o scored 88.7 and Claude 3.5 Sonnet scored 88.3.

In their paper, Meta researchers also teased upcoming “multimodal” versions of the models due out later this year that layer image, video and speech capabilities on top of the core Llama 3 text model.

Early experiments indicate those models can perform “competitively” with other multimodal models such as Google’s Gemini 1.5 and Anthropic’s Claude 3.5 Sonnet, they said.

(Reporting by Katie Paul; Editing by Louise Heavens and Daniel Wallis)

 

Continue Reading

Why pay for news and opinions when you can get them for free?

       Subscribe for free now!


By submitting this form, you are consenting to receive marketing emails from: . You can revoke your consent to receive emails at any time by using the SafeUnsubscribe® link, found at the bottom of every email. Emails are serviced by Constant Contact

Recent Posts