Meta's future Llama AI models are trained on a GPU cluster that is “bigger than anything else”

 • 15801 переглядiв

Mark Zuckerberg announced that Meta is training a new version of the Llama model on an unprecedentedly large cluster of GPUs. The company is increasing investments in AI amid a 9% increase in operating expenses and a 22% increase in sales.

Meta CEO Mark Zuckerberg announced the latest token in generative artificial intelligence training - according to him, the next release of the Llama model is training on the 'Bigger Than Anything' GPU cluster.

Writes UNN with reference to Wired.

Managing such a gigantic array of chips to develop Llama 4 is likely to present unique engineering challenges and require large amounts of energy. Meta CEO Mark Zuckerberg on Wednesday set a new milestone in generative AI training, saying the company's next major release of its Llama model is being trained on a GPU cluster that is "the biggest ever.

Help

This year, Meta's total operating expenses increased by about 9%. Total sales (mainly due to advertising) grew by more than 22%, resulting in higher margins and higher profits.

Meanwhile, OpenAI, which is still a non-profit company and is considered the undisputed leader in the development of advanced AI, announced that it is developing GPT-5, the successor to the model that ChatGPT is currently running on.

OpenAI has raised $6.6 billion in investments03.10.24, 05:00

OpenAI said that GPT-5 will be larger than its predecessor, but did not say anything about the pool of computers it uses for training. OpenAI also said that in addition to scale, GPT-5 would include other innovations, including a newly developed approach to reasoning.

Meta will allow third-party apps to call WhatsApp and Messenger from 202708.09.24, 03:20

Popular
Jewish 'kuchky' before Passover - what it is and when it will occur in 2026

 • 18863 переглядiв

Zelenskyy revealed details of Iran's lies about supplying thousands of drones to Russia

 • 18149 переглядiв

Resident Evil Requiem game sets historic sales record for the series

 • 23364 переглядiв

IMF concerned about Ukraine's financing due to parliamentary delays

 • 25472 переглядiв

News by theme
Zelenskyy starts regional discussions on internal Strengthening Plan

 • 20256 переглядiв

The UN discussed mass violation of human rights in russia and belarus

 • 19321 переглядiв

The United States and South Korea call on the DPRK to withdraw its troops from Russia

 • 18634 переглядiв

Zelensky signs decree on dismissal of Prosecutor General Kostin

 • 14909 переглядiв

FT: Chinese sanctions hit US drone maker supplying Ukraine

 • 15900 переглядiв

The wreckage of a downed drone fell on the territory of an IDP camp in Kyiv region

 • 20011 переглядiв

Typhoon Kong-ray hits Taiwan in an unusual season

 • 16852 переглядiв

20th drone attack on Kyiv in October: what was damaged and what are the consequences

 • 46758 переглядiв