Meta's future Llama AI models are trained on a GPU cluster that is “bigger than anything else”

 • 15806 переглядiв

Mark Zuckerberg announced that Meta is training a new version of the Llama model on an unprecedentedly large cluster of GPUs. The company is increasing investments in AI amid a 9% increase in operating expenses and a 22% increase in sales.

Meta CEO Mark Zuckerberg announced the latest token in generative artificial intelligence training - according to him, the next release of the Llama model is training on the 'Bigger Than Anything' GPU cluster.

Writes UNN with reference to Wired.

Managing such a gigantic array of chips to develop Llama 4 is likely to present unique engineering challenges and require large amounts of energy. Meta CEO Mark Zuckerberg on Wednesday set a new milestone in generative AI training, saying the company's next major release of its Llama model is being trained on a GPU cluster that is "the biggest ever.

Help

This year, Meta's total operating expenses increased by about 9%. Total sales (mainly due to advertising) grew by more than 22%, resulting in higher margins and higher profits.

Meanwhile, OpenAI, which is still a non-profit company and is considered the undisputed leader in the development of advanced AI, announced that it is developing GPT-5, the successor to the model that ChatGPT is currently running on.

OpenAI has raised $6.6 billion in investments03.10.24, 05:00

OpenAI said that GPT-5 will be larger than its predecessor, but did not say anything about the pool of computers it uses for training. OpenAI also said that in addition to scale, GPT-5 would include other innovations, including a newly developed approach to reasoning.

Meta will allow third-party apps to call WhatsApp and Messenger from 202708.09.24, 03:20

Popular
Iranian Foreign Minister departs for Moscow for urgent meeting with Putin

 • 10152 переглядiв

Massive drone attack on Odesa: at least 13 people injured

 • 10880 переглядiв

Trump warned of a possible explosion of Iranian oil pipelines within three days

 • 8840 переглядiв

Explosion occurs near a store in Kharkiv: grenade fuse found

 • 13383 переглядiв

News by theme
Zelenskyy starts regional discussions on internal Strengthening Plan

 • 20267 переглядiв

The UN discussed mass violation of human rights in russia and belarus

 • 19328 переглядiв

The United States and South Korea call on the DPRK to withdraw its troops from Russia

 • 18644 переглядiв

Zelensky signs decree on dismissal of Prosecutor General Kostin

 • 14913 переглядiв

FT: Chinese sanctions hit US drone maker supplying Ukraine

 • 15910 переглядiв

The wreckage of a downed drone fell on the territory of an IDP camp in Kyiv region

 • 20018 переглядiв

Typhoon Kong-ray hits Taiwan in an unusual season

 • 16860 переглядiв

20th drone attack on Kyiv in October: what was damaged and what are the consequences

 • 46764 переглядiв