The Training Costs of Ai-Models Over Time

"The rising cost of training Al models over time, based on data from the 2024 Artificial Intelligence Index Report released by Stanford University.

How Training Cost is Determined ❓

StanfordUniversity collaborated with research firm Epoch AI to estimate AI model trainingcosts, which were based on cloud compute rental prices.

Key factors that were analyzed include the model's training duration, the hardware's utilization rate, and the value of the training hardware.

The cost of training AI models has increased dramatically these past few years.

For instance, it cost just $930 to train Transformer, a groundbreaking neuralnetwork architecture introduced in 2017-yet it cost over$78 million to train GPT4o last year.

Google's AI model, GeminiUltra, costs even more, at a staggering $191 million. As of early 2024, the model outperformed GPT4o on several metrics, most notably across the Massive Multitask Language Understanding (MMLU) benchmark.

This benchmark serves as a crucial yardstick for gauging the capabilities of large language models, evaluating its knowledge and problemsolving proficiency across 57 subject areas. "

Author

AiUTOMATING PEOPLE, ABN ASIA was founded by people with deep roots in academia, with work experience in the US, Holland, Hungary, Japan, South Korea, Singapore, and Vietnam. ABN Asia is where academia and technology meet opportunity. With our cutting-edge solutions and competent software development services, we're helping businesses level up and take on the global scene. Our commitment: Faster. Better. More reliable. In most cases: Cheaper as well.

Feel free to reach out to us whenever you require IT services, digital consulting, off-the-shelf software solutions, or if you'd like to send us requests for proposals (RFPs). You can contact us at [email protected]. We're ready to assist you with all your technology needs.

© ABN ASIA