A Human Forecaster Beaten by AI: The Turning Point in Metaculus Tournaments

Yann Rivière, one of the best human forecasters in the world, has been surpassed by artificial intelligence models in a tournament on Metaculus, a platform that hosts prediction competitions on global events. The AI model Preseen achieved the highest score, while another bot, Cassi, ranked second. This is the first time AI models have surpassed human forecasters in an official tournament, marking a turning point in the competition between artificial intelligence and human predictive capabilities.

Quick Response

  • Yann Rivière, top human forecaster, was beaten by AI models in a tournament on Metaculus
  • Preseen and Cassi, the winning AI models, achieved the two highest scores
  • This is the first time AI has surpassed humans in a prediction tournament
  • The progress of AI in forecasting reflects broader trends in benchmarks like FutureX and Prophet Arena
  • Companies are exploring how to integrate AI and human forecasters to improve strategic decisions

The Race for the AI Oracle: When Artificial Intelligence Surpasses Humans

The results of Metaculus reflect a broader trend. Benchmarks like ByteDance's FutureX and the University of Chicago's Prophet Arena show that AI's forecasting capabilities are improving rapidly. The Forecasting Research Institute (FRI) stated in July that the top-ranked models in its ranking are now "statistically indistinguishable" from elite human forecasters. This rapid evolution has sparked a race among AI startups to design the first model capable of consistently outperforming elite-level forecasters in any subject.

The Value of Forecasting in Companies: Beyond Prediction

The rise of AI models in forecasting raises questions about the value of forecasting within companies. Rivière, who works as a professional forecaster at the AI startup Mantic, is one of the few who has turned his talent into a job. However, relatively few forecasters help executives make strategic decisions. Companies often have to hire an army of elite forecasters to keep up with demand, which is often not feasible on a large scale.

From Financial Planning to Predictive Maintenance: The Use of AI in Forecasting

For quantitative forecasts, such as financial planning, demand forecasting, and predictive maintenance, companies have traditionally turned to time series models. For open-ended and strategic issues, such as the launch of a new product by a competitor, companies have relied on executives who filter expert opinions and customer feedback through their own experience and intuition. Now that AI is approaching parity with humans, this balance is beginning to change.

The Importance of Human Forecasters in the AI Era

Ironically, the rise of AI forecasters could make hiring human forecasters more attractive. To formulate an accurate prediction, forecasters must develop a theory that explains why one outcome is more likely than another. This process can provide insights that prove more relevant than the prediction itself. Human forecasters can provide a blueprint for how teams might use AI to gather data, experiment with unconventional ideas, and challenge established assumptions.

Yann Rivière's Path: From Curiosity to Professional Forecasting

Rivière stumbled into the world of forecasting almost by accident. The Metaculus prediction platform was one of the "many weird places on the Internet" he encountered while creating YouTube essay videos. Around 2021, while studying for his law degree, he created an account on Metaculus and made some predictions purely by chance. He gradually climbed the rankings and, in 2026, joined the elite of professional forecasters on Metaculus, taking on assignments with RAND and Swift Centre.

The Methodology of Superforecasters: Attention to Detail and Bias Control

Rivière attributes his success less to encyclopedic knowledge and more to his ability to control his own biases, combined with his insatiable curiosity. To predict whether Shakira's official song for the 2026 World Cup would achieve a higher chart position than "Waka Waka (This Time for Africa)," he evaluated numerous factors, including the slight delay with which the Billboard Hot 100 chart operates and the greater potential for virality of the current track due to the spread of the internet compared to 2010.

Superforecasting: The Art and Science of Prediction

Philip Tetlock, a psychologist at the University of Pennsylvania who coined the term "superforecaster," argues that when it comes to forecasting, IQ and subject-matter competence are not enough. In fact, knowing a subject too deeply can accentuate one's blind spots. Tetlock's 2015 book "Superforecasting: The Art and Science of Prediction," co-authored with Dan Gardner, argues that the ability to control one's biases and insatiable curiosity are essential qualities for a superforecaster.

The Corporate Forecasting Market: Opportunities and Challenges for CISOs

The corporate forecasting sector is rapidly expanding, with a market estimated at over $5 billion by 2028. This trend offers significant opportunities for Chief Information Security Officers (CISO) seeking to integrate predictive capabilities into cyber risk management. Forecasting solutions can help identify emerging threats, optimize budget allocations for cyber insurance, and improve incident response processes. However, adopting these technologies requires specialized skills and the ability to interpret results in a business security context.

The Impact of Regulation on Forecasting Tools

The growing regulation of the technology sector, such as the NIS2 directive and the DORA regulation, is influencing the development and adoption of forecasting tools. Companies must ensure that their predictive models comply with compliance and transparency standards. This poses significant challenges for AI startups seeking to develop advanced forecasting models, as they must balance innovation and adherence to regulations.

Integrating Forecasting into Security Operations Processes

Integrating forecasting into Security Operations Center (SOC) processes can significantly improve the ability to detect and respond to threats. AI models can analyze large amounts of data in real-time, identifying anomalous patterns and predicting potential attacks. However, the effectiveness of these systems depends on the quality of the data and the ability of analysts to interpret the results. A Managed Detection and Response (MDR) integrated with forecasting capabilities can offer a higher level of protection, but it requires significant investments in infrastructure and skills.

The Implications for Cybersecurity Professionals

For cybersecurity professionals, the rise of AI forecasting represents both a threat and an opportunity. On one hand, AI models can automate many of the analysis and prediction activities, reducing the need for specialized personnel. On the other hand, the ability to interpret and use forecasting results can become a key skill for security professionals. CISOs must invest in continuous training and the development of advanced skills to remain competitive in a rapidly evolving market.

The Future of Forecasting: Towards Deeper Integration

The future of forecasting in the corporate context will see deeper integration with other security technologies, such as Data Loss Prevention (DLP) systems and Security Information and Event Management (SIEM) platforms. These systems can use forecasting models to predict and prevent the loss of sensitive data, improving digital operational resilience. Additionally, the adoption of zero trust architectures can benefit from AI's predictive capabilities, providing an additional layer of protection against internal and external threats.

The Ethical and Legal Challenges of Corporate Forecasting

The use of corporate forecasting also raises ethical and legal challenges. Companies must ensure that their predictive models do not violate the privacy rights of employees and customers. Additionally, transparency in decision-making processes based on AI predictions is essential to maintain stakeholder trust. Regulations such as the GDPR and other data protection laws will impose stringent requirements for the use of these technologies, requiring companies to adopt responsible and compliant approaches.

The Role of Prediction Markets in the Financial Sector

Prediction markets like Kalshi and Polymarket are gaining popularity in the financial sector, offering investors the opportunity to bet on future events. These markets can provide valuable insights for financial planning and risk management, but they require a deep understanding of market dynamics. Companies using these markets for forecasting must be aware of the associated risks and develop strategies to mitigate potential losses.

The Evolution of Forecasting in the Healthcare Sector

The healthcare sector is another area where forecasting can have a significant impact. Predictive models can help forecast epidemics, optimize resource distribution, and improve supply chain management. However, adopting these technologies requires collaboration between public health experts, computer scientists, and security professionals. Challenges related to the protection of health data and compliance with regulations such as HIPAA must be addressed to ensure the effectiveness and security of these systems.

Future Perspectives of Forecasting in the Corporate Context

The future of forecasting in the corporate context is promising, but it requires a strategic and integrated approach. Companies that invest in advanced skills, innovative technologies, and compliant processes can benefit from AI's predictive capabilities. However, they must also address the ethical, legal, and operational challenges associated with these technologies. With the continuous evolution of AI models and the adoption of new regulations, the forecasting sector will continue to grow, offering unique opportunities for companies seeking to improve their resilience and competitiveness.

Frequently Asked Questions

What is the role of forecasting in cyber risk management?

Forecasting can help identify emerging threats, optimize budget allocations for cyber insurance, and improve incident response processes, offering a higher level of protection.

How can CISOs integrate forecasting into security operations processes?

CISOs can integrate forecasting into SOC processes using AI models to analyze large amounts of data in real-time, identifying anomalous patterns and predicting potential attacks.

What are the ethical and legal challenges of corporate forecasting?

The challenges include protecting the privacy rights of employees and customers, transparency in decision-making processes based on AI predictions, and compliance with regulations such as the GDPR.

How can companies benefit from prediction markets in the financial sector?

Companies can use prediction markets to obtain valuable insights for financial planning and risk management, but they must develop strategies to mitigate the associated risks.

Editorial Note and Disclaimer

The guides and content published on GoYou are the result of independent research and analysis activities, for informational, educational, and in-depth purposes.

GoYou does not constitute a journalistic publication nor an editorial product pursuant to Law No. 62/2001 and does not engage in real-time information activities.

The GoYou project does not provide professional, technical, legal, or financial advice and disclaims any liability for the improper use of the information published.

In the Crypto sector, every investment involves risks: readers are invited to always inform themselves independently before making any decision.