Using AI to enhance societal decision making (article by Zershaaneh Qureshi)

| Podcasts | March 06, 2026 | 1.4 Thousand views | 31:28

TL;DR

Advanced AI could compress centuries of progress into years, forcing humanity to make existential decisions faster than ever; developing targeted AI decision-making tools now could help society navigate this critical period by improving collective intelligence before dangerous capabilities emerge.

⏱️ The Compressed Future and Institutional Stakes 3 insights

Century of progress in a decade

Advanced AI may accelerate innovation so dramatically that decisions requiring years of deliberation must be made in months, exponentially increasing the risk of catastrophic missteps.

Pattern of institutional failure

History shows repeated failures to act on clear warnings, from climate change to COVID-19, suggesting current decision-making architectures are inadequate for higher-stakes futures.

Differential technology opportunity

We can intentionally accelerate safety-promoting AI tools—like verification and forecasting systems—so they arrive before dangerous capabilities, rather than waiting for default market development.

🛠️ Epistemic and Coordination Tools 3 insights

Epistemic enhancement

AI fact-checkers and forecasting systems could overcome human limitations in processing information and predicting outcomes, while moral reasoning tools might help society navigate complex ethical disagreements.

Coordination mechanisms

AI negotiation tools could simulate thousands of bargaining scenarios to find mutually beneficial agreements, while verification systems and structured transparency could enable trust between competing actors without total surveillance.

Near-term feasibility

Many of these applications may be buildable with current technology, representing low-hanging fruit compared to the massive investment in general AI capabilities.

⚠️ Objections and Strategic Considerations 3 insights

Market gap argument

While some decision-making tools will emerge commercially, specific high-impact applications—like ethical reasoning aids or non-financial forecasting—lack market incentives and may arrive too late if pursued by default.

Managing acceleration risks

Targeting lower-risk applications like fact-checking rather than strategic planning minimizes the chance of advancing dangerous capabilities, and the benefits of better coordination likely outweigh small contributions to overall AI hype.

Democratizing access

To prevent power concentration, these tools must be widely distributed to institutions and the public, ensuring no single actor gains dangerous unilateral advantages through superior decision-making technology.

Bottom Line

Thoughtful entrepreneurs should prioritize building under-commercialized AI decision-making tools—particularly in forecasting, verification, and ethical reasoning—that can be deployed widely before AGI arrives, while carefully selecting projects that minimize acceleration of dangerous capabilities.

More from 80,000 Hours Podcast (Rob Wiblin)

View all
The pattern that says we're due for another transformation
1:29:46
80,000 Hours Podcast (Rob Wiblin) 80,000 Hours Podcast (Rob Wiblin)

The pattern that says we're due for another transformation

Advanced AI could trigger a societal transformation as profound as the Agricultural or Industrial Revolutions within decades rather than centuries by automating economically valuable human labor, creating both unprecedented prosperity and existential risks that make AI safety work a critical priority.

13 days ago · 8 points
How to switch careers before the intelligence explosion
1:06:43
80,000 Hours Podcast (Rob Wiblin) 80,000 Hours Podcast (Rob Wiblin)

How to switch careers before the intelligence explosion

Benjamin Todd argues that while AI may automate R&D within 2-3 years (creating an 'intelligence explosion'), most people should optimize for medium-term career strategies that balance urgency against the compounding value of career capital, which can increase one's future impact by 10-100x compared to acting immediately.

29 days ago · 9 points