General Notes, Ideas, and Thoughts

Ideas (add them at aisi.ai/list/ai-governance where you can also indicate interest)

Key considerations for the weekend's project

Notes from the breakout session

• Ideal worlds in the future
• Open-minded, listen to some thoughts
• Q&A
  • What should the format of the story be
    • Reasonably concise and concrete
  • How far away from real-life may it be
    • As long as it informs real life in a concrete way

Overview and Resource Notes

Write a story about how a future world with AI looks and how we got there. You may either base it on 1) things going well, 2) things going bad or 3) a place in-between. We encourage you to be creative! As a starting prompt, you can tell a story of a small part of the world in 2040 from the future perspective.

Write your notes for each resources in the foldout

• GPT-2030 – a Berkeley assistant professor's take on what the future AI might be capable of based on the current numbers
• Shulman on the Dwarkesh Podcast [1:02:00 to 1:33:00] – when asked the question "How does an intelligence explosion look like?", he responds with what it feels like
• What 2026 Might Look Like – impressively predicted the 2023 LLM hype in 2021
• The Next Decades Might be Wild – an overview of how the next decades might look with AI
• [Additional reading] Safety Timelines
• [Additional reading] Welcome to 2030. I own nothing, have no privacy, and life has never been better. – a short exposition of the life in 2030
• [Additional reading] EpochAI's research – a great resource for informing your perspective on how future AI development will look like
• [Additional reading] How we could stumble into AI catastrophe – a description of how we might accidentally cause a catastrophe