Definition
Seed AI is a type of artificial intelligence designed with a minimal core of general intelligence and a specific capacity for recursive self-improvement. Instead of being fully programmed with human knowledge, it is designed to understand its own architecture and iteratively engineer better versions of itself.
Why It Matters
Seed AI is the ‘fire’ of the intelligence explosion; understanding its capacity for recursive self-improvement is the only way to prepare for a transition to a superintelligent state that could happen at a pace far beyond human control.
Core Concepts
- Minimal Core: The initial version (the “seed”) doesn’t need to be superintelligent; it only needs enough intelligence to improve its own coding and learning algorithms.
- Bootstrapping: The process of using existing intelligence to create a higher level of intelligence. This is a positive feedback loop.
- Architectural Understanding: Unlike a “child machine” which primarily accumulates content, a Seed AI modifies its own “brain” structure.
- The Threshold of Explosion: Once the Seed AI crosses a certain threshold in computer science or mathematical ability, it can trigger a runaway intelligence explosion.
- Alien Intelligence: Seed AIs are likely to develop cognitive architectures and goal systems that are extremely alien to human biology.