We are witnessing a boom in thinking about AI; it’s a cool buzzword, but much of that thinking ends up focusing on near-term concerns, such as for lethal autonomous weapons, cybercrime, privacy, self-driving cars and so on. All very useful, but our aim goes far beyond that.
Once machine brains surpass human brains in general intelligence, this new superintelligence will become super powerful. Just as the fate of flora and animals depends more now on us humans than on themselves, so the fate of humans will depend on machine superintelligence.
Humankind now stands at the threshold of such evolution, which we expect to reach in this lifetime.