Autonomous weapons are artificial intelligence systems that are programmed to kill. In the hands of the wrong person, these weapons could easily cause mass casualties. Moreover, an AI arms race could inadvertently lead to an AI war that also results in mass casualties. To avoid being thwarted by the enemy, these weapons would be designed to be extremely difficult to simply “turn off,” so humans could plausibly lose control of such a situation. This risk is one that’s present even with narrow AI, but grows as levels of AI intelligence and autonomy increase.

It may be that media have made the AI safety debate seem more (6) than it really is. After all, fear sells, and articles using out-of-context quotes to (7) imminent doom can generate more clicks than nuanced and balanced ones. (8) , two people who only know about each other’s positions from media quotes are likely (9) think they disagree more than they really do. For example, a techno-skeptic who only read about Bill Gates’s position in a British tabloid may mistakenly think Gates believes superintelligence to be imminent. Similarly, someone in the beneficial-AI movement (10) who knows nothing about Andrew Ng’s position except his quote about overpopulation on Mars may mistakenly think he doesn’t care about AI safety, whereas in fact, he does. The crux is simply that because Ng’s timeline estimates are longer, he naturally tends to prioritize short-term AI challenges over long-term ones.

According to futurist Ray Kurzweil human civilisation will be unavoidably transformed in the year 2045 by an event that he call The Singularity. He suggests that exponential technological development will lead to the inevitable rise of artificial intelligence (A.I.). Such advanced technology may make humanity insignificant.

Kurzweil says that technologies are double-edged swords and envisions the possibility that an artificial intelligence might decde to put an end to humanity simply because it surpasses human intelligence. Kurzweil does have faith in mankind, however. He suggests that people are wise to accept that technological progress is unavoidable and that such acceptance will make the process of transition easier.

Kurzweil has personal reasons to hope for the coming of The Singularity, because he wants his life to be extended by it. Kurzweil envisions that future medical advances could invent tiny computerised machines, or nanobots, which operate inside the body to enhance the immune system. In addition ne believes that future technology might be able to resurrect his deceased father.

Looking at the state of current technological advances in many fields such as medicine, navigation and communication, Kurzweil's visions may not be unbelievable.The critical issue, however, is whether genuine artificial intelligence can ever be truly realised. Kurzweil suggests that critics of his theories, who believe that the human brain is too complex to duplicate, are underestimating what the exponential growth in technology can eventually accomplish.