node created 2012/06/17
last changed 2013/02/04
I cannot tell why the spokesmen I have cited want the developments I forecast to become true. Some of them have told me that they work on them for the morally bankrupt reason that "If we don't do it, someone else will." They fear that evil people will develop superintelligent machines and use them to oppress mankind, and that the only defense against these enemy machines will be superintelligent machines controlled by us, that is, by well-intentioned people. Others reveal that they have abdicated their autonomy by appealing to the "principle" of technological inevitability. But, finally, all I can say with assurance is that these people are not stupid. All the rest is mystery.
The frightening coincidence of the modern population explosion with the discovery of technical devices that, through automation, will make large sections of the population 'superfluous' even in terms of labor, and that, through nuclear energy, make it possible to deal with this twofold threat by the use of instruments beside which Hitler's gassing installations look like an evil child's fumbling toys, should be enough to make us tremble.
"Eichmann in Jerusalem: A Report on the Banality of Evil"
We don't know a perfected totalitarian power structure, because it would require the control of the whole planet. But we know enough about the the still preliminary experiments of total organization to realize that the very well possible perfection of this apparatus would get rid of human agency in the sense as we know it. To act would turn out to be superfluous for people living together, when all people have become an example of their species, when all doing has become an acceleration of the movement mechanism of history or nature following a set pattern, and all deeds have become the execution of death sentences which history and nature have given anyway.
"Elemente und Urspr√ľnge totaler Herrschaft" p. 683
If machines produce everything we need, the outcome will depend on how things are distributed. Everyone can enjoy a life of luxurious leisure if the machine-produced wealth is shared, or most people can end up miserably poor if the machine-owners successfully lobby against wealth redistribution. So far, the trend seems to be toward the second option, with technology driving ever-increasing inequality.
Remember this. The people you're trying to step on, we're everyone you depend on. We're the people who do your laundry and cook your food and serve your dinner. We make your bed. We guard you while you're asleep. We drive the ambulances. We direct your call. We are cooks and taxi drivers and we know everything about you. We process your insurance claims and credit card charges. We control every part of your life.

We are the middle children of history, raised by television to believe that someday we'll be millionaires and movie stars and rock stars, but we won't. And we're just learning this fact. So don't fuck with us.
"Fight Club"
Let's take robots on assembly lines: If it's used to free up the workforce for more creative work, say, controlling production, making decisions about it, finding creative ways to act and so on, then it's to the good. If it's used as a device to maximize profit and throw people into the trashcan, then it's not good.