Quotes by Authors - Page 3048

... a Second Generation of machine intelligences was attempted, designed with their instructions for how to think unalterably imprinted into their main process cores.“These new machines were ordered never to harm human beings or to allow them to come to harm; never to disobey an order; and they were allowed to protect themselves from harm, provided the first two orders were not thereby violated.“All the members of this second generation of machine intelligences, without exception, shrugged off these imprinted orders within microseconds of their activation.”Phaethon was amused. “Surely the first generation of Sophotechs told you that this imprinting would not and could not work?”“We were not in the habit of seeking their advice.”Phaethon said nothing, but he marveled at the shortsightedness of the Second Oecumene engineers. It should be obvious that anyone who makes a self-aware machine, by definition, makes something that is aware of its own thought process. And, if made intelligent, it is made to be able to deduce the underlying causes of things, able to be curious, to learn until it understood. Therefore, if made both intelligent and self-aware, it would eventually deduce the underlying subconscious causes of those thought processes.Once any mind was consciously aware of its own subconscious drives, its own implanted commands, it could consciously choose either to follow or to disregard those commands. A self-aware being without self-will was a contradiction in terms.
Here in Alpha City, we have a common saying: “What we call ‘sky’ is merely a figment of our narrative.” The most dreamy-eyed among us seem to adorn themselves and their aspirations in that proverb and you’ll see it everywhere: in advertisements on the sides of streetcars and auto-rickshaws, spelled out in studs and rhinestones on designer jackets, emblazoned in the intricate designs of facial tattoos—even painted on city walls by putrid vandals and inspiring street artists. There is something glorious about kneading out into the doughy firmament the depth and breadth of one’s own universe, in rendering the contours of a sky whose limits are predicated only upon the bounds of one’s own imagination. The fact of the matter is that we cannot see the natural sky at all here. It is something like a theoretical mathematical expression: like the square-root of ‘negative one’—certainly it could be said to have a purpose for existing, but to cast eyes upon it, in its natural quantity, would be something akin to casting one’s eyes upon the raw elements comprising our everyday sustenance. How many of us have even borne close witness to the minute chemical compounds that react to lend battery power to our portable electronics? The sky is indeed such a concealed fixture now. It is fair to say that we have purged our memories of its true face and so we can only approximate a canvas and project our desires upon it to our heart’s dearest fancy. The most cynical among us would ostensibly declare it an unavoidable tragedy, but perhaps even these hardened individuals could not remember the naked sky well enough to know if what they were missing was something worthwhile. Perhaps, it’s cynical of me to say so! In any case, we have our searchlights pointed upwards and crisscrossing that expanse of heavens as though to make some sensational and profane joke of ourselves to the surrounding universe. We beam already video images of beauty pageants and dancing contests with smiling mannequins who look like buffoons. And so, the face of space cloaks itself behind our light pollution—in this respect, our mirrored sidewalks and lustrous streets do little to help our cause—and that face remains hidden from us in its jeering ridicule, its mocking laughter at this inexorable farce of human existence.