Friday, April 07, 2023

High intelligence is a double-edged sword



The conventional wisdom would be that if you have high intellect you would be more adaptive to a wide range of environments. Homo Sapiens has evolved to possess a highly developed intelligence, and it surely correlates with the fact that humans have come to dominate in a wide range of environments, from the tropics to the north and south poles on the earth, and to International Space Station and further beyond, perhaps even to Mars.

However, although intelligence has surely helped humans to be more robustly adaptive in a wide range of environments, it has also made the human existence less robust and stable. The possibility of human extinction through total nuclear war is just one example.

It could be argued therefore that high intelligence is a double-edged sword. On the one hand it can help make the system more robust. On the other there would be increased vulnerabilities, easily scaling out of the comfort zone.

It is an interesting question whether incorporating artificial emotion or consciousness in a system would make it more or less robust. Memorably, Eliezer Yudkowsky remarked in a recent Lex Fridman podcast that endowing an AI with emotion would be terrible. Artificial consciousness might make a AI more stable, by the incorporation of metacognitive processes, realizing the veto function, which is indispensable in human ethics.

The jury is still out.

In a recent episode of Ken Mogi's Street Brain Radio I discussed these pressing issues in some detail.


Related video:


High intelligence, artificial or natural, becomes unstable. Can consciousness help that? 





Thursday, April 06, 2023

The arms race happen between people, not AI systems.


For some time now people have been discussing existential risks for humanity with the development of artificial intelligence. Although there would be genuine vulnerabilities due to the general disruption that the intelligence-related technologies would cause, especially by those involved in military operations, the tendency to depict AI, AGI in particular, in the light of possible overtaking of human existence is not only misleading but also potentially damaging.


Typically, when people discuss doomsday scenarios, they are projecting their own psychology onto the machine. It is not AI that would try to overtake the world. People have desires and ambitions about exerting control over others, and artificial intelligence systems are regarded as tools to realize their obsessions.


The arms race happen between people, not AI systems. The alpha male projection of aggression on the coming AGI is not only misplaced but also damaging to the neutrality of the technology.  


Related video.


The existential risk of Artificial Intelligence only comes from human nature and imagination





Saving Japan



In the last few years I have written two books on Japan. One on ikigai and another one on nagomi. With these attempts, I have hopefully presented the best in the tradition of the land of the rising sun.


As I have written in the small print sections of these books, I had no intention of claiming that Japan is the best, or indeed, unique among nations on the globe. Each culture has its own merits and strengths, juxtaposed with shortcomings and weaknesses. Japan is far from perfect, especially when it comes to gender equality, for example.


In a way, with the ikigai and nagomi books I have presented a vision of what Japan could be, could have been, and would be, in addition to what it actually is. I believe realities can be seen from a new and hope-giving perspective, when you have the perception and good will to achieve that.


I really admired the film Saving Mr. Banks. It told the true story behind Mary Poppins. As a lover of the excellent musical film, I believe in the alchemy of transformation from the actual Mr. Banks to the fictional character, depicting what he could have been, inspiring people. 


In the same spirit, I wanted to do something in the spirit of Saving Japan, while remaining true to the essential nature of the nation. Sometimes, you see the real self better from a distance.