Artificial intelligence developers urged to study human consciousness

Academic leaders worldwide have published an open letter urging artificial intelligence (AI) developers to increase their understanding of consciousness as AI systems continue to develop at an unprecedented pace. 

The letter, released by the Association for Mathematical Consciousness Science (AMCS), a group of over 150 researchers focusing on mathematical and computational approaches to consciousness, was described as a "wake-up call" to the scientific community, tech sector, and wider society to prioritize consciousness research.

In light of recent calls from tech leaders for a pause in AI experiments, the letter warned that AI is advancing at a rate that outstrips our ability to comprehend its implications for ethical, legal, and political concerns. Signatories of the letter argue that while language models like Google's Bard and OpenAI's ChatGPT currently mimic animal brain neural networks, they will soon be constructed to replicate higher-level brain architecture and functioning.

The letter suggests that AI systems could soon possess feelings and even human-level consciousness, with some already displaying human psychological traits such as Theory of Mind, which is the understanding that others possess beliefs, perceptions, emotions, and desires that differ from one's own. As such, the authors of the letter argue that AI will possess capabilities beyond those currently comprehensible to its developers, which could profoundly change society's relationship with these systems.

The authors argue that AI development must be transparent, with society and governing bodies informed of the ethical, safety, and societal implications associated with artificial general intelligence (AGI). They suggest that mathematical tools to measure and model consciousness are essential for understanding the implications of AI and ensuring its safety. 

The letter calls on society, the scientific community, and the tech sector to prioritise consciousness research to ensure that AI delivers positive outcomes for humanity and that AI research should not proceed unguided.

In summary, the letter serves as a reminder that as AI continues to advance, we must remain vigilant in understanding its ethical, legal, and political implications, particularly concerning consciousness research. The authors urge the scientific community and tech sector to take these issues seriously and to accelerate research in consciousness, ensuring that AI development progresses with the positive outcomes for humanity.