The Consciousness Simulation Gap : evaluating and benchmarking AI models through functional decomposition

Zhylin, Mykhailo, Hovorun, Tamara, Alizade, Bilal, Kovalenko, Maksym and Lytvynvhuk, Alla (2025) The Consciousness Simulation Gap : evaluating and benchmarking AI models through functional decomposition. Journal of Theoretical and Applied Information Technology, 103 (10). 4047- 4048. ISSN 1992-8645

[thumbnail of The Consciousness Simulation Gap - evaluating and benchmarking AI models through functional decomposition.pdf] Text
The Consciousness Simulation Gap - evaluating and benchmarking AI models through functional decomposition.pdf - Published Version

Download (1MB)

Abstract

The relevance of the research is determined by the need to study the consciousness of neural networks and the possibility of developing artificial self-awareness. The aim of the article is to investigate the main functional elements of models of consciousness in artificial intelligence (AI). The study employed such methods as the Turing test, Context-driven Testing and analysis of generation models. F1-score, Accuracy, t-test were used for statistical analysis. The reliability of the selected methods was checked by Test-Retest Reliability. The results were obtained that demonstrate the key aspects of the functioning of artificial consciousness models. GPT-4 shows the highest accuracy (92%) and F1-score (0.91), but has difficulties with complex logic problems. AlphaZero has the lowest accuracy (85%) and has trouble understanding abstract concepts. IBM Watson shows medium performance, but does not recognize irony well. DeepMind’s Gato is 90% accurate and wrong on coreference problems. The resulting analysis showed that modern models, such as GPT-4, have a high level of development of perception and attention, which contributes to the effective processing of natural language. However, the question of true consciousness and self-awareness of AI remains open, requiring further research. Understanding the functional components of consciousness is important for the development of ethical norms in the field of AI. Therefore, it is necessary to improve the algorithms to grade up the cognitive functions of the models. Prospects for future research in neural network consciousness include an in-depth study of the mechanisms that provide true consciousness and self-awareness in artificial systems.

Item Type: Article
Keywords: Artificial Consciousness | Neural Networks | Dialogue Model | GPT-4 | Neuroscience
Subjects: Physical, Life and Health Sciences > Computer Science
Physical, Life and Health Sciences > Engineering and Technology
JGU School/Centre: Jindal Global Law School
Depositing User: Mr. Luckey Pathan
Date Deposited: 09 Aug 2025 13:08
Last Modified: 09 Aug 2025 13:08
Official URL: https://www.jatit.org/volumes/hundredthree10.php
URI: https://pure.jgu.edu.in/id/eprint/9962

Downloads

Downloads per month over past year

Actions (login required)

View Item
View Item