Mind meets machine: Unravelling GPT-4’s cognitive psychology

Dhingra, Sifatkaur, Singh, Manmeet, S.B., Vaisakh, Malviya, Neetiraj and Gill, Sukhpal Singh (2023) Mind meets machine: Unravelling GPT-4’s cognitive psychology. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3 (3). ISSN 2772-4859

[thumbnail of 1-s2.0-S277248592300056X-main.pdf] Text
1-s2.0-S277248592300056X-main.pdf - Published Version
Restricted to Repository staff only

Download (736kB) | Request a copy

Abstract

Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large Language Models (LLMs) are emerging as potent tools increasingly capable of performing human-level tasks. The recent development in the form of Generative Pre-trained Transformer 4 (GPT-4) and its demonstrated success in tasks complex to humans exam and complex problems has led to an increased confidence in the LLMs to become perfect instruments of intelligence. Although GPT-4 report has shown performance on some cognitive psychology tasks, a comprehensive assessment of GPT-4, via the existing well-established datasets is required. In this study, we focus on the evaluation of GPT-4’s performance on a set of cognitive psychology datasets such as CommonsenseQA, SuperGLUE, MATH and HANS. In doing so, we understand how GPT-4 processes and integrates cognitive psychology with contextual information, providing insight into the underlying cognitive processes that enable its ability to generate the responses. We show that GPT-4 exhibits a high level of accuracy in cognitive psychology tasks relative to the prior state-of-the-art models. Our results strengthen the already available assessments and confidence on GPT-4’s cognitive psychology abilities. It has significant potential to revolutionise the field of Artificial Intelligence (AI), by enabling machines to bridge the gap between human and machine reasoning.

Item Type: Article
Keywords: Artificial intelligence | Large language models | ChatGPT | Cognitive psychology | GPT
Subjects: Social Sciences and humanities > Business, Management and Accounting > Business and International Management
Social Sciences and humanities > Business, Management and Accounting > Management Information Systems
Social Sciences and humanities > Business, Management and Accounting > Management of Technology and Innovation
JGU School/Centre: Jindal Institute of Behavioural Sciences
Depositing User: Subhajit Bhattacharjee
Date Deposited: 05 Jul 2024 06:49
Last Modified: 05 Jul 2024 06:49
Official URL: https://doi.org/10.1016/j.tbench.2023.100139
URI: https://pure.jgu.edu.in/id/eprint/8051

Downloads

Downloads per month over past year

Actions (login required)

View Item
View Item