Bhatnagar, Mohit (2025) Enhancing career guidance through intent mining with large language models. In: Artificial Intelligence in Education Technologies: New Development and Innovative Practices. Lecture Notes on Data Engineering and Communications Technologies, 228 . Springer International Publishing AG, pp. 17-33. ISBN 9789819792559
560059_1_En_2_Chapter_Author.pdf - Published Version
Restricted to Repository staff only
Download (3MB) | Request a copy
Abstract
This study uses Large Language Models (LLMs) for extracting intents within the field of career guidance. Collating discussions from a popular social media platform, BERTopic, a state-of-the-art topic modeling technique leveraging Bidirectional Encoder Representations from Transformers (BERT) embeddings is employed to extract key career-related themes. Our analysis evaluates BERTopic's proficiency, particularly its integration with LLMs, to refine topic modeling and automate the intent extraction process. A central focus lies on the application of Generative AI for automatic topic labeling, contrasting the performance of proprietary models like OpenAI's GPT-3.5 with open-source models such as Llama-2. Subsequently, the study uses these mined intents to fine-tune a BERT based LLM, scrutinizing its efficacy in intent classification against a Random Forest baseline model. The BERT model demonstrates a remarkable improvement in multi-classification accuracy of 0.92. Our results underscore the profound and emerging capabilities of LLMs to integrate in task based chatbots that can offer nuanced, tailored career guidance, heralding potentially a new era of AI-enabled educational support. To ensure the reproducibility of our results and foster further research, the dataset and code is publicly made available.
Item Type: | Book Section |
---|---|
Subjects: | Social Sciences and humanities > Business, Management and Accounting > Human Resource Management Physical, Life and Health Sciences > Computer Science Social Sciences and humanities > Social Sciences > Social Sciences (General) |
JGU School/Centre: | Jindal Global Business School |
Depositing User: | Dharmveer Modi |
Date Deposited: | 27 Jan 2025 04:31 |
Last Modified: | 27 Jan 2025 04:31 |
Official URL: | https://doi.org/10.1007/978-981-97-9255-9_2 |
URI: | https://pure.jgu.edu.in/id/eprint/9050 |
Downloads
Downloads per month over past year