Enhancing career guidance through intent mining with large language models

Bhatnagar, Mohit (2025) Enhancing career guidance through intent mining with large language models. In: Artificial Intelligence in Education Technologies: New Development and Innovative Practices. Lecture Notes on Data Engineering and Communications Technologies, 228 . Springer International Publishing AG, pp. 17-33. ISBN 9789819792559

[thumbnail of 560059_1_En_2_Chapter_Author.pdf] Text
560059_1_En_2_Chapter_Author.pdf - Published Version
Restricted to Repository staff only

Download (3MB) | Request a copy

Abstract

This study uses Large Language Models (LLMs) for extracting intents within the field of career guidance. Collating discussions from a popular social media platform, BERTopic, a state-of-the-art topic modeling technique leveraging Bidirectional Encoder Representations from Transformers (BERT) embeddings is employed to extract key career-related themes. Our analysis evaluates BERTopic's proficiency, particularly its integration with LLMs, to refine topic modeling and automate the intent extraction process. A central focus lies on the application of Generative AI for automatic topic labeling, contrasting the performance of proprietary models like OpenAI's GPT-3.5 with open-source models such as Llama-2. Subsequently, the study uses these mined intents to fine-tune a BERT based LLM, scrutinizing its efficacy in intent classification against a Random Forest baseline model. The BERT model demonstrates a remarkable improvement in multi-classification accuracy of 0.92. Our results underscore the profound and emerging capabilities of LLMs to integrate in task based chatbots that can offer nuanced, tailored career guidance, heralding potentially a new era of AI-enabled educational support. To ensure the reproducibility of our results and foster further research, the dataset and code is publicly made available.

Item Type: Book Section
Subjects: Social Sciences and humanities > Business, Management and Accounting > Human Resource Management
Physical, Life and Health Sciences > Computer Science
Social Sciences and humanities > Social Sciences > Social Sciences (General)
JGU School/Centre: Jindal Global Business School
Depositing User: Dharmveer Modi
Date Deposited: 27 Jan 2025 04:31
Last Modified: 27 Jan 2025 04:31
Official URL: https://doi.org/10.1007/978-981-97-9255-9_2
URI: https://pure.jgu.edu.in/id/eprint/9050

Downloads

Downloads per month over past year

Actions (login required)

View Item
View Item