Adversarial Hallucination Engineering: Targeted Misdirection Attacks Against LLM Powered Security Operations Centers

Agarwal, Ashutosh ORCID: https://orcid.org/0009-0000-1695-7067 (2026) Adversarial Hallucination Engineering: Targeted Misdirection Attacks Against LLM Powered Security Operations Centers. Research and Reviews in Economics and Managament, 2 (2). pp. 1-5. CSK Scientific Press . Available at: https://cskscientificpress.com/articles_file/685-_...

[thumbnail of Adversarial Hallucination Engineering.pdf]
Preview
Text
Adversarial Hallucination Engineering.pdf - Published Version

Download (488kB) | Preview

Abstract

Large Language Models (LLMs) are increasingly deployed in Security Operations Centers (SOCs) for alert triage and threat‑intelligence synthesis. We study Adversarial Hallucination En-gineering (AHE): attacks that bias LLM reasoning by introducing small clusters of poisoned context into retrieval‑augmented generation (RAG) pipelines, producing targeted fabrications aligned with attacker goals. Using a safe, fully synthetic simulator of a RAG+LLM SOC, we formalize the AHE threat model, introduce Hallucination Propagation Chains (HPCs)—mutually reinforcing poisoned documents designed to create artificial consensus at retrieval time—and evaluate a light-weight defense, Chain‑of‑Thought Attestation (CoTA), based on per‑token uncertainty, provenance attribution, and source reputation. Across three model scales, hallucination‑induction rate (HIR) rises superlinearly with HPC size (e.g., for a Large‑70B proxy, 12.45%→61.84% as HPC size in top‑k grows 0→5); actionable mis-configuration rate (AMR) grows from 3.23% (no attack) to 38.18% (HPC‑5). CoTA reduces attack‑success rate (ASR) by ~55% for HPCs≥3 at ~7% false‑positive flags and ~8% latency overhead. We release synthetic artifacts to support reproducible, defensive research.

Item Type: Article
Uncontrolled Keywords: Adversarial Machine Learning | LLM Security | Security Operations | Retrieval‑Augmented Generation | Threat Intelligence
Subjects: Physical, Life and Health Sciences > Computer Science
Vol/Issue no. published date: April 2026
Depositing User: Mr. Syed Anas Ali
Date Deposited: 17 Aug 2026 11:47
Last Modified: 17 Aug 2026 11:48
Official URL: https://cskscientificpress.com/articles_file/685-_...
URI: https://pure.jgu.edu.in/id/eprint/12238

Downloads

Downloads per month over past year

Actions (login required)

View Item
View Item