Agarwal, Ashutosh
ORCID: https://orcid.org/0009-0000-1695-7067
(2026)
Adversarial Hallucination Engineering: Targeted Misdirection Attacks Against LLM Powered Security Operations Centers.
Research and Reviews in Economics and Managament, 2 (2).
pp. 1-5.
CSK Scientific Press
.
Available at: https://cskscientificpress.com/articles_file/685-_...
Adversarial Hallucination Engineering.pdf - Published Version
Download (488kB) | Preview
Abstract
Large Language Models (LLMs) are increasingly deployed in Security Operations Centers (SOCs) for alert triage and threat‑intelligence synthesis. We study Adversarial Hallucination En-gineering (AHE): attacks that bias LLM reasoning by introducing small clusters of poisoned context into retrieval‑augmented generation (RAG) pipelines, producing targeted fabrications aligned with attacker goals. Using a safe, fully synthetic simulator of a RAG+LLM SOC, we formalize the AHE threat model, introduce Hallucination Propagation Chains (HPCs)—mutually reinforcing poisoned documents designed to create artificial consensus at retrieval time—and evaluate a light-weight defense, Chain‑of‑Thought Attestation (CoTA), based on per‑token uncertainty, provenance attribution, and source reputation. Across three model scales, hallucination‑induction rate (HIR) rises superlinearly with HPC size (e.g., for a Large‑70B proxy, 12.45%→61.84% as HPC size in top‑k grows 0→5); actionable mis-configuration rate (AMR) grows from 3.23% (no attack) to 38.18% (HPC‑5). CoTA reduces attack‑success rate (ASR) by ~55% for HPCs≥3 at ~7% false‑positive flags and ~8% latency overhead. We release synthetic artifacts to support reproducible, defensive research.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Adversarial Machine Learning | LLM Security | Security Operations | Retrieval‑Augmented Generation | Threat Intelligence |
| Subjects: | Physical, Life and Health Sciences > Computer Science |
| Vol/Issue no. published date: | April 2026 |
| Depositing User: | Mr. Syed Anas Ali |
| Date Deposited: | 17 Aug 2026 11:47 |
| Last Modified: | 17 Aug 2026 11:48 |
| Official URL: | https://cskscientificpress.com/articles_file/685-_... |
| URI: | https://pure.jgu.edu.in/id/eprint/12238 |
Downloads
Downloads per month over past year
