← 研踪 PaperTrailarXiv:2608.08942 · v2
Prompt Privilege in Large Language Models: Measuring and Mitigating Barriers to Equitable AI Access
首次提交 2026-08-10 06:38
版本更新 2026-11-15 14:26
雷达观测 2026-11-17 19:15
摘要
Large language models (LLMs) are increasingly used in healthcare, education, public services, and everyday decision making. They should provide comparable assistance regardless of users' literacy, communication style, or prompt-engineering expertise. However, research on prompt robustness primarily focuses on adversarial attacks, prompt injection, and prompt optimization, overlooking whether semantically equivalent requests receive different responses simply because they are phrased differently. We call this accessibility challenge "Prompt Privilege": users with greater prompting expertise obtain better model performance despite expressing the same underlying intent. To address this problem, we propose the Prompt Equity Score (PES), a metric for evaluating performance consistency across user populations, and the Prompt Equity Transformer (PET), an LLM-based agent that automatically transforms user requests into semantically equivalent prompts while preserving their intent. PET shifts prompt optimization from users to AI systems, serving as an accessibility layer between users and foundation models. Experiments on MedQA reveal measurable prompt privilege, with statistically significant performance disparities between low-literacy and expert-prompting cohorts. Applying PET reduces these differences, with no pairwise cohort differences reaching statistical significance in our evaluation. These results suggest that accessibility-oriented prompt normalization can improve equitable AI access. By introducing prompt privilege as a new dimension of AI accessibility and PET as a practical solution, this work advances system-centered accessibility and provides a foundation for fairer, more trustworthy, and more inclusive AI systems.
作者备注:Accepted to ICAICE 2026
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-15 14:26 · 最新观测版本
Prompt Privilege in Large Language Models: Measuring and Mitigating Barriers to Equitable AI Access
Large language models (LLMs) are increasingly used in healthcare, education, public services, and everyday decision making. They should provide comparable assistance regardless of users' literacy, communication style, or prompt-engineering expertise. However, research on prompt robustness primarily focuses on adversarial attacks, prompt injection, and prompt optimization, overlooking whether semantically equivalent requests receive different responses simply because they are phrased differently. We call this accessibility challenge "Prompt Privilege": users with greater prompting expertise obtain better model performance despite expressing the same underlying intent. To address this problem, we propose the Prompt Equity Score (PES), a metric for evaluating performance consistency across user populations, and the Prompt Equity Transformer (PET), an LLM-based agent that automatically transforms user requests into semantically equivalent prompts while preserving their intent. PET shifts prompt optimization from users to AI systems, serving as an accessibility layer between users and foundation models. Experiments on MedQA reveal measurable prompt privilege, with statistically significant performance disparities between low-literacy and expert-prompting cohorts. Applying PET reduces these differences, with no pairwise cohort differences reaching statistical significance in our evaluation. These results suggest that accessibility-oriented prompt normalization can improve equitable AI access. By introducing prompt privilege as a new dimension of AI accessibility and PET as a practical solution, this work advances system-centered accessibility and provides a foundation for fairer, more trustworthy, and more inclusive AI systems.
查看此版本解读 →查看此版本原文 ↗