跳到正文
研踪PaperTrail
← 研踪 PaperTrail
正在查看已观测的 v1。查看最新 v2 →

arXiv:2611.20794 · v1

Regularizing Treatment Leakage for LLM-based Uplift Estimation

首次提交 2026-11-16 17:42
版本更新 2026-11-16 17:42
雷达观测 2026-11-17 17:11
arXiv ↗PDF ↗

摘要

Uplift modeling estimates the conditional average treatment effect (CATE) and supports industrial decisions such as promotional pricing. When large language models (LLMs) encode product text, treatment-revealing content can introduce shortcuts that do not transfer to deployment. We propose \emph{LLM-based Uplift Leakage Regularization} (\textsc{LULR}), which uses a CLUB-based penalty on the causal head's trainable shared representation while keeping the LLM encoder frozen. Controlled proxy experiments show a positive ranking-score interaction and higher scores than the tested weight-decay configuration; treatment-dependent evaluation limits their interpretation to exploratory model behavior. Structured-only comparisons provide reference performance, without establishing a general advantage over tree-based estimators. On a million-record industrial pricing RCT, \textsc{LULR} improves offline lift@0.3\text{lift@}0.3 in 4/54/5 seeds, although the difference is not statistically significant and estimated policy values are near-tied. A separate one-week online A/B experiment records 5.45%5.45\% higher sales volume and 1.91%1.91\% higher GMV than the control arm. These aggregate results provide short-term business evidence for the complete deployed pricing policy; they do not isolate the regularizer's contribution.

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

仅对比实际观测的元数据,不代表 PDF 正文或实验变化。版本可能不连续;带删除线为移除,下划线为新增。

摘要变化

Uplift modeling estimates the conditional average treatment effect (CATE) and supports industrial decisions such as promotional pricing. When largeLarge language models (LLMs) encodeprovide productsemantic textfeatures for uplift estimation, but treatment-revealing contenttext can introduceinduce prediction shortcuts that do not transfer to deployment. We propose \emph{LLM-based Uplift Leakage Regularization} (\textsc{LULR}), whichto usesaddress athis CLUB-basedrisk. penaltyWith onthe LLM encoder frozen, \textsc{LULR} penalizes dependence between the causal head's trainable shared representation whileand keepingtreatment thewhile LLMretaining encoderseparate frozen.outcome Controlledheads. proxyThe experimentspenalty showuses a positivevariational ranking-scoreapproximation interactionto andthe highercontrastive scoreslog-ratio thanupper thebound tested(CLUB) weight-decayof configuration;mutual treatment-dependentinformation, evaluationtargeting limitstreatment theirdependence interpretationrather tothan exploratorygeneric modelparameter behaviorshrinkage. Structured-onlyControlled comparisonsproxy experiments provide referenceexploratory performance,evidence withoutof establishingimproved aranking generalscores advantageunder overinjected treetreatment information relative to no regularization and the tested weight-baseddecay estimatorssetting. OnStructured-only abenchmarks millionshow modest, dataset-recorddependent effects. On an industrial pricing RCT,randomized \textsc{LULR}controlled improvestrial, mean offline $\text{lift@}0.3$ inis $4/50.258$ seeds, although the difference is not statisticallyfor significant\textsc{LULR}, andcompared estimatedwith policy$0.106$ valuesfor arethe nearsame-tiedbackbone baseline. A separate one-week online A/B experimenttest of the complete deployed pricing policy records $5.45\%$ higher sales volume and $1.91\%$ higher GMVgross merchandise value than the control arm. These aggregate results provide short-term business evidence for the complete deployed pricing policy;-level theygains do not isolate the regularizer's contributioneffect.

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v2 · 2026-11-17 14:13 · 最新观测版本

Regularizing Treatment Leakage for LLM-based Uplift Estimation

Large language models (LLMs) provide semantic features for uplift estimation, but treatment-revealing text can induce prediction shortcuts that do not transfer to deployment. We propose \emph{LLM-based Uplift Leakage Regularization} (\textsc{LULR}) to address this risk. With the LLM encoder frozen, \textsc{LULR} penalizes dependence between the causal head's trainable shared representation and treatment while retaining separate outcome heads. The penalty uses a variational approximation to the contrastive log-ratio upper bound (CLUB) of mutual information, targeting treatment dependence rather than generic parameter shrinkage. Controlled proxy experiments provide exploratory evidence of improved ranking scores under injected treatment information relative to no regularization and the tested weight-decay setting. Structured-only benchmarks show modest, dataset-dependent effects. On an industrial pricing randomized controlled trial, mean offline lift@0.3\text{lift@}0.3 is 0.2580.258 for \textsc{LULR}, compared with 0.1060.106 for the same-backbone baseline. A separate one-week online A/B test of the complete deployed pricing policy records 5.45%5.45\% higher sales volume and 1.91%1.91\% higher gross merchandise value than the control arm. These short-term policy-level gains do not isolate the regularizer's effect.

查看此版本解读 →查看此版本原文 ↗
v1 · 2026-11-16 17:42

Regularizing Treatment Leakage for LLM-based Uplift Estimation

Uplift modeling estimates the conditional average treatment effect (CATE) and supports industrial decisions such as promotional pricing. When large language models (LLMs) encode product text, treatment-revealing content can introduce shortcuts that do not transfer to deployment. We propose \emph{LLM-based Uplift Leakage Regularization} (\textsc{LULR}), which uses a CLUB-based penalty on the causal head's trainable shared representation while keeping the LLM encoder frozen. Controlled proxy experiments show a positive ranking-score interaction and higher scores than the tested weight-decay configuration; treatment-dependent evaluation limits their interpretation to exploratory model behavior. Structured-only comparisons provide reference performance, without establishing a general advantage over tree-based estimators. On a million-record industrial pricing RCT, \textsc{LULR} improves offline lift@0.3\text{lift@}0.3 in 4/54/5 seeds, although the difference is not statistically significant and estimated policy values are near-tied. A separate one-week online A/B experiment records 5.45%5.45\% higher sales volume and 1.91%1.91\% higher GMV than the control arm. These aggregate results provide short-term business evidence for the complete deployed pricing policy; they do not isolate the regularizer's contribution.

查看此版本解读 →查看此版本原文 ↗