相似但不冗余:面向高细粒度主题模型的嵌入门控精炼方法
Similar but Not Redundant: Embedding-Gated Refinement for High-Granularity Topic Models
Daniel Denley, Robert L. Nicol, Mike J. Chantler
AI 速读 基于摘要
针对高细粒度主题建模中"过度聚类"的争议,提出嵌入门控迭代合并方法 EGIM,用嵌入相似度提名候选、再用 LLM 判断是否真正冗余,以保留语义相近但有意义的细分主题。
cs.CL · cs.IR
查看原文摘要
High-granularity topic modelling extracts hundreds of niche topics from a corpus, yet this regime is rarely studied and is more commonly framed as a failure mode: "over-clustering," in which coherent themes fragment into redundant subtopics. We argue that this framing conflates genuine redundancy with topics that are semantically similar but meaningfully distinct, and that the central challenge in high-granularity modelling is separating the two. Recent post-hoc refinement methods address topic redundancy through either embedding-based similarity thresholding or LLM-guided merging. We show that neither suffices in high-granularity settings and propose embedding-gated iterative merge (EGIM), a hybrid approach that iteratively generates context-rich topic representations, uses embedding similarity to propose candidate merges across the topic space, then applies LLM judgement to accept only genuinely redundant pairs while preserving niche distinctions. Across two patent corpora and one legal corpus, LLM judgement rejects 83% of embedding-identified candidates as non-redundant. EGIM improves discriminability on merged topics by 25-55% over a prior iterative LLM baseline while better preserving the original topic distribution.