$\ell$BISG: Probabilistic Race and Ethnicity Prediction Using Group-Specific Name Lists
Kyla Chasalow, Noah Dasanaike, Kosuke Imai
原文摘要
Statistically valid estimation of racial and ethnic disparities often requires inferring group membership probabilities from names and geographic locations. The standard method, Bayesian Improved Surname Geocoding (BISG), requires group frequencies for each name. Such data are available from the U.S. Census Bureau for common names and limited racial categories, but are unavailable for many ethnic groups and rarely exist outside the United States. We propose list-powered BISG ($\ell$BISG), in which we replace these frequencies with group-specific name lists and combine the lists with geographic prevalence data to obtain calibrated group membership probabilities. These lists can be compiled from different sources or generated by large language models (LLMs), despite potentially unknown biases. Under certain conditions on the name lists, $\ell$BISG can also be applied without geographic prevalence data. Empirical validation using U.S. voter files with self-reported race, the full-count 1900 U.S. Census, and the Lebanese voter registry demonstrates that LLM-generated lists yield accurate, well-calibrated probabilities and precise disparity estimates comparable to existing methods that require name-race frequency data. Thus, $\ell$BISG extends probabilistic race and ethnicity prediction to settings where it was previously not thought possible.
cs.CL