Measuring Public Participation in Local Government: An Audio-Based Instrument for Classifying Speakers in City Council Meetings
Menglin Liu, J. Sophia Wang, Ge Shi
原文摘要
How much does the public actually speak in local government? Despite sustained interest in democratic participation, we lack large-scale measures of public voice at the local level, because the underlying record -- audio of open meetings -- has been prohibitively costly to convert into data. We contribute a measurement instrument: an audio-analysis pipeline that classifies each speaker in a city council meeting as an elected official or a member of the public directly from audio, and aggregates these labels into validated measures of participation such as floor-time share. The pipeline first segments each recording by speaker, then classifies each speaker with a multimodal large language model (MLLM), using the meeting's own temporal structure (neighboring speakers, iterative refinement, and a majority vote across three classifiers) as supporting components. We collect 1,618 recordings from seven U.S. cities (2017-2023); after diarization and quality control, the analytic corpus is 1,565 meetings from five cities. The task is non-trivial: audio quality is uneven, members of the public speak informally and are often introduced only briefly, and speech frequently overlaps. Even so, segmentation reaches 89% accuracy (mean pairwise kappa=0.84), and the classifier reaches 87.7% accuracy (kappa=0.736, public-participant F1=0.832) on ground truth from five cities (N=1,761 speakers) -- agreement comparable to that among the human annotators themselves. At scale, members of the public receive a median of just 10% of floor time, the top speaker is an official in over 94% of meetings, and public participation declined over COVID-19 without recovering by 2023. The instrument measures participation directly from audio, without transcription or linkage to external voter or property records, establishing audio-as-data as a practical approach for the study of local politics.
cs.CY