← 研踪 PaperTrailarXiv:2606.18692 · v2
Text-Based Visualizations for Learning Analytics: Perspectives from STEM Education Researchers
首次提交 2026-06-17 13:14
版本更新 2026-11-16 14:45
雷达观测 2026-11-17 17:12
摘要
Visualizing student reflections collected throughout a course can help instructors track changes in student language and inform teaching decisions. Interpreting these changes, however, requires tools that connect overall patterns with individual responses, and how to design such visualizations for learning analytics remains an open question. To address this gap, we conducted a mixed-methods study with 10 STEM education researchers who offered dual perspectives as both instructors and qualitative researchers. We used two visualization platforms as probes to elicit expert perspectives: the Journal Data Dashboard, for analyzing formative assessments, and WordStream Maker, for authoring custom visualizations. Participants evaluated both platforms by analyzing weekly student journal responses from a data visualization course. Findings revealed shared prioritization of context and control, discipline-rooted differences in perceived usefulness, and, notably, epistemological disagreement about frequency as viable evidence in qualitative work. Some participants regarded frequency-based visualization as a productive entry point to qualitative analysis, while others argued that it conflicts with the values of qualitative data analysis and may obscure rare but critical responses. These findings support the argument that perceived ease of use and usefulness, context of use or role, and epistemic frames are relevant to users of qualitative data visualization and learning analytics tools. We discuss design implications for future tools to better integrate quantitative techniques with qualitative interpretation. Transcripts, tutorials, and all supplementary materials are available at https://osf.io/z2f8d.
作者备注:11 pages, 6 figures, 2 tables
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-16 14:45 · 最新观测版本
Text-Based Visualizations for Learning Analytics: Perspectives from STEM Education Researchers
Visualizing student reflections collected throughout a course can help instructors track changes in student language and inform teaching decisions. Interpreting these changes, however, requires tools that connect overall patterns with individual responses, and how to design such visualizations for learning analytics remains an open question. To address this gap, we conducted a mixed-methods study with 10 STEM education researchers who offered dual perspectives as both instructors and qualitative researchers. We used two visualization platforms as probes to elicit expert perspectives: the Journal Data Dashboard, for analyzing formative assessments, and WordStream Maker, for authoring custom visualizations. Participants evaluated both platforms by analyzing weekly student journal responses from a data visualization course. Findings revealed shared prioritization of context and control, discipline-rooted differences in perceived usefulness, and, notably, epistemological disagreement about frequency as viable evidence in qualitative work. Some participants regarded frequency-based visualization as a productive entry point to qualitative analysis, while others argued that it conflicts with the values of qualitative data analysis and may obscure rare but critical responses. These findings support the argument that perceived ease of use and usefulness, context of use or role, and epistemic frames are relevant to users of qualitative data visualization and learning analytics tools. We discuss design implications for future tools to better integrate quantitative techniques with qualitative interpretation. Transcripts, tutorials, and all supplementary materials are available at https://osf.io/z2f8d.
查看此版本解读 →查看此版本原文 ↗