Déjà View:面向视觉任务的共享工作记忆模型
Déjà View: A Shared Working-Memory Model for Visual Tasks
Mranmay Shetty, Gabriel Kreiman
AI 速读 基于摘要
作者提出一个结合动态活动与图像特征临时关联的工作记忆模型,用同一训练模型完成五种视觉任务,并考察延迟、分心和图像历史对记忆表现的影响。
cs.CV · cs.LG · q-bio.NC
查看原文摘要
A working-memory model must remember stimuli and use its memory flexibly to perform different tasks. Here we introduce a model of working memory for images that combines dynamic activity with temporary associations between image features. We train the model on five tasks, including remembering a sample while other images are presented, categorizing distractor images while remembering the sample, and determining whether an image is new or has been presented before. The same trained model performs all tasks, guided by explicit cues about which response is required. We use this flexible memory model to ask how delay, distraction, and image history affect performance. Delays have little effect on sample-memory performance for the delays we tested, while seeing more images leads to more false alarms even when the target image appeared equally recently in all cases. On the sample-memory-plus-categorization task, the probability of correct responses on all questions decreases as more questions are asked, despite robust sample-memory performance. Finally, the model maintains stable performance across 40 brief trials of each task under the tested conditions. Together, these results demonstrate how a single working-memory system can be flexibly used to perform different tasks, and how its errors depend on both previous images and task demands.