← 研踪 PaperTrailarXiv:2609.13771 · v2
Homeostatic Continual Learning
首次提交 2026-09-12 15:29
版本更新 2026-11-19 21:40
雷达观测 2026-11-20 16:53
摘要
I formulate a Continual Learning problem for an autonomous agent that imitates the one animals face. The agent has intents to satisfy. It experiences contexts where different combinations of features are active and impact intent outcomes. I propose a method named ``Homeostatic Continual Learning'' that imitates the one animals use. The agent learns incrementally environment data and features relevant for their intents from the impact of contexts, gradually completes its model and policy and performs well in more and more contexts. The core of the method is to find outliers in the environment data when the agent experiences an outlier in its intent outcome after the context changes. This method enables the agent to learn continuously in changing contexts without catastrophic forgetting. When pursuing many intents concurrently, the agent may build a transformer-like world model with the method where it factorizes the objects in the world into features, abstract objects into comparable instances of concepts and map concepts to intents through features. The world model is composed of semantic nodes and explainable by nature. I discuss the works needed to render the method practical, the connections to many fields in Artificial Intelligence and the broader implications of the method.
作者备注:19 pages, 13 figures, 1 table
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-19 21:40 · 最新观测版本
Homeostatic Continual Learning
I formulate a Continual Learning problem for an autonomous agent that imitates the one animals face. The agent has intents to satisfy. It experiences contexts where different combinations of features are active and impact intent outcomes. I propose a method named ``Homeostatic Continual Learning'' that imitates the one animals use. The agent learns incrementally environment data and features relevant for their intents from the impact of contexts, gradually completes its model and policy and performs well in more and more contexts. The core of the method is to find outliers in the environment data when the agent experiences an outlier in its intent outcome after the context changes. This method enables the agent to learn continuously in changing contexts without catastrophic forgetting. When pursuing many intents concurrently, the agent may build a transformer-like world model with the method where it factorizes the objects in the world into features, abstract objects into comparable instances of concepts and map concepts to intents through features. The world model is composed of semantic nodes and explainable by nature. I discuss the works needed to render the method practical, the connections to many fields in Artificial Intelligence and the broader implications of the method.
查看此版本解读 →查看此版本原文 ↗