On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification
By Qinyuan Ye · Paper · cs.AI
Memory-based self-improving agents--those that learn from an online stream of tasks and improve over time by maintaining a textual memory bank--have shown great promise in recent literature. However, the reliability aspects of these methods have been critically overlooked. In thi