The Benefit of Forgetting