Let's say Hal learns something you do not want it to remember.
Could be wrong spelling, or an inappropriate response.
Right after Hal says the wrong phrase, you respond with "Forget your last response" and Hal erases the phrase from it's brain.
Don't know if it's possible, but I think it would be easier than searching for the phrases manually to delete.