Ok basically I am looking for a way to use hal and have it able to not just iopen programs but also use them. is there a way this can be done? I have seen other chat bots that can access games in web browsers and learn how to play the game. However what I would like it to do is to be able to learn from a ebook or text document. that way I could just, for lack of a better word, insert the book into hal and he now knows everything that book had to say.
By doing this I believe it would greatly increase Hal's capabilities, and allow him to learn 1000 times faster. Combine that with the ability to actually use programs on the computer and you would have him able to not only learn from txt documents or books but also use that knowledge to help teach.