1
Ultra Hal Assistant File Sharing Area / Re: Optical Reader for Hal is Now Complete
« on: December 26, 2022, 12:41:11 pm »
Where do you download this from i see no link???
This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.
In part the reason they need so much computational resource is that everything is in a high level language usually Python. I think resources could be more efficient if they used asembly. However thats only a part of it. The other part is that they are having the computer figure out everything or more than is nessicary. Think about how most people work for example... Its raining outside. You walk outside you get wet.... etc.,etc. after the figuring out phase for most people it just becomes a general rule of thumb... Its raining outside... is it raining and windy or just raining... if raining and windy get rain coat... if not windy get umbrella...other than varying levels of complexity you get the idea. What gpt needs to be able to do is bridge the gap from the training model to rule of thumb so ultimatley the gpt only really becomes active as the gazillion rules of thumb come up against something previously not covered by simpler rules creating new or refined rules to the existing database of rules.Where is it posted at? Every time i goto open ai web site or git hub theres a waiting list. From my understanding of it gpt2 is the same as gpt 3 with just a larger model used. Gpt 2 can run on a pc.
Correct, the source code of GPT-2 and GPT-3 are exactly the same. The training data of GPT-3 is much larger and the resulting trained neural net is much larger. OpenAI published the source code, but not the training data or trained neural net.
There is a group at https://eleuther.ai who took the source code and created their own training dataset a little larger than GPT-3 with some improvements. They are currently training it and maybe by August will complete it and will publish both the training data and trained model.