When I first began thinking of GPT3 I thought about downloading the coding on to a storage device connected to the computer, SSD's do not contain enough memory so you would have to use a Hard drive in the tera byte range, cost is about $200 and I'm not sure if that would be large enough. It would eliminate paying for the cloud but it might make it possible to modify the training. At this time I can't even get a connected to a cloud with GPT 3. Looks like a lot of fun and You Tube has a lot of apps to do different things.
Carl2
Carl2