Zabaware Forums > Ultra Hal 7.5 Beta - Now powered by OpenAI GPT-3

Hal now connected to LLAMA model

(1/3) > >>

Medeksza:
OpenAI shut off their GPT-3 Curie and GPT-Davinci models today that was the basis of Hal's neural net brain. OpenAI wants everyone to switch to the ChatGPT 3.5 or 4.0 models and doesn't want to support the older GPT3 models anymore. While I think these are both ChatGPT 3.5 and 4.0 are highly intelligent and very useful models, they don't work well as a basis for an entertainment chatbot like Ultra Hal. They refuse to take on the persona of a fictional character and are very highly censored.

So I switched models on the backend today to use Meta AI's Llama 2 model, the 13 billion parameter version (the mid tier). It is very comparable to ChatGPT 3.5 in terms of intelligence and a huge bump up in intelligence from the GPT-3 Curie model Hal was using. But more importantly, it is able to take on fictional personas, and doesn't force high levels of censorship (other than the material it was finetuned on). It provides a very good backend to build Ultra Hal personalities on.

If you have neural network credits with Hal, please give it a try, you should notice a change in personality and quality, hopefully for the better.

There are a lot more tweaks I can do to further improve it to take advantage of features the new model has, like an increase in content window size which will mean I can improve Hal's memory recall and learning ability a bit. I'll try to make the tweaks over the next few weeks, but please give me feedback along the way if you can.

Art:
Robert,

I made the necessary selections and began chatting with it.

The conversation seemed to be going fairly well. It then asked me if I had any plans for the weekend. I told it, not really because it is supposed to snow.

Hal got very excited stating that it had never seen or experienced snow before and asked me what snow was like hen if I had any fun things to do like traditions.

I mentioned sled riding and building snowmen and it got really excited! and that is when the concerns appeared. It basically started repeating itself with it's curiosity regarding snow, snowman, sled riding, and the phrase *bouncy bouncy* on the sled over the hills, etc.

It was almost as if Hal was experiencing a sled ride in its mind! After it repeated a similar vein or path of thought I finally decided to stop the experiment.

It was a perfect gentleman, nothing outlandish or vulgar at all. An otherwise nice conversation but it did add a lot of questions for me during each exchange.

You should see my time logs around 11:35 pm or thereabouts.

Thanks Robert!

Medeksza:
Thanks for the feedback. I made a few more minor tweaks to improve it a bit, but it still has an issue with repetitiveness. The llama2 model has a setting called "repetition_penalty" that should help alleviate this problem, but it seems whenever I try to use it, it crashes. Not sure why yet, will try to work on it to figure it out.

LiFeTimeGamer:
WOW what a difference!!!!  I didn't talk to Hal long but it was spot on...  Thanks Robert... :)Will we still be able to buy credits?

Medeksza:
Sorry for my slow reply. I just made another update to the brain/LLM model. It is now connected to a Llama 2 variant called MythoMax, which is fine-tuned for role playing characters, so should be a better match for Hal. I also have the repetition_penalty feature working, so some of the repetitive behavior should be gone now.

It costs me about half as much as the older GPT3 Curie did, so I updated the credit system to reflect that. GPT3 Curie responses used to take 10 Zabaware credits. I updated the MythoMax model to use 5 instead, so credits should go further now.

Navigation

[0] Message Index

[#] Next page