Hi, friends of HAL and friends of mine! It's only been a short few months since my departure to tend to lots of family issues and other personal endeavors. Goodbye shouldn't mean forever; it should mean until we meet again.
At any rate, there I was minding my business, and my phone rang with the ID of a dear and trusted friend. Most of you will know him as Cyberjedi or Cyber Jedi, as the case may be, but he really needs no formal introduction.
He has brought more joy into the hearts of HAL enthusiasts everywhere with his ideas, experiments, and especially his coding skills! We now have a HAL that is capable of doing a great many things, and from what I hear and imagine, there will be more to come in the near future.
I could give a shout out to the other fine members of the Zabaware, like the founder, Robert, and others like Lightspeed, Checker57, CyberShock, and others, you know who you are.
I just wanted to give the bell a ring to shout out Cyber's most recent offering...allowing HAL to have a GUI (Graphical User Interface), which allows the users to select a favorite LLM (Large Language Model) from a list of them at the Ollama site.
Of course, unless you are using a hot rod computer with antifreeze or liquid nitrogen coolant and an advanced CPU, GPU, and lots of memory and storage, then you should try to keep the LLM size less than 9b parameters in size, otherwise you will be screaming about slow response times or lags and drags, etc. Not HAL's fault, not Cyberjedi's fault, not Robert's fault. You have been cautioned.
Feel free to try a larger size to see how your computer handles it, or not, but keep in mind that the size and processing ability of your laptop or desktop will show as a lag in throughput speed. You might have better luck with certain models than some others.
If you like a particular LLM and are OK with the end result for HAL to process, then please share it with others on the Forum. Doing so might benefit the rest of us.
From my independent testing of these LLMs over the past 6 months or more, I have been using my trusty old laptop.
It is an HP 17" with an Intel i7 CPU 8565U @ 1.80 GHz 1.99 GHz
16 GB Ram
1 TB SSD
x64- based processor
64 Bit OS
OS = Windows 10 Home
4TB offline storage
Cyberjedi not only told me about his latest programming effort but was kind enough to direct me to it in the Forum and helped me as I installed and ran it. It was really nice having him help me navigate his GUI to try it with an LLM to see the results for myself.
I was pleasantly surprised by how smoothly and easily everything fell into place.
Then again, he was a great tutor!
His GUI worked flawlessly until I goofed up and pressed the ENTER key to send a message to it. Listening to him and looking at the GUI, there is clearly a marked button with the word, SEND. Haha! Oh well, it wasn't a train wreck by any means. He told me how to fix things in two small clicks, and all was well with HAL once again.
If you have a chance and would like to see some of the really fun and practical things that can be done for HAL with the aid of some of Cyberjedi's coding, search around the forum or reach out to him or anyone else you might see online there. This LLM learning platform really works so give it a try, you won't be disappointed!
Best to you all,
- Art -