Have a look at self hosted alternatives like Ollama in combination with Open-webui. It can be a hassle to set up, or even excruciatingly painful if you never touched a computer before, but it could be worth a try. I use it daily and like it much more than chatgpt to be honest.
I like the gemma models bc of the phrasing they use and that they give sources sometimes. The best results though come from llama3 I think. Also openhermes and openchat, which perform well enough for my purposes.
In the beginning i had used microsoft phi, that wasn’t that good though.
Have a look at self hosted alternatives like Ollama in combination with Open-webui. It can be a hassle to set up, or even excruciatingly painful if you never touched a computer before, but it could be worth a try. I use it daily and like it much more than chatgpt to be honest.
is the perfect description
You can literally run large language models with a single exe download: https://github.com/Mozilla-Ocho/llamafile
It doesn’t get much simpler than that.
Thanks!
I wish I did. What local model and version of ChatGPT did you compare?
For my purposes, ChatGPT 4 was leagues ahead of the largest model I could run on a 1060.
I like the gemma models bc of the phrasing they use and that they give sources sometimes. The best results though come from llama3 I think. Also openhermes and openchat, which perform well enough for my purposes.
In the beginning i had used microsoft phi, that wasn’t that good though.
I will have to give it another shot because I don’t recognize any of those models meaning I probably didn’t try them.