What is currently the leading chatbot that can be self hosted on your computer?
I have heard about alot of them and it seems like everyone and there dog is making one however I’m not sure which one I should be use.
Edit : I am running a 3060 with 12GB of ram
Mistral OpenOrca is a good one. I pull about 10 to 11 tokens/sec. Very impressive. For some reason though, i cannot get GPT4ALL to use my 2080ti even though it is selected in the settings.