flâneur

*Incredibly* simple guide to run language models locally on your PC, in 5 simple steps for non-techies. : singularity

reddit.com · 6 words · saved by 1 readers

ChatGPT is a language model. You run it over the cloud. It is censored in many ways. These language models run on your computer, and your conversation with them is totally private. And it's free forever. And many of them are completely uncensored and will talk about anything, no matter how dirty or socially unacceptable, etc. The point is - this is your own personal private ChatGPT (not quite as smart) that will never refuse to discuss ANY topic, and is completely private and local on your machine. And yes it will write code for you too. This guide is for Windows (but you can run them on Macs and Linux too). 1) Create a new folder on your computer. 2) Go here and download the latest koboldcpp.exe: https://github.com/LostRuins/koboldcpp/releases As of this writing, the latest version is 1.29 Stick that file into your new folder. 3) Go to my leaderboard and pick a model. Click on any link inside the "Scores" tab of the spreadsheet, which takes you to huggingface. Check the Files and vers

Reddit - Please wait for verification

related reading