It’s not for anything important but I host a stupid discord bot trained on my friend group’s server chat history. It’s pretty much just a lobotomized ChatGPT but it’s a lot of fun. I’m looking to move off of OpenAI’s infrastructure though to something that doesn’t give money to the USA but it seems like everything is American.

Basically, I’m just looking for somewhere that I can finetune and run custom models. Does anyone know of such a place?

  • NotSteve_@lemmy.caOP
    5·
    7 months ago

    Yeah, I’m thinking I’ll actually just pick up a used 3060. I already have server hardware running Proxmox so it wouldn’t be the hardest to setup

    • Sturgist@lemmy.ca
      2·
      7 months ago

      My laptop has a 1650 and I’m able to run a local StableDiffusion model. Some things are a bit too intense for it, for instance I’m restricted to 514×514 resolution, but it works well. A single image finishes in under a minute.