• diffuselight@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    A 30B model which will be fine for specialized tasks runs on a 3090 or any modern mac today.

    We are months away from being affordable at current trajectory

    • hottari@lemmy.ml
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      Which modern Mac are you talking about and how much does that cost? Again, I doubt any of the opensource 30B models can compete even with ChatGPT 3.5. Which is the point I started with earlier.

      Seems to me like you are riding this whole efficiency thing on nothing more than hopium.