• hottari@lemmy.ml
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    edit-2
    1 year ago

    An A6000 ranges between $4500 and $7000 . We are a long long way from reaching efficiency on affordable consumer grade hardware.

    • diffuselight@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      A 30B model which will be fine for specialized tasks runs on a 3090 or any modern mac today.

      We are months away from being affordable at current trajectory

      • hottari@lemmy.ml
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        1 year ago

        Which modern Mac are you talking about and how much does that cost? Again, I doubt any of the opensource 30B models can compete even with ChatGPT 3.5. Which is the point I started with earlier.

        Seems to me like you are riding this whole efficiency thing on nothing more than hopium.