• Assian_Candor [comrade/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    1 month ago

    Yeah probably a better pi setup would be to create more granular agent types. I tried creating a worker powered by deepseek but found it wasn’t really that good. Something like an agent team spec (use a technical product manager agent to coordinate modules, review the worker output, and to make necessary corrections) then you could use a frontier model to plan and issue work instructions to the TPM agent

    Not sure if this would be more economical in practice but would be interesting to try

    Long run I think you will always need the data centers to handle big training loads but we might go back to on-prem computing for enterprises to run frontier models. Or even edge nodes that have enough muscle that folks can subscribe to locally.

    Something in your city you can sub to for $30 a month that lets you run any flagship open source model could be very compelling

    • ZWQbpkzl [none/use name]@hexbear.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      Something in your city you can sub to for $30 a month that lets you run any flagship open source model could be very compelling

      The admins at db0 have some sort of AI service mesh running already so thats way more viable than you’d think.