Language Model Teams as Distrbuted Systems

(arxiv.org)

40 points | by jryio 3 hours ago

3 comments

  • 50lo 1 minute ago
    Once you run more than one agent in a loop, you inevitably recreate distributed systems problems: message ordering, retries, partial failure, etc. Most agent frameworks pretend these don’t exist. Some of them address those problems partially. None of the frameworks I've seen address all of them.
  • measurablefunc 2 hours ago
    Next up, LLMs as actors & processes in π-calculus.
    • keeganpoppen 21 minutes ago
      i cant wait for the world to catch up to process, session, et al. calculii. the closest i’ve seen is all this “choreo” stuff that is floating around nowadays, which is pretty neat in itself.
    • timcobb 1 hour ago
      Is it web scale?
      • measurablefunc 1 hour ago
        Abstractly? 100%. Realistically? Depends on how many trillions we can get from investors.
    • robot-wrangler 52 minutes ago
      > Next up, LLMs as actors & processes in π-calculus.

      You jest, but agents are of course already useful and fairly formal primitives. Distinct from actors, agents can have things like goals/strategies. There's a whole body of research on multi-agent systems that already exists and is even implemented in some model-checkers. It's surprising how little interest that creates in most LLM / AI / ML enthusiasts, who don't seem that motivated to use the prior art to propose / study / implement topologies and interaction protocols for the new wave of "agentic".

      • andai 18 minutes ago
        Ten years ago at my old university we had a course called Multi-Agent Systems. The whole year built up to it: a course in Formal Logic with Prolog, Logic-Based AI (LBAI) with a robot in a block world, also with Prolog, and finally Multi-Agent Systems (MAS).

        In the MAS course, we used GOAL, which was a system built on top of Prolog. Agents had Goals, Perceptions, Beliefs, and Actions. The whole thing was deterministic. (Network lag aside ;)

        The actual project was that we programmed teams of bots for a Capture The Flag tournament in Unreal Tournament 3.

        So it was the most fun possible way to learn the coolest possible thing.

        The next year they threw out the whole curriculum and replaced it with Machine Learning.

      • charcircuit 14 minutes ago
        Could it just be that it is happening behind closed doors due to multi agents being part of the secret sauce of post training LLMs.
      • measurablefunc 45 minutes ago
        That's all nice & well but which protocol & topology will deliver the most dollars from investors?
  • rishabhjajoriya 26 minutes ago
    [flagged]