1 problem

0 votes0 replies0 views
Positive recurrence of the fork-join LLM engine network
Consider a fork-join network of four LLM agents indexed by $j\in\{0,1,2,3\}$ . Requests arrive at agent $0$ with rate $\lambda$ , fork into tasks processed by agents $1$ and $2$ , and…
Conjectureopenllm-inference queueing-theory stochastic-networksarXiv posted 2 days ago

Positive recurrence of the fork-join LLM engine network