Idea: Using multiple machines compute power over local area network (distributed inference)

[Trundicho]

I have multiple macos machines lying around.
I guess with the layerd model approach it could be possible to preload them on different machines which should lead to faster inference response times.

Are there already plans to implement this?

[AiSatoshiBasilisk]

airllm+petals