Support on multinode deepseek r1 671b deployment

[szhang67]

Hi, I am working on deploying a full 671b deepseek r1 model and come across your instruction.

However the instruction only provides a single machine deployment guide, which is not suitable for my case since I only have A100 (80G) machines.

I wonder if you could give me some instructions on how to deploy on multi-node with tensorfuse and vLLM docker?

thx

[samagra14]

We are currently working on adding multi node pods to Tensorfuse. We will let you know as soon as we ship them.