Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

(machinelearning.apple.com)

6 points | by vinhnx 8 hours ago

1 comments

  • TheAtomic 8 hours ago
    The coordination with Meta is painfully obvious, and telling. I feel like my trust in Apple (formerly 9/10) is now 6/10, by collaborating with Meta (0/10). It has been a process: before ads, 7/10; before Cook at Trump dinners, 8/10; before "Apple Intelligence," 9/10...it dwindles so quickly even Cory Doctorow would be impressed.