[ Ai and llms ] 9 min read
Two Strong Oxen or 1,024 Chickens: The Hardware and Network Behind LLM Training
A frontier training run is a networking problem dressed up in a math costume. The industry chose the chickens over the oxen, so how do you get 16,000 of them pulling in the same direction? Part three of six.