Horovod (machine learning)

Horovod is a free and open-source software framework for distributed deep learning training using TensorFlow, Keras, PyTorch, and Apache MXNet. Horovod is hosted under the Linux Foundation AI (LF AI).^[3] Horovod has the goal of improving the speed, scale, and resource allocation when training a machine learning model.^[4]

Horovod

Developer(s)	Uber
Initial release	August 9, 2017; 7 years ago (2017-08-09)[1]
Stable release	v0.28.1[2] / June 12, 2023; 22 months ago (2023-06-12)
Written in	Python, C++, CUDA
Platform	Linux, macOS, Windows
Type	Artificial intelligence ecosystem
License	Apache License 2.0
Website	horovod.ai

See also

• Comparison of deep learning software
• Differentiable programming
• All-Reduce