Course Outline

Introduction

  • Overview of Horovod features and concepts
  • Understanding the supported frameworks

Installing and Configuring Horovod

  • Preparing the hosting environment    
  • Building Horovod for TensorFlow, Keras, PyTorch, and Apache MXNet
  • Running Horovod

Running Distributed Training

  • Modifying and running training examples with TensorFlow
  • Modifying and running training examples with Keras
  • Modifying and running training examples with PyTorch
  • Modifying and running training examples with Apache MXNet

Optimizing Distributed Training Processes

  • Running concurrent operations on multiple GPUs    
  • Tuning hyperparameters
  • Enabling performance autotuning

Troubleshooting

Summary and Conclusion

Requirements

  • An understanding of Machine Learning, specifically deep learning
  • Familiarity with machine learning libraries (TensorFlow, Keras, PyTorch, Apache MXNet)
  • Python programming experience

Audience

  • Developers
  • Data scientists
 7 Hours

Number of participants



Price per participant

Testimonials (5)

Related Courses

Artificial Intelligence (AI) in Automotive

14 Hours

Artificial Neural Networks, Machine Learning, Deep Thinking

21 Hours

Artificial Neural Networks, Machine Learning and Deep Thinking

21 Hours

Deep Learning for Vision with Caffe

21 Hours

Introduction to Deep Learning

21 Hours

DeepSpeed for Deep Learning

21 Hours

Advanced Deep Learning

28 Hours

Deep Learning AI Techniques for Executives, Developers and Managers

21 Hours

Deep Learning for Business

14 Hours

Deep Learning for Finance (with R)

28 Hours

Deep Learning for Banking (with Python)

28 Hours

Deep Learning for Banking (with R)

28 Hours

Deep Learning for Finance (with Python)

28 Hours

Deep Learning for Medicine

14 Hours

Deep Learning for Telecom (with Python)

28 Hours

Related Categories

1