Course Code: horovod
Duration: 7 hours
Prerequisites:
  • 理解 Machine Learning,特別是深度學習
  • 熟悉機器學習庫(TensorFlow、Keras、PyTorch、Apache MXNet)
  • Python 程式設計經驗

觀眾

  • 開發人員
  • 數據科學家
Overview:

Horovod 是一個開源軟體框架,旨在使用 TensorFlow、Keras、PyTorch 和 Apache MXNet 處理快速高效的分散式深度學習模型。它可以擴展單個 GPU 訓練腳本,以便在多個 GPU 或主機上運行,只需進行最少的代碼更改。

這種由講師指導的即時培訓(在線或現場)面向希望使用 Horovod 運行分散式深度學習訓練並將其擴展為在多個 GPU 之間並行運行的開發人員或數據科學家。

在本次培訓結束時,參與者將能夠:

  • 設置必要的開發環境以開始運行深度學習訓練。
  • 安裝並配置 Horovod 以使用 TensorFlow、Keras、PyTorch 和 Apache MXNet 訓練模型。
  • 使用 Horovod 擴展深度學習訓練以在多個 GPU 上運行。

課程形式

  • 互動講座和討論。
  • 大量的練習和練習。
  • 在即時實驗室環境中動手實施。

課程自定義選項

  • 本課程側重於 Horovod,但可能需要其他軟體工具和框架,如 TensorFlow、Keras、PyTorch 和 Apache MXNet。如果您有具體要求或偏好,請告訴我們。
  • 要申請本課程的定製培訓,請聯繫我們進行安排。
Course Outline:

介紹

  • Horovod 功能和概念概述
  • 了解支援的框架

安裝和設定 Horovod

  • 準備託管環境    
  • 為 TensorFlow、Keras、PyTorch 和 Apache MXNet 構建 Horovod
  • 正在執行 Horovod

運行分散式訓練

  • 使用 TensorFlow 修改和運行訓練範例
  • 使用 Keras 修改和運行訓練範例
  • 使用 Py 修改和運行訓練範例Torch
  • 使用 Apache MXNet 修改和運行訓練範例

優化分散式訓練過程

  • 在多個GPU    上運行併發操作
  • 優化超參數
  • 啟用性能自動調整

故障排除

總結和結論

Sites Published:

United Arab Emirates - Distributed Deep Learning with Horovod

Qatar - Distributed Deep Learning with Horovod

Egypt - Distributed Deep Learning with Horovod

Saudi Arabia - Distributed Deep Learning with Horovod

South Africa - Distributed Deep Learning with Horovod

Brasil - Distributed Deep Learning with Horovod

Canada - Distributed Deep Learning with Horovod

中国 - Distributed Deep Learning with Horovod

香港 - Distributed Deep Learning with Horovod

澳門 - Distributed Deep Learning with Horovod

台灣 - Distributed Deep Learning with Horovod

USA - Distributed Deep Learning with Horovod

Österreich - Distributed Deep Learning with Horovod

Schweiz - Distributed Deep Learning with Horovod

Deutschland - Distributed Deep Learning with Horovod

Czech Republic - Distributed Deep Learning with Horovod

Denmark - Distributed Deep Learning with Horovod

Estonia - Distributed Deep Learning with Horovod

Finland - Distributed Deep Learning with Horovod

Greece - Distributed Deep Learning with Horovod

Magyarország - Distributed Deep Learning with Horovod

Ireland - Distributed Deep Learning with Horovod

Luxembourg - Distributed Deep Learning with Horovod

Latvia - Distributed Deep Learning with Horovod

España - Distributed Deep Learning with Horovod

Italia - Distributed Deep Learning with Horovod

Lithuania - Distributed Deep Learning with Horovod

Nederland - Distributed Deep Learning with Horovod

Norway - Distributed Deep Learning with Horovod

Portugal - Distributed Deep Learning with Horovod

România - Distributed Deep Learning with Horovod

Sverige - Distributed Deep Learning with Horovod

Türkiye - Distributed Deep Learning with Horovod

Malta - Distributed Deep Learning with Horovod

Belgique - Distributed Deep Learning with Horovod

France - Distributed Deep Learning with Horovod

日本 - Distributed Deep Learning with Horovod

Australia - Distributed Deep Learning with Horovod

Malaysia - Distributed Deep Learning with Horovod

New Zealand - Distributed Deep Learning with Horovod

Philippines - Distributed Deep Learning with Horovod

Singapore - Distributed Deep Learning with Horovod

Thailand - Distributed Deep Learning with Horovod

Vietnam - Distributed Deep Learning with Horovod

India - Distributed Deep Learning with Horovod

Argentina - Distributed Deep Learning with Horovod

Chile - Distributed Deep Learning with Horovod

Costa Rica - Distributed Deep Learning with Horovod

Ecuador - Distributed Deep Learning with Horovod

Guatemala - Distributed Deep Learning with Horovod

Colombia - Distributed Deep Learning with Horovod

México - Distributed Deep Learning with Horovod

Panama - Distributed Deep Learning with Horovod

Peru - Distributed Deep Learning with Horovod

Uruguay - Distributed Deep Learning with Horovod

Venezuela - Distributed Deep Learning with Horovod

Polska - Distributed Deep Learning with Horovod

United Kingdom - Distributed Deep Learning with Horovod

South Korea - Distributed Deep Learning with Horovod

Pakistan - Distributed Deep Learning with Horovod

Sri Lanka - Distributed Deep Learning with Horovod

Bulgaria - Distributed Deep Learning with Horovod

Bolivia - Distributed Deep Learning with Horovod

Indonesia - Distributed Deep Learning with Horovod

Kazakhstan - Distributed Deep Learning with Horovod

Moldova - Distributed Deep Learning with Horovod

Morocco - Distributed Deep Learning with Horovod

Tunisia - Distributed Deep Learning with Horovod

Kuwait - Distributed Deep Learning with Horovod

Oman - Distributed Deep Learning with Horovod

Slovakia - Distributed Deep Learning with Horovod

Kenya - Distributed Deep Learning with Horovod

Nigeria - Distributed Deep Learning with Horovod

Botswana - Distributed Deep Learning with Horovod

Slovenia - Distributed Deep Learning with Horovod

Croatia - Distributed Deep Learning with Horovod

Serbia - Distributed Deep Learning with Horovod

Bhutan - Distributed Deep Learning with Horovod

Nepal - Distributed Deep Learning with Horovod

Uzbekistan - Distributed Deep Learning with Horovod