Course Code: airflowds
Duration: 21 hours
Prerequisites:
  • 熟悉機器學習工作流程和概念
  • 對 Apache Airflow 有基本的瞭解,包括 DAG 和運算符
  • 熟練掌握 Python 程式設計

觀眾

  • 數據科學家
  • 機器學習工程師
  • AI 開發人員
Overview:

Apache Airflow 是一個開源平臺,用於編排工作流和自動化複雜的數據管道。

這種講師指導的現場培訓(在線或現場)面向希望自動化和管理機器學習工作流程的中級參與者,包括使用 Apache Airflow 進行模型訓練、驗證和部署。

在本次培訓結束時,參與者將能夠:

  • 設置 Apache Airflow 用於機器學習工作流編排。
  • 自動執行數據預處理、模型訓練和驗證任務。
  • 將 Airflow 與機器學習框架和工具整合。
  • 使用自動化管道部署機器學習模型。
  • 監控和優化生產中的機器學習工作流程。

課程形式

  • 互動講座和討論。
  • 大量的練習和練習。
  • 在即時實驗室環境中動手實施。

課程自定義選項

  • 要申請本課程的定製培訓,請聯繫我們進行安排。
Course Outline:

Machine Learning 的 Apache Airflow 簡介

  • Apache Airflow 概述及其與數據科學的相關性
  • 自動化機器學習工作流程的主要功能
  • 為數據科學項目設置 Airflow

使用 Airflow 構建 Machine Learning 管道

  • 為端到端ML工作流設計DAG
  • 使用運算符進行數據攝取、預處理和特徵工程
  • 計劃和管理管道依賴關係

模型訓練和驗證

  • 使用 Airflow 自動執行模型訓練任務
  • 將 Airflow 與 ML 框架集成(例如 TensorFlow、PyTorch)
  • 驗證模型並存儲評估指標

模型部署和監控

  • 使用自動化管道部署機器學習模型
  • 使用 Airflow 任務監控已部署的模型
  • 處理重新訓練和模型更新

高級定製和整合

  • 為 ML 特定任務開發自訂運算元
  • 將 Airflow 與雲平臺和 ML 服務整合
  • 使用外掛程式和感測器擴展 Airflow 工作流

優化和擴展 ML 管道

  • 提高大規模數據的工作流性能
  • 使用 Celery 和 Kubernetes 擴展 Airflow 部署
  • 生產級 ML 工作流的最佳實踐

案例研究和實際應用

  • 使用 Airflow 實現 ML 自動化的真實範例
  • 動手練習:構建端到端ML管道
  • 討論 ML 工作流管理中的挑戰和解決方案

總結和後續步驟

Sites Published:

United Arab Emirates - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Qatar - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Egypt - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Saudi Arabia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

South Africa - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Brasil - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Canada - Apache Airflow for Data Science: Automating Machine Learning Pipelines

中国 - Apache Airflow for Data Science: Automating Machine Learning Pipelines

香港 - Apache Airflow for Data Science: Automating Machine Learning Pipelines

澳門 - Apache Airflow for Data Science: Automating Machine Learning Pipelines

台灣 - Apache Airflow for Data Science: Automating Machine Learning Pipelines

USA - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Österreich - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Schweiz - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Deutschland - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Czech Republic - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Denmark - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Estonia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Finland - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Greece - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Magyarország - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Ireland - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Luxembourg - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Latvia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

España - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Italia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Lithuania - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Nederland - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Norway - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Portugal - Apache Airflow for Data Science: Automating Machine Learning Pipelines

România - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Sverige - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Türkiye - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Malta - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Belgique - Apache Airflow for Data Science: Automating Machine Learning Pipelines

France - Apache Airflow for Data Science: Automating Machine Learning Pipelines

日本 - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Australia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Malaysia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

New Zealand - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Philippines - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Singapore - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Thailand - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Vietnam - Apache Airflow for Data Science: Automating Machine Learning Pipelines

India - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Argentina - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Chile - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Costa Rica - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Ecuador - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Guatemala - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Colombia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

México - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Panama - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Peru - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Uruguay - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Venezuela - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Polska - Apache Airflow for Data Science: Automating Machine Learning Pipelines

United Kingdom - Apache Airflow for Data Science: Automating Machine Learning Pipelines

South Korea - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Pakistan - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Sri Lanka - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Bulgaria - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Bolivia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Indonesia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Kazakhstan - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Moldova - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Morocco - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Tunisia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Kuwait - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Oman - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Slovakia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Kenya - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Nigeria - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Botswana - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Slovenia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Croatia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Serbia - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Bhutan - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Nepal - Apache Airflow for Data Science: Automating Machine Learning Pipelines

Uzbekistan - Apache Airflow for Data Science: Automating Machine Learning Pipelines