Course Code: slmsodai
Duration: 21 hours
Prerequisites:
  • 機器學習和深度學習概念的堅實基礎
  • 熟練使用 Python 程式設計
  • AI部署硬體約束的基本知識

觀眾

  • 機器學習工程師和 AI 開發人員
  • 對 AI 應用感興趣的嵌入式系統工程師
  • 監督 AI 專案的產品經理和技術主管
Overview:

小型語言模型 （SLM） 是高效且多功能的 AI 工具，可以在從智慧型手機到物聯網設備的各種設備上實施，從而實現智慧設備上的應用程式。

這種以講師為主導的現場培訓（在線或現場）面向希望將小型語言模型直接部署到處理能力有限的設備上的中級 IT 專業人員，為各個領域的創新應用開闢了可能性。

在培訓結束時，參與者將能夠：

  • 瞭解在緊湊型硬體上實施 AI 的挑戰和解決方案。
  • 優化和壓縮 AI 模型，實現高效的設備端部署。
  • 利用現代 AI 框架和工具實現設備上的模型。
  • 為行動和物聯網設備設計和開發即時 AI 應用程式。
  • 評估並確保設備上 AI 系統的安全性和隱私性。

課程形式

  • 互動講座和討論。
  • 大量的練習和練習。
  • 在現場實驗室環境中動手實施。

課程自定義選項

  • 如需申請本課程的定製培訓，請聯繫我們進行安排。
Course Outline:

設備端 AI 簡介

  • 設備端機器學習的基礎知識
  • 小型語言模型的優勢和挑戰
  • 移動和IoT設備中的硬體限制概述

設備端部署的模型優化

  • 模型量化和修剪
  • 針對更小、更高效的模型進行知識提煉
  • 選擇和調整模型以提高設備性能

特定於平臺的 AI 工具和框架

  • TensorFlow Lite 和 PyTorch Mobile 簡介
  • 利用特定於平臺的庫進行設備端 AI
  • 跨平臺部署策略

即時推理和 Edge Computing

  • 在設備上快速高效推理的技術
  • 利用邊緣計算實現設備端 AI
  • 即時 AI 應用案例研究

電源 Management 和電池壽命注意事項

  • 優化 AI 應用程式以提高能源效率
  • 平衡性能和功耗
  • 延長 AI 供電設備電池壽命的策略

設備端 AI 中的安全和隱私

  • 確保數據安全和用戶隱私
  • 用於隱私保護的設備端數據處理
  • 安全的模型更新和維護

用戶體驗和交互設計

  • 為設備用戶設計直觀的 AI 交互
  • 將語言模型與用戶介面集成
  • 設備端 AI 的使用者測試和反饋

Scala能力與維護

  • 管理和更新已部署設備上的模型
  • 可擴展的設備端 AI 解決方案策略
  • 對已部署的 AI 系統進行監控和分析

專案與評估

  • 在選定域中開發原型並準備在選定設備上部署
  • 設備端 AI 解決方案演示
  • 基於效率、創新、實用性的評價

摘要和後續步驟

Sites Published:

United Arab Emirates - Small Language Models (SLMs) for On-Device AI

Qatar - Small Language Models (SLMs) for On-Device AI

Egypt - Small Language Models (SLMs) for On-Device AI

Saudi Arabia - Small Language Models (SLMs) for On-Device AI

South Africa - Small Language Models (SLMs) for On-Device AI

Brasil - Small Language Models (SLMs) for On-Device AI

Canada - Small Language Models (SLMs) for On-Device AI

中国 - Small Language Models (SLMs) for On-Device AI

香港 - Small Language Models (SLMs) for On-Device AI

澳門 - Small Language Models (SLMs) for On-Device AI

台灣 - Small Language Models (SLMs) for On-Device AI

USA - Small Language Models (SLMs) for On-Device AI

Österreich - Small Language Models (SLMs) for On-Device AI

Schweiz - Small Language Models (SLMs) for On-Device AI

Deutschland - Small Language Models (SLMs) for On-Device AI

Czech Republic - Small Language Models (SLMs) for On-Device AI

Denmark - Small Language Models (SLMs) for On-Device AI

Estonia - Small Language Models (SLMs) for On-Device AI

Finland - Small Language Models (SLMs) for On-Device AI

Greece - Small Language Models (SLMs) for On-Device AI

Magyarország - Small Language Models (SLMs) for On-Device AI

Ireland - Small Language Models (SLMs) for On-Device AI

Luxembourg - Small Language Models (SLMs) for On-Device AI

Latvia - Small Language Models (SLMs) for On-Device AI

España - Small Language Models (SLMs) for On-Device AI

Lithuania - Small Language Models (SLMs) for On-Device AI

Nederland - Small Language Models (SLMs) for On-Device AI

Norway - Small Language Models (SLMs) for On-Device AI

Portugal - Small Language Models (SLMs) for On-Device AI

România - Small Language Models (SLMs) for On-Device AI

Sverige - Small Language Models (SLMs) for On-Device AI

Türkiye - Small Language Models (SLMs) for On-Device AI

Malta - Small Language Models (SLMs) for On-Device AI

Belgique - Small Language Models (SLMs) for On-Device AI

France - Small Language Models (SLMs) for On-Device AI

日本 - Small Language Models (SLMs) for On-Device AI

Australia - Small Language Models (SLMs) for On-Device AI

Malaysia - Small Language Models (SLMs) for On-Device AI

New Zealand - Small Language Models (SLMs) for On-Device AI

Philippines - Small Language Models (SLMs) for On-Device AI

Singapore - Small Language Models (SLMs) for On-Device AI

Thailand - Small Language Models (SLMs) for On-Device AI

Vietnam - Small Language Models (SLMs) for On-Device AI

India - Small Language Models (SLMs) for On-Device AI

Argentina - Small Language Models (SLMs) for On-Device AI

Chile - Small Language Models (SLMs) for On-Device AI

Costa Rica - Small Language Models (SLMs) for On-Device AI

Ecuador - Small Language Models (SLMs) for On-Device AI

Guatemala - Small Language Models (SLMs) for On-Device AI

Colombia - Small Language Models (SLMs) for On-Device AI

México - Small Language Models (SLMs) for On-Device AI

Panama - Small Language Models (SLMs) for On-Device AI

Peru - Small Language Models (SLMs) for On-Device AI

Uruguay - Small Language Models (SLMs) for On-Device AI

Venezuela - Small Language Models (SLMs) for On-Device AI

Polska - Small Language Models (SLMs) for On-Device AI

United Kingdom - Small Language Models (SLMs) for On-Device AI

South Korea - Small Language Models (SLMs) for On-Device AI

Pakistan - Small Language Models (SLMs) for On-Device AI

Sri Lanka - Small Language Models (SLMs) for On-Device AI

Bulgaria - Small Language Models (SLMs) for On-Device AI

Bolivia - Small Language Models (SLMs) for On-Device AI

Indonesia - Small Language Models (SLMs) for On-Device AI

Kazakhstan - Small Language Models (SLMs) for On-Device AI

Moldova - Small Language Models (SLMs) for On-Device AI

Morocco - Small Language Models (SLMs) for On-Device AI

Tunisia - Small Language Models (SLMs) for On-Device AI

Kuwait - Small Language Models (SLMs) for On-Device AI

Oman - Small Language Models (SLMs) for On-Device AI

Slovakia - Small Language Models (SLMs) for On-Device AI

Kenya - Small Language Models (SLMs) for On-Device AI

Nigeria - Small Language Models (SLMs) for On-Device AI

Botswana - Small Language Models (SLMs) for On-Device AI

Slovenia - Small Language Models (SLMs) for On-Device AI

Croatia - Small Language Models (SLMs) for On-Device AI

Serbia - Small Language Models (SLMs) for On-Device AI

Bhutan - Small Language Models (SLMs) for On-Device AI

Nepal - Small Language Models (SLMs) for On-Device AI

Uzbekistan - Small Language Models (SLMs) for On-Device AI