Course Code: slmsodai
Duration: 21 hours
Prerequisites:
  • 机器学习和深度学习概念的坚实基础
  • 熟练使用 Python 编程
  • AI部署硬件约束的基本知识

观众

  • 机器学习工程师和 AI 开发人员
  • 对 AI 应用感兴趣的嵌入式系统工程师
  • 监督 AI 项目的产品经理和技术主管
Overview:

小型语言模型 (SLM) 是高效且多功能的 AI 工具,可以在从智能手机到物联网设备的各种设备上实施,从而实现智能设备上的应用程序。

这种以讲师为主导的现场培训(在线或现场)面向希望将小型语言模型直接部署到处理能力有限的设备上的中级 IT 专业人员,为各个领域的创新应用开辟了可能性。

在培训结束时,参与者将能够:

  • 了解在紧凑型硬件上实施 AI 的挑战和解决方案。
  • 优化和压缩 AI 模型,实现高效的设备端部署。
  • 利用现代 AI 框架和工具实现设备上的模型。
  • 为移动和物联网设备设计和开发实时 AI 应用程序。
  • 评估并确保设备上 AI 系统的安全性和隐私性。

课程形式

  • 互动讲座和讨论。
  • 大量的练习和练习。
  • 在现场实验室环境中动手实施。

课程自定义选项

  • 如需申请本课程的定制培训,请联系我们进行安排。
Course Outline:

设备端 AI 简介

  • 设备端机器学习的基础知识
  • 小型语言模型的优势和挑战
  • 移动和 IoT 设备中的硬件限制概述

设备端部署的模型优化

  • 模型量化和修剪
  • 针对更小、更高效的模型进行知识提炼
  • 选择和调整模型以提高设备性能

特定于平台的 AI 工具和框架

  • TensorFlow Lite 和 PyTorch Mobile 简介
  • 利用特定于平台的库进行设备端 AI
  • 跨平台部署策略

实时推理和 Edge Computing

  • 在设备上快速高效推理的技术
  • 利用边缘计算实现设备端 AI
  • 实时 AI 应用案例研究

电源 Management 和电池寿命注意事项

  • 优化 AI 应用程序以提高能源效率
  • 平衡性能和功耗
  • 延长 AI 供电设备电池寿命的策略

设备端 AI 中的安全和隐私

  • 确保数据安全和用户隐私
  • 用于隐私保护的设备端数据处理
  • 安全的模型更新和维护

用户体验和交互设计

  • 为设备用户设计直观的 AI 交互
  • 将语言模型与用户界面集成
  • 设备端 AI 的用户测试和反馈

Scala能力与维护

  • 管理和更新已部署设备上的模型
  • 可扩展的设备端 AI 解决方案策略
  • 对已部署的 AI 系统进行监控和分析

项目与评估

  • 在选定域中开发原型并准备在选定设备上部署
  • 设备端 AI 解决方案演示
  • 基于效率、创新、实用性的评价

摘要和后续步骤

Sites Published:

United Arab Emirates - Small Language Models (SLMs) for On-Device AI

Qatar - Small Language Models (SLMs) for On-Device AI

Egypt - Small Language Models (SLMs) for On-Device AI

Saudi Arabia - Small Language Models (SLMs) for On-Device AI

South Africa - Small Language Models (SLMs) for On-Device AI

Brasil - Small Language Models (SLMs) for On-Device AI

Canada - Small Language Models (SLMs) for On-Device AI

中国 - Small Language Models (SLMs) for On-Device AI

香港 - Small Language Models (SLMs) for On-Device AI

澳門 - Small Language Models (SLMs) for On-Device AI

台灣 - Small Language Models (SLMs) for On-Device AI

USA - Small Language Models (SLMs) for On-Device AI

Österreich - Small Language Models (SLMs) for On-Device AI

Schweiz - Small Language Models (SLMs) for On-Device AI

Deutschland - Small Language Models (SLMs) for On-Device AI

Czech Republic - Small Language Models (SLMs) for On-Device AI

Denmark - Small Language Models (SLMs) for On-Device AI

Estonia - Small Language Models (SLMs) for On-Device AI

Finland - Small Language Models (SLMs) for On-Device AI

Greece - Small Language Models (SLMs) for On-Device AI

Magyarország - Small Language Models (SLMs) for On-Device AI

Ireland - Small Language Models (SLMs) for On-Device AI

Luxembourg - Small Language Models (SLMs) for On-Device AI

Latvia - Small Language Models (SLMs) for On-Device AI

España - Small Language Models (SLMs) for On-Device AI

Lithuania - Small Language Models (SLMs) for On-Device AI

Nederland - Small Language Models (SLMs) for On-Device AI

Norway - Small Language Models (SLMs) for On-Device AI

Portugal - Small Language Models (SLMs) for On-Device AI

România - Small Language Models (SLMs) for On-Device AI

Sverige - Small Language Models (SLMs) for On-Device AI

Türkiye - Small Language Models (SLMs) for On-Device AI

Malta - Small Language Models (SLMs) for On-Device AI

Belgique - Small Language Models (SLMs) for On-Device AI

France - Small Language Models (SLMs) for On-Device AI

日本 - Small Language Models (SLMs) for On-Device AI

Australia - Small Language Models (SLMs) for On-Device AI

Malaysia - Small Language Models (SLMs) for On-Device AI

New Zealand - Small Language Models (SLMs) for On-Device AI

Philippines - Small Language Models (SLMs) for On-Device AI

Singapore - Small Language Models (SLMs) for On-Device AI

Thailand - Small Language Models (SLMs) for On-Device AI

Vietnam - Small Language Models (SLMs) for On-Device AI

India - Small Language Models (SLMs) for On-Device AI

Argentina - Small Language Models (SLMs) for On-Device AI

Chile - Small Language Models (SLMs) for On-Device AI

Costa Rica - Small Language Models (SLMs) for On-Device AI

Ecuador - Small Language Models (SLMs) for On-Device AI

Guatemala - Small Language Models (SLMs) for On-Device AI

Colombia - Small Language Models (SLMs) for On-Device AI

México - Small Language Models (SLMs) for On-Device AI

Panama - Small Language Models (SLMs) for On-Device AI

Peru - Small Language Models (SLMs) for On-Device AI

Uruguay - Small Language Models (SLMs) for On-Device AI

Venezuela - Small Language Models (SLMs) for On-Device AI

Polska - Small Language Models (SLMs) for On-Device AI

United Kingdom - Small Language Models (SLMs) for On-Device AI

South Korea - Small Language Models (SLMs) for On-Device AI

Pakistan - Small Language Models (SLMs) for On-Device AI

Sri Lanka - Small Language Models (SLMs) for On-Device AI

Bulgaria - Small Language Models (SLMs) for On-Device AI

Bolivia - Small Language Models (SLMs) for On-Device AI

Indonesia - Small Language Models (SLMs) for On-Device AI

Kazakhstan - Small Language Models (SLMs) for On-Device AI

Moldova - Small Language Models (SLMs) for On-Device AI

Morocco - Small Language Models (SLMs) for On-Device AI

Tunisia - Small Language Models (SLMs) for On-Device AI

Kuwait - Small Language Models (SLMs) for On-Device AI

Oman - Small Language Models (SLMs) for On-Device AI

Slovakia - Small Language Models (SLMs) for On-Device AI

Kenya - Small Language Models (SLMs) for On-Device AI

Nigeria - Small Language Models (SLMs) for On-Device AI

Botswana - Small Language Models (SLMs) for On-Device AI

Slovenia - Small Language Models (SLMs) for On-Device AI

Croatia - Small Language Models (SLMs) for On-Device AI

Serbia - Small Language Models (SLMs) for On-Device AI

Bhutan - Small Language Models (SLMs) for On-Device AI

Nepal - Small Language Models (SLMs) for On-Device AI

Uzbekistan - Small Language Models (SLMs) for On-Device AI