Course Code: dollmsollama
Duration: 14 hours
Prerequisites:
  • 具備機器學習和人工智慧模型的基本經驗
  • 熟悉命令列介面和腳本編寫
  • 了解部署環境（本地、邊緣、雲端）

目標受眾

  • 最佳化本地和雲端人工智慧部署的AI工程師
  • 部署和微調大型語言模型（LLM）的機器學習從業者
  • DevOps 管理人工智慧模型整合的專業人員
Overview:

Ollama 提供了一種高效的方式，可在本地或生產環境中部署和運行大型語言模型（LLMs），並提供對性能、成本和安全的控制。

這是一個由講師指導的實時培訓（線上或現場），適合希望使用 Ollama 來部署、優化和整合 LLMs 的中級專業人士。

在培訓結束時，參與者將能夠：

  • 使用 Ollama 設置和部署 LLMs。
  • 優化 AI 模型的性能和效率。
  • 利用 GPU 加速來提升推理速度。
  • 將 Ollama 整合到工作流程和應用程式中。
  • 監控和維護 AI 模型的長期性能。

課程形式

  • 互動式講座與討論。
  • 大量練習與實作。
  • 在實時實驗室環境中進行動手實作。

課程定制選項

  • 如需為本課程定制培訓，請聯繫我們安排。
Course Outline:

Ollama 大型語言模型部署入門

  • Ollama 功能概述
  • 本地 AI 模型部署的優勢
  • 與雲端 AI 託管解決方案的比較

部署環境設置

  • 安裝 Ollama 及所需依賴項
  • 配置硬體與 GPU 加速
  • Docker 化 Ollama 以實現可擴展部署

使用 Ollama 部署大型語言模型

  • 載入與管理 AI 模型
  • 部署 Llama 3、DeepSeek、Mistral 及其他模型
  • 創建 API 與端點以存取 AI 模型

優化大型語言模型性能

  • 微調模型以提高效率
  • 降低延遲並改善回應時間
  • 管理記憶體與資源分配

將 Ollama 整合至 AI 工作流程

  • 將 Ollama 連接至應用程式與服務
  • 自動化 AI 驅動的流程
  • 在邊緣運算環境中使用 Ollama

監控與維護

  • 追蹤性能並除錯問題
  • 更新與管理 AI 模型
  • 確保 AI 部署的安全性與合規性

擴展 AI 模型部署

  • 處理高工作負載的最佳實踐
  • 為企業用例擴展 Ollama
  • 本地 AI 模型部署的未來發展

總結與下一步

Sites Published:

United Arab Emirates - Deploying and Optimizing LLMs with Ollama

Qatar - Deploying and Optimizing LLMs with Ollama

Egypt - Deploying and Optimizing LLMs with Ollama

Saudi Arabia - Deploying and Optimizing LLMs with Ollama

South Africa - Deploying and Optimizing LLMs with Ollama

Brasil - Deploying and Optimizing LLMs with Ollama

Canada - Deploying and Optimizing LLMs with Ollama

中国 - Deploying and Optimizing LLMs with Ollama

香港 - Deploying and Optimizing LLMs with Ollama

澳門 - Deploying and Optimizing LLMs with Ollama

台灣 - Deploying and Optimizing LLMs with Ollama

USA - Deploying and Optimizing LLMs with Ollama

Österreich - Deploying and Optimizing LLMs with Ollama

Schweiz - Deploying and Optimizing LLMs with Ollama

Deutschland - Deploying and Optimizing LLMs with Ollama

Czech Republic - Deploying and Optimizing LLMs with Ollama

Denmark - Deploying and Optimizing LLMs with Ollama

Estonia - Deploying and Optimizing LLMs with Ollama

Finland - Deploying and Optimizing LLMs with Ollama

Greece - Deploying and Optimizing LLMs with Ollama

Magyarország - Deploying and Optimizing LLMs with Ollama

Ireland - Deploying and Optimizing LLMs with Ollama

Luxembourg - Deploying and Optimizing LLMs with Ollama

Latvia - Deploying and Optimizing LLMs with Ollama

España - Deploying and Optimizing LLMs with Ollama

Italia - Deploying and Optimizing LLMs with Ollama

Lithuania - Deploying and Optimizing LLMs with Ollama

Nederland - Deploying and Optimizing LLMs with Ollama

Norway - Deploying and Optimizing LLMs with Ollama

Portugal - Deploying and Optimizing LLMs with Ollama

România - Deploying and Optimizing LLMs with Ollama

Sverige - Deploying and Optimizing LLMs with Ollama

Türkiye - Deploying and Optimizing LLMs with Ollama

Malta - Deploying and Optimizing LLMs with Ollama

Belgique - Deploying and Optimizing LLMs with Ollama

France - Deploying and Optimizing LLMs with Ollama

日本 - Deploying and Optimizing LLMs with Ollama

Australia - Deploying and Optimizing LLMs with Ollama

Malaysia - Deploying and Optimizing LLMs with Ollama

New Zealand - Deploying and Optimizing LLMs with Ollama

Philippines - Deploying and Optimizing LLMs with Ollama

Singapore - Deploying and Optimizing LLMs with Ollama

Thailand - Deploying and Optimizing LLMs with Ollama

Vietnam - Deploying and Optimizing LLMs with Ollama

India - Deploying and Optimizing LLMs with Ollama

Argentina - Deploying and Optimizing LLMs with Ollama

Chile - Deploying and Optimizing LLMs with Ollama

Costa Rica - Deploying and Optimizing LLMs with Ollama

Ecuador - Deploying and Optimizing LLMs with Ollama

Guatemala - Deploying and Optimizing LLMs with Ollama

Colombia - Deploying and Optimizing LLMs with Ollama

México - Deploying and Optimizing LLMs with Ollama

Panama - Deploying and Optimizing LLMs with Ollama

Peru - Deploying and Optimizing LLMs with Ollama

Uruguay - Deploying and Optimizing LLMs with Ollama

Venezuela - Deploying and Optimizing LLMs with Ollama

Polska - Deploying and Optimizing LLMs with Ollama

United Kingdom - Deploying and Optimizing LLMs with Ollama

South Korea - Deploying and Optimizing LLMs with Ollama

Pakistan - Deploying and Optimizing LLMs with Ollama

Sri Lanka - Deploying and Optimizing LLMs with Ollama

Bulgaria - Deploying and Optimizing LLMs with Ollama

Bolivia - Deploying and Optimizing LLMs with Ollama

Indonesia - Deploying and Optimizing LLMs with Ollama

Kazakhstan - Deploying and Optimizing LLMs with Ollama

Moldova - Deploying and Optimizing LLMs with Ollama

Morocco - Deploying and Optimizing LLMs with Ollama

Tunisia - Deploying and Optimizing LLMs with Ollama

Kuwait - Deploying and Optimizing LLMs with Ollama

Oman - Deploying and Optimizing LLMs with Ollama

Slovakia - Deploying and Optimizing LLMs with Ollama

Kenya - Deploying and Optimizing LLMs with Ollama

Nigeria - Deploying and Optimizing LLMs with Ollama

Botswana - Deploying and Optimizing LLMs with Ollama

Slovenia - Deploying and Optimizing LLMs with Ollama

Croatia - Deploying and Optimizing LLMs with Ollama

Serbia - Deploying and Optimizing LLMs with Ollama

Bhutan - Deploying and Optimizing LLMs with Ollama

Nepal - Deploying and Optimizing LLMs with Ollama

Uzbekistan - Deploying and Optimizing LLMs with Ollama