Course Code: finetuningllms
Duration: 14 hours
Prerequisites:
  • 了解機器學習基礎知識
  • Python 個程式設計經驗
  • 熟悉預訓練模型及其應用

觀眾

  • 數據科學家
  • 機器學習工程師
  • AI 研究人員
Overview:

微調模型和 LLM 是使預先訓練的機器學習模型適應特定任務和數據集的關鍵過程。本課程探討了微調的技術、工具和最佳實踐,重點介紹實現高性能的實際實施和優化策略。

這種由講師指導的實時培訓(在線或現場)面向希望為特定任務和數據集自定義預訓練模型的中高級專業人員。

在本次培訓結束時,參與者將能夠:

  • 瞭解微調的原理及其應用。
  • 準備數據集以微調預訓練模型。
  • 為 NLP 任務微調大型語言模型 (LLM)。
  • 優化模型性能並解決常見挑戰。

課程形式

  • 互動講座和討論。
  • 大量的練習和練習。
  • 在即時實驗室環境中動手實施。

課程自定義選項

  • 要申請本課程的定製培訓,請聯繫我們進行安排。
Course Outline:

微調簡介

  • 什麼是微調?
  • 微調的使用案例和優勢
  • 預訓練模型和遷移學習概述

準備微調

  • 收集和清理數據集
  • 瞭解特定於任務的數據要求
  • 探索性數據分析和預處理

微調技術

  • 遷移學習和特徵提取
  • 帶 Hugging Face 的微調變壓器
  • 針對監督任務與無監督任務進行微調

微調 Large Language Models (LLMs)

  • 使 LLM 適應 NLP 任務(例如,文字分類、摘要)
  • 使用自訂數據集訓練 LLM
  • 使用提示工程控制 LLM 行為

優化和評估

  • 超參數優化
  • 評估模型性能
  • 解決過擬合和欠擬合

擴展微調工作

  • 在分散式系統上進行微調
  • 利用基於雲端解決方案實現可擴充性
  • 案例研究:大規模微調專案

最佳實踐和挑戰

  • 微調成功的最佳實踐
  • 常見挑戰和故障排除
  • 微調 AI 模型的道德注意事項

進階主題(選擇)

  • 微調多模態模型
  • 零樣本和少數樣本學習
  • 探索LoRA (Low-Rank Adaptation) 技術

總結和後續步驟

Sites Published:

United Arab Emirates - Fine-Tuning Models and Large Language Models (LLMs)

Qatar - Fine-Tuning Models and Large Language Models (LLMs)

Egypt - Fine-Tuning Models and Large Language Models (LLMs)

Saudi Arabia - Fine-Tuning Models and Large Language Models (LLMs)

South Africa - Fine-Tuning Models and Large Language Models (LLMs)

Brasil - Fine-Tuning Models and Large Language Models (LLMs)

Canada - Fine-Tuning Models and Large Language Models (LLMs)

中国 - Fine-Tuning Models and Large Language Models (LLMs)

香港 - Fine-Tuning Models and Large Language Models (LLMs)

澳門 - Fine-Tuning Models and Large Language Models (LLMs)

台灣 - Fine-Tuning Models and Large Language Models (LLMs)

USA - Fine-Tuning Models and Large Language Models (LLMs)

Österreich - Fine-Tuning Models and Large Language Models (LLMs)

Schweiz - Fine-Tuning Models and Large Language Models (LLMs)

Deutschland - Fine-Tuning Models and Large Language Models (LLMs)

Czech Republic - Fine-Tuning Models and Large Language Models (LLMs)

Denmark - Fine-Tuning Models and Large Language Models (LLMs)

Estonia - Fine-Tuning Models and Large Language Models (LLMs)

Finland - Fine-Tuning Models and Large Language Models (LLMs)

Greece - Fine-Tuning Models and Large Language Models (LLMs)

Magyarország - Fine-Tuning Models and Large Language Models (LLMs)

Ireland - Fine-Tuning Models and Large Language Models (LLMs)

Luxembourg - Fine-Tuning Models and Large Language Models (LLMs)

Latvia - Fine-Tuning Models and Large Language Models (LLMs)

España - Fine-Tuning Models and Large Language Models (LLMs)

Italia - Fine-Tuning Models and Large Language Models (LLMs)

Lithuania - Fine-Tuning Models and Large Language Models (LLMs)

Nederland - Fine-Tuning Models and Large Language Models (LLMs)

Norway - Fine-Tuning Models and Large Language Models (LLMs)

Portugal - Fine-Tuning Models and Large Language Models (LLMs)

România - Fine-Tuning Models and Large Language Models (LLMs)

Sverige - Fine-Tuning Models and Large Language Models (LLMs)

Türkiye - Fine-Tuning Models and Large Language Models (LLMs)

Malta - Fine-Tuning Models and Large Language Models (LLMs)

Belgique - Fine-Tuning Models and Large Language Models (LLMs)

France - Fine-Tuning Models and Large Language Models (LLMs)

日本 - Fine-Tuning Models and Large Language Models (LLMs)

Australia - Fine-Tuning Models and Large Language Models (LLMs)

Malaysia - Fine-Tuning Models and Large Language Models (LLMs)

New Zealand - Fine-Tuning Models and Large Language Models (LLMs)

Philippines - Fine-Tuning Models and Large Language Models (LLMs)

Singapore - Fine-Tuning Models and Large Language Models (LLMs)

Thailand - Fine-Tuning Models and Large Language Models (LLMs)

Vietnam - Fine-Tuning Models and Large Language Models (LLMs)

India - Fine-Tuning Models and Large Language Models (LLMs)

Argentina - Fine-Tuning Models and Large Language Models (LLMs)

Chile - Fine-Tuning Models and Large Language Models (LLMs)

Costa Rica - Fine-Tuning Models and Large Language Models (LLMs)

Ecuador - Fine-Tuning Models and Large Language Models (LLMs)

Guatemala - Fine-Tuning Models and Large Language Models (LLMs)

Colombia - Fine-Tuning Models and Large Language Models (LLMs)

México - Fine-Tuning Models and Large Language Models (LLMs)

Panama - Fine-Tuning Models and Large Language Models (LLMs)

Peru - Fine-Tuning Models and Large Language Models (LLMs)

Uruguay - Fine-Tuning Models and Large Language Models (LLMs)

Venezuela - Fine-Tuning Models and Large Language Models (LLMs)

Polska - Fine-Tuning Models and Large Language Models (LLMs)

United Kingdom - Fine-Tuning Models and Large Language Models (LLMs)

South Korea - Fine-Tuning Models and Large Language Models (LLMs)

Pakistan - Fine-Tuning Models and Large Language Models (LLMs)

Sri Lanka - Fine-Tuning Models and Large Language Models (LLMs)

Bulgaria - Fine-Tuning Models and Large Language Models (LLMs)

Bolivia - Fine-Tuning Models and Large Language Models (LLMs)

Indonesia - Fine-Tuning Models and Large Language Models (LLMs)

Kazakhstan - Fine-Tuning Models and Large Language Models (LLMs)

Moldova - Fine-Tuning Models and Large Language Models (LLMs)

Morocco - Fine-Tuning Models and Large Language Models (LLMs)

Tunisia - Fine-Tuning Models and Large Language Models (LLMs)

Kuwait - Fine-Tuning Models and Large Language Models (LLMs)

Oman - Fine-Tuning Models and Large Language Models (LLMs)

Slovakia - Fine-Tuning Models and Large Language Models (LLMs)

Kenya - Fine-Tuning Models and Large Language Models (LLMs)

Nigeria - Fine-Tuning Models and Large Language Models (LLMs)

Botswana - Fine-Tuning Models and Large Language Models (LLMs)

Slovenia - Fine-Tuning Models and Large Language Models (LLMs)

Croatia - Fine-Tuning Models and Large Language Models (LLMs)

Serbia - Fine-Tuning Models and Large Language Models (LLMs)

Bhutan - Fine-Tuning Models and Large Language Models (LLMs)

Nepal - Fine-Tuning Models and Large Language Models (LLMs)

Uzbekistan - Fine-Tuning Models and Large Language Models (LLMs)