- 具有 Python 和 Apache Kafka 的經驗
- 熟悉流處理平臺
觀眾
- 數據工程師
- 數據科學家
- 程式師
Apache Spark 流式處理是一種可擴展的開源流 處理系統，允許使用者處理來自受支援源的實時數據。Spark Streaming 支援對數據流進行容錯處理。
這種以講師為主導的現場培訓（現場或遠端）針對希望使用Spark Streaming功能處理和分析即時數據的數據工程師，數據科學家和程式師。
在本次培訓結束時，參與者將能夠使用 Spark Streaming 處理實時數據流，以便在資料庫、文件系統和即時儀錶板中使用。
課程形式
- 互動講座和討論。
- 大量的練習和練習。
- 在現場實驗室環境中實際實施。
課程定製選項
- 如需申請此課程的定製培訓，請聯繫我們進行安排。
介紹
Spark Streaming 功能和體系結構概述
- 支持的數據源
- 核心 API
準備環境
- 依賴
- Spark 和流式處理上下文
- 連接到 Kafka
處理消息
- 將入站消息解析為 JSON
- ETL 過程
- 啟動流式處理上下文
執行視窗化Stream Processing
- 滑動間隔
- 檢查點傳送配置
- 啟動環境
對處理代碼進行原型設計
- 連接到 Kafka 主題
- 使用 Paw 從數據源檢索 JSON
- 變更和額外處理
流式傳輸代碼
- 作業控制變數
- 定義要匹配的值
- 功能和條件
獲取流輸出
- 計數器
- Kafka 輸出（匹配和不符合）
故障排除
總結和結論
United Arab Emirates - Spark Streaming with Python and Kafka
Qatar - Spark Streaming with Python and Kafka
Egypt - Spark Streaming with Python and Kafka
Saudi Arabia - Spark Streaming with Python and Kafka
South Africa - Spark Streaming with Python and Kafka
Brasil - Spark Streaming with Python and Kafka
Canada - Spark Streaming with Python and Kafka
中国 - Spark Streaming with Python and Kafka
香港 - Spark Streaming with Python and Kafka
澳門 - Spark Streaming with Python and Kafka
台灣 - Spark Streaming with Python and Kafka
USA - Spark Streaming with Python and Kafka
Österreich - Spark Streaming with Python and Kafka
Schweiz - Spark Streaming with Python and Kafka
Deutschland - Spark Streaming with Python and Kafka
Czech Republic - Spark Streaming with Python and Kafka
Denmark - Spark Streaming with Python and Kafka
Estonia - Spark Streaming with Python and Kafka
Finland - Spark Streaming with Python and Kafka
Greece - Spark Streaming with Python and Kafka
Magyarország - Spark Streaming with Python and Kafka
Ireland - Spark Streaming with Python and Kafka
Luxembourg - Spark Streaming with Python and Kafka
Latvia - Spark Streaming with Python and Kafka
España - Spark Streaming with Python and Kafka
Italia - Spark Streaming with Python and Kafka
Lithuania - Spark Streaming with Python and Kafka
Nederland - Spark Streaming with Python and Kafka
Norway - Spark Streaming with Python and Kafka
Portugal - Spark Streaming with Python and Kafka
România - Spark Streaming with Python and Kafka
Sverige - Spark Streaming with Python and Kafka
Türkiye - Spark Streaming with Python and Kafka
Malta - Spark Streaming with Python and Kafka
Belgique - Spark Streaming with Python and Kafka
France - Spark Streaming with Python and Kafka
日本 - Spark Streaming with Python and Kafka
Australia - Spark Streaming with Python and Kafka
Malaysia - Spark Streaming with Python and Kafka
New Zealand - Spark Streaming with Python and Kafka
Philippines - Spark Streaming with Python and Kafka
Singapore - Spark Streaming with Python and Kafka
Thailand - Spark Streaming with Python and Kafka
Vietnam - Spark Streaming with Python and Kafka
India - Spark Streaming with Python and Kafka
Argentina - Spark Streaming with Python and Kafka
Chile - Spark Streaming with Python and Kafka
Costa Rica - Spark Streaming with Python and Kafka
Ecuador - Spark Streaming with Python and Kafka
Guatemala - Spark Streaming with Python and Kafka
Colombia - Spark Streaming with Python and Kafka
México - Spark Streaming with Python and Kafka
Panama - Spark Streaming with Python and Kafka
Peru - Spark Streaming with Python and Kafka
Uruguay - Spark Streaming with Python and Kafka
Venezuela - Spark Streaming with Python and Kafka
Polska - Spark Streaming with Python and Kafka
United Kingdom - Spark Streaming with Python and Kafka
South Korea - Spark Streaming with Python and Kafka
Pakistan - Spark Streaming with Python and Kafka
Sri Lanka - Spark Streaming with Python and Kafka
Bulgaria - Spark Streaming with Python and Kafka
Bolivia - Spark Streaming with Python and Kafka
Indonesia - Spark Streaming with Python and Kafka
Kazakhstan - Spark Streaming with Python and Kafka
Moldova - Spark Streaming with Python and Kafka
Morocco - Spark Streaming with Python and Kafka
Tunisia - Spark Streaming with Python and Kafka
Kuwait - Spark Streaming with Python and Kafka
Oman - Spark Streaming with Python and Kafka
Slovakia - Spark Streaming with Python and Kafka
Kenya - Spark Streaming with Python and Kafka
Nigeria - Spark Streaming with Python and Kafka
Botswana - Spark Streaming with Python and Kafka
Slovenia - Spark Streaming with Python and Kafka
Croatia - Spark Streaming with Python and Kafka
Serbia - Spark Streaming with Python and Kafka
Bhutan - Spark Streaming with Python and Kafka