Course Code: bigdata_
Duration: 35 hours
Prerequisites:
  • A general understanding of math
  • A general understanding of programming
  • A general understanding of databases

Audience

  • Developers / programmers
  • IT consultants
Overview:

Participants who complete this instructor-led, live training will gain a practical, real-world understanding of Big Data and its related technologies, methodologies and tools.

Participants will have the opportunity to put this knowledge into practice through hands-on exercises. Group interaction and instructor feedback make up an important component of the class.

The course starts with an introduction to elemental concepts of Big Data, then progresses into the programming languages and methodologies used to perform Data Analysis. Finally, we discuss the tools and infrastructure that enable Big Data storage, Distributed Processing, and Scalability.

Format of the Course

  • Interactive lecture and discussion.
  • Lots of exercises and practice.
  • Hands-on implementation in a live-lab environment.

Course Customization Options

  • To request a customized training for this course, please contact us to arrange.
Course Outline:

Introduction to Data Analysis and Big Data

  • What Makes Big Data "Big"?
    • Velocity, Volume, Variety, Veracity (VVVV)
  • Limits to Traditional Data Processing
  • Distributed Processing
  • Statistical Analysis
  • Types of Machine Learning Analysis
  • Data Visualization

Big Data Roles and Responsibilities

  • Administrators
  • Developers
  • Data Analysts

Languages Used for Data Analysis

  • R Language
    • Why R for Data Analysis?
    • Data manipulation, calculation and graphical display
  • Python
    • Why Python for Data Analysis?
    • Manipulating, processing, cleaning, and crunching data

Approaches to Data Analysis

  • Statistical Analysis
    • Time Series analysis
    • Forecasting with Correlation and Regression models
    • Inferential Statistics (estimating)
    • Descriptive Statistics in Big Data sets (e.g. calculating mean)
  • Machine Learning
    • Supervised vs unsupervised learning
    • Classification and clustering
    • Estimating cost of specific methods
    • Filtering
  • Natural Language Processing
    • Processing text
    • Understaing meaning of the text
    • Automatic text generation
    • Sentiment analysis / topic analysis
  • Computer Vision
    • Acquiring, processing, analyzing, and understanding images
    • Reconstructing, interpreting and understanding 3D scenes
    • Using image data to make decisions

Big Data Infrastructure

  • Data Storage
    • Relational databases (SQL)
      • MySQL
      • Postgres
      • Oracle
    • Non-relational databases (NoSQL)
      • Cassandra
      • MongoDB
      • Neo4js
    • Understanding the nuances
      • Hierarchical databases
      • Object-oriented databases
      • Document-oriented databases
      • Graph-oriented databases
      • Other
  • Distributed Processing
    • Hadoop
      • HDFS as a distributed filesystem
      • MapReduce for distributed processing
    • Spark
      • All-in-one in-memory cluster computing framework for large-scale data processing
      • Structured streaming
      • Spark SQL
      • Machine Learning libraries: MLlib
      • Graph processing with GraphX
  • Scalability
    • Public cloud
      • AWS, Google, Aliyun, etc.
    • Private cloud
      • OpenStack, Cloud Foundry, etc.
    • Auto-scalability

Choosing the Right Solution for the Problem

The Future of Big Data

Summary and Next Steps

Sites Published:

United Arab Emirates - A Practical Introduction to Data Analysis and Big Data

Qatar - A Practical Introduction to Data Analysis and Big Data

Egypt - A Practical Introduction to Data Analysis and Big Data

Saudi Arabia - A Practical Introduction to Data Analysis and Big Data

South Africa - A Practical Introduction to Data Analysis and Big Data

Brasil - A Practical Introduction to Data Analysis and Big Data

Canada - A Practical Introduction to Data Analysis and Big Data

中国 - 数据分析和大数据的实用介绍

香港 - A Practical Introduction to Data Analysis and Big Data

澳門 - A Practical Introduction to Data Analysis and Big Data

台灣 - A Practical Introduction to Data Analysis and Big Data

USA - A Practical Introduction to Data Analysis and Big Data

Österreich - A Practical Introduction to Data Analysis and Big Data

Schweiz - A Practical Introduction to Data Analysis and Big Data

Deutschland - A Practical Introduction to Data Analysis and Big Data

Czech Republic - A Practical Introduction to Data Analysis and Big Data

Denmark - A Practical Introduction to Data Analysis and Big Data

Estonia - A Practical Introduction to Data Analysis and Big Data

Finland - A Practical Introduction to Data Analysis and Big Data

Greece - A Practical Introduction to Data Analysis and Big Data

Magyarország - A Practical Introduction to Data Analysis and Big Data

Ireland - A Practical Introduction to Data Analysis and Big Data

Luxembourg - A Practical Introduction to Data Analysis and Big Data

Latvia - A Practical Introduction to Data Analysis and Big Data

España - Una introducción práctica al análisis de datos y Big Data

Italia - A Practical Introduction to Data Analysis and Big Data

Lithuania - A Practical Introduction to Data Analysis and Big Data

Nederland - A Practical Introduction to Data Analysis and Big Data

Norway - A Practical Introduction to Data Analysis and Big Data

Portugal - A Practical Introduction to Data Analysis and Big Data

România - A Practical Introduction to Data Analysis and Big Data

Sverige - A Practical Introduction to Data Analysis and Big Data

Türkiye - A Practical Introduction to Data Analysis and Big Data

Malta - A Practical Introduction to Data Analysis and Big Data

Belgique - A Practical Introduction to Data Analysis and Big Data

France - A Practical Introduction to Data Analysis and Big Data

日本 - A Practical Introduction to Data Analysis and Big Data

Australia - A Practical Introduction to Data Analysis and Big Data

Malaysia - A Practical Introduction to Data Analysis and Big Data

New Zealand - A Practical Introduction to Data Analysis and Big Data

Philippines - A Practical Introduction to Data Analysis and Big Data

Singapore - A Practical Introduction to Data Analysis and Big Data

Thailand - A Practical Introduction to Data Analysis and Big Data

Vietnam - A Practical Introduction to Data Analysis and Big Data

India - A Practical Introduction to Data Analysis and Big Data

Argentina - Una introducción práctica al análisis de datos y Big Data

Chile - Una introducción práctica al análisis de datos y Big Data

Costa Rica - Una introducción práctica al análisis de datos y Big Data

Ecuador - Una introducción práctica al análisis de datos y Big Data

Guatemala - Una introducción práctica al análisis de datos y Big Data

Colombia - Una introducción práctica al análisis de datos y Big Data

México - Una introducción práctica al análisis de datos y Big Data

Panama - Una introducción práctica al análisis de datos y Big Data

Peru - Una introducción práctica al análisis de datos y Big Data

Uruguay - Una introducción práctica al análisis de datos y Big Data

Venezuela - Una introducción práctica al análisis de datos y Big Data

Polska - A Practical Introduction to Data Analysis and Big Data

United Kingdom - A Practical Introduction to Data Analysis and Big Data

South Korea - A Practical Introduction to Data Analysis and Big Data

Pakistan - A Practical Introduction to Data Analysis and Big Data

Sri Lanka - A Practical Introduction to Data Analysis and Big Data

Bulgaria - A Practical Introduction to Data Analysis and Big Data

Bolivia - Una introducción práctica al análisis de datos y Big Data

Indonesia - A Practical Introduction to Data Analysis and Big Data

Kazakhstan - A Practical Introduction to Data Analysis and Big Data

Moldova - A Practical Introduction to Data Analysis and Big Data

Morocco - A Practical Introduction to Data Analysis and Big Data

Tunisia - A Practical Introduction to Data Analysis and Big Data

Kuwait - A Practical Introduction to Data Analysis and Big Data

Oman - A Practical Introduction to Data Analysis and Big Data

Slovakia - A Practical Introduction to Data Analysis and Big Data

Kenya - A Practical Introduction to Data Analysis and Big Data

Nigeria - A Practical Introduction to Data Analysis and Big Data

Botswana - A Practical Introduction to Data Analysis and Big Data

Slovenia - A Practical Introduction to Data Analysis and Big Data

Croatia - A Practical Introduction to Data Analysis and Big Data

Serbia - A Practical Introduction to Data Analysis and Big Data

Bhutan - A Practical Introduction to Data Analysis and Big Data

Nepal - A Practical Introduction to Data Analysis and Big Data

Uzbekistan - A Practical Introduction to Data Analysis and Big Data