SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Top 10 Best Apache
Spark video tutorials
Introduction
As we already discussed that how every day a large amount data is generated
in Hadoop video tutorials post and how Hadoop helps to process and manage
the large sets of data. It is not possible for the machine to handle requests
such CRUD operations on the dataset as the data is very huge. Hadoop solves
problems
● HDFS - Distributed Storage (It offers files to be stored in different
clusters)
● MapReduce - Computing Engine
● YARN - Resource Manager
Introduction contd..
Though Hadoop solves real-world problems but it was efficient as there were
many complexities with MapReduce. At the same time, Apache Spark was
evolved that solved enhanced the efficiency of Hadoop.
Why Apache Spark?
Spark runs 100x faster than the Hadoop MapReduce, as Spark uses called
DAG engine that optimizes the workflows. Many popular websites are using
Apache Spark namely, Amazon, eBay, NASA JPL, Groupon, Tripadvisor, Yahoo
and much more.
Introduction contd..
Apache Spark gives the flexibility to write the code in Java, Scala, R and Python
programming language. Out of all the programming languages, Scala works
best and efficient to work with Apache Spark as it is written in Scala
programming language.
Introduction contd..
Different components of Apache Spark:
● Spark Core
● Spark Streaming
● Spark SQL
● MLLib
● Graphx
Introduction contd..
Introduction contd..
There are many tutorials online but below are top 10 video tutorials to learn
Apache Spark.
Apache Spark 2.0 with Scala - Hands On with Big Data!
This video tutorial is popular video tutorial over the web which provides you a
basic overview of Apache Spark 2.0. You will understand how big data works
and what "big data" really is and you will also learn about scala programming.
This video tutorial is clear and focused with a very good balance between
theoretical and practical concepts. The instructor begins with explaining how
to set up the environment to get started with Apache Spark, how Spark will
solve the real world problems. If you want to learn Spark using Java, you can
go with Apache Spark with Java - Learn Spark from a Big Data Guru and if you
want to learn spark with Python then go with Taming Big Data with Apache
Spark and Python - Hands On
Apache Spark - Scala
This video tutorial is presented by itversity YouTube channel and this channel
has collection of videos related to bid data technologies which includes
Hadoop, Apache Spark, Hive, Pig, Sqoop, HBase, Cassandra, Mongo DB, ETL,
Data Warehousing, Linux, Oracle, MySQL, Aster, Greenplum, Teradata,
Goldengate and much more everything that is in the context of Big Data. Here,
the instructor has released a series of video tutorial on Apache Spark- Scala. It
is worth to go through this tutorials.
Apache Spark with Scala - Learn Spark from a Big Data Guru
This tutorial is another popular video tutorial to learn Apache Spark with Scala
programming. In this video tutorial, you will about the architecture of the
Apache Spark, how to develop the applications with Scala using RDD
transformations and Spark SQL. Also, you will learn about the advanced
techniques to improve Apache Spark jobs by partitioning, caching and
persisting RDDs and how to share information between the different nodes
across Apache Spark cluster by broadcast variables and accumulators etc,.
and the best practices to follow. Though the concepts are complex to
understand, the instructor managed to explain the code is very clear and in an
easy style.
Apache Spark 2.0 Novice to Expert Tutorial (Training)
This tutorial is presented by the TalentOrigin and here, TalentOrigin you will
find the tutorials on various topics related to BigData and Data analytics such
as Hadoop, Spark, PySpark, Python, Hive, Impala, Oozie, Cloudera, Horton
Works etc,. Here, in this Spark tutorial, you will learn the basic concepts of
Apache Spark. The instructor starts with explaining the how to download and
install Apache Spark. Then he explains about Spark Shell, RDD's,
transformations, Spark project using IntelliJ Maven and SBT and also with
Eclipse, Spark Dataframe, Creating a DataFrame with CSV file and working with
datasets vs Data frames and much more. It is worth to go through this
tutorial.
Learn Apache Spark from Scratch for Beginners
This tutorial is presented by Eduonix Learning Solutions and The course is
divided into four sections. In the first section, you will learn about how
different applications can be built using Apache Spark, Machine Learning, and
Graph X, then different modes in runtime, then how to set up the
HotronWorks VM, Scala API, then running Apache Spark. In the second
section, you will learn how to build and run the spark applications using
runtime modes. In the third section, you will learn how to build types of
applications such as visualization, Machine Learning, Streaming, SQL
application. you will also how to build the tools and spark(Maven and Gradle)
and submitting the application to Spark Driver.
Apache Spark
By the end of this tutorial, you will be able to understand why Apache Spark is
used and purpose of it, different components of Apache Spark unified stack,
understanding the RDD(Resilient Distributed Dataset) and how to install the
setup. How to work with Scala and Python programming in Apache Spark,
then finally, learn how to run the jobs in both Scala and Python shell.
Apache Spark Tutorials
Apache Spark Tutorials is an excellent video tutorial by the Learning Journal. In
this tutorials, the instructor the explains the concepts the clearly and
concisely. The instructor starts with explaining how to set up the environment
of Apache Spark, then walks you through the quick introduction of Apache
Spark and it's ecosystem, why it is popular in the world of big data? he also
covers the architecture of the Apache spark and data frames, you will learn
about Spark related Jargons and the anatomy of Spark Application etc,.
Introduction to Spark & Scala | Apache Spark Tutorial for Beginners
This tutorial gives you a quick introduction to Apache Spark and in this
tutorial, the instructor discusses what is Bigdata and it's history, how to
Hadoop and Spark helps in data processing?then difference Hadoop and
spark? how the spark is handy for solving the real world problems, and what
are limitations of Hadoop map reduce?What is a need for spark and its
features, ecosystems, data flow of Spark, and data trends and much more? It
is worth to go through this tutorial.
Apache Spark and Scala Tutorial Videos
In this tutorial, you will find all the information required to get started with
Apache Spark and Scala programming language. Though the list is not
organized properly, the information available from each video is useful to
learn Apache Spark. Here you will video of Scala programming, Spark SQL,
Spark Hadoop tutorial, Spark Ecosystem, MapReduce vs Apache Spark,
Pyspark, interview questions and answers etc,. You need to organize the
content in structured instead of going through them randomly
Apache Spark Tutorial
Apache Spark tutorial series helps to get started with Apache Spark tutorial
and it covers the basic concepts of Apache Spark. Here, the instructor walks
you through setting up Apache spark on Ubuntu, then discussed the Spark
shell, Spark UI, SparkR setup, how to work with JSON data, Apache parquet,
and Apache spark, how to run a spark job on Standalone Cluster.
Conclusion
If you're interested in learning Apache Spark through book then you can check
out the below
Learning Spark: Lightning-Fast Big Data Analysis
Conclusion
From every video tutorial, you will learn something new, so I believe that the
more you explore, the more you learn
Keep Learning :)

Weitere ähnliche Inhalte

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 

Kürzlich hochgeladen (20)

Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 

Empfohlen

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 

Empfohlen (20)

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 

Top 10 best apache spark video tutorials | best bigdata tutorials

  • 1. Top 10 Best Apache Spark video tutorials
  • 2. Introduction As we already discussed that how every day a large amount data is generated in Hadoop video tutorials post and how Hadoop helps to process and manage the large sets of data. It is not possible for the machine to handle requests such CRUD operations on the dataset as the data is very huge. Hadoop solves problems ● HDFS - Distributed Storage (It offers files to be stored in different clusters) ● MapReduce - Computing Engine ● YARN - Resource Manager
  • 3. Introduction contd.. Though Hadoop solves real-world problems but it was efficient as there were many complexities with MapReduce. At the same time, Apache Spark was evolved that solved enhanced the efficiency of Hadoop. Why Apache Spark? Spark runs 100x faster than the Hadoop MapReduce, as Spark uses called DAG engine that optimizes the workflows. Many popular websites are using Apache Spark namely, Amazon, eBay, NASA JPL, Groupon, Tripadvisor, Yahoo and much more.
  • 4. Introduction contd.. Apache Spark gives the flexibility to write the code in Java, Scala, R and Python programming language. Out of all the programming languages, Scala works best and efficient to work with Apache Spark as it is written in Scala programming language.
  • 5. Introduction contd.. Different components of Apache Spark: ● Spark Core ● Spark Streaming ● Spark SQL ● MLLib ● Graphx
  • 7. Introduction contd.. There are many tutorials online but below are top 10 video tutorials to learn Apache Spark.
  • 8. Apache Spark 2.0 with Scala - Hands On with Big Data! This video tutorial is popular video tutorial over the web which provides you a basic overview of Apache Spark 2.0. You will understand how big data works and what "big data" really is and you will also learn about scala programming. This video tutorial is clear and focused with a very good balance between theoretical and practical concepts. The instructor begins with explaining how to set up the environment to get started with Apache Spark, how Spark will solve the real world problems. If you want to learn Spark using Java, you can go with Apache Spark with Java - Learn Spark from a Big Data Guru and if you want to learn spark with Python then go with Taming Big Data with Apache Spark and Python - Hands On
  • 9. Apache Spark - Scala This video tutorial is presented by itversity YouTube channel and this channel has collection of videos related to bid data technologies which includes Hadoop, Apache Spark, Hive, Pig, Sqoop, HBase, Cassandra, Mongo DB, ETL, Data Warehousing, Linux, Oracle, MySQL, Aster, Greenplum, Teradata, Goldengate and much more everything that is in the context of Big Data. Here, the instructor has released a series of video tutorial on Apache Spark- Scala. It is worth to go through this tutorials.
  • 10. Apache Spark with Scala - Learn Spark from a Big Data Guru This tutorial is another popular video tutorial to learn Apache Spark with Scala programming. In this video tutorial, you will about the architecture of the Apache Spark, how to develop the applications with Scala using RDD transformations and Spark SQL. Also, you will learn about the advanced techniques to improve Apache Spark jobs by partitioning, caching and persisting RDDs and how to share information between the different nodes across Apache Spark cluster by broadcast variables and accumulators etc,. and the best practices to follow. Though the concepts are complex to understand, the instructor managed to explain the code is very clear and in an easy style.
  • 11. Apache Spark 2.0 Novice to Expert Tutorial (Training) This tutorial is presented by the TalentOrigin and here, TalentOrigin you will find the tutorials on various topics related to BigData and Data analytics such as Hadoop, Spark, PySpark, Python, Hive, Impala, Oozie, Cloudera, Horton Works etc,. Here, in this Spark tutorial, you will learn the basic concepts of Apache Spark. The instructor starts with explaining the how to download and install Apache Spark. Then he explains about Spark Shell, RDD's, transformations, Spark project using IntelliJ Maven and SBT and also with Eclipse, Spark Dataframe, Creating a DataFrame with CSV file and working with datasets vs Data frames and much more. It is worth to go through this tutorial.
  • 12. Learn Apache Spark from Scratch for Beginners This tutorial is presented by Eduonix Learning Solutions and The course is divided into four sections. In the first section, you will learn about how different applications can be built using Apache Spark, Machine Learning, and Graph X, then different modes in runtime, then how to set up the HotronWorks VM, Scala API, then running Apache Spark. In the second section, you will learn how to build and run the spark applications using runtime modes. In the third section, you will learn how to build types of applications such as visualization, Machine Learning, Streaming, SQL application. you will also how to build the tools and spark(Maven and Gradle) and submitting the application to Spark Driver.
  • 13. Apache Spark By the end of this tutorial, you will be able to understand why Apache Spark is used and purpose of it, different components of Apache Spark unified stack, understanding the RDD(Resilient Distributed Dataset) and how to install the setup. How to work with Scala and Python programming in Apache Spark, then finally, learn how to run the jobs in both Scala and Python shell.
  • 14. Apache Spark Tutorials Apache Spark Tutorials is an excellent video tutorial by the Learning Journal. In this tutorials, the instructor the explains the concepts the clearly and concisely. The instructor starts with explaining how to set up the environment of Apache Spark, then walks you through the quick introduction of Apache Spark and it's ecosystem, why it is popular in the world of big data? he also covers the architecture of the Apache spark and data frames, you will learn about Spark related Jargons and the anatomy of Spark Application etc,.
  • 15. Introduction to Spark & Scala | Apache Spark Tutorial for Beginners This tutorial gives you a quick introduction to Apache Spark and in this tutorial, the instructor discusses what is Bigdata and it's history, how to Hadoop and Spark helps in data processing?then difference Hadoop and spark? how the spark is handy for solving the real world problems, and what are limitations of Hadoop map reduce?What is a need for spark and its features, ecosystems, data flow of Spark, and data trends and much more? It is worth to go through this tutorial.
  • 16. Apache Spark and Scala Tutorial Videos In this tutorial, you will find all the information required to get started with Apache Spark and Scala programming language. Though the list is not organized properly, the information available from each video is useful to learn Apache Spark. Here you will video of Scala programming, Spark SQL, Spark Hadoop tutorial, Spark Ecosystem, MapReduce vs Apache Spark, Pyspark, interview questions and answers etc,. You need to organize the content in structured instead of going through them randomly
  • 17. Apache Spark Tutorial Apache Spark tutorial series helps to get started with Apache Spark tutorial and it covers the basic concepts of Apache Spark. Here, the instructor walks you through setting up Apache spark on Ubuntu, then discussed the Spark shell, Spark UI, SparkR setup, how to work with JSON data, Apache parquet, and Apache spark, how to run a spark job on Standalone Cluster.
  • 18. Conclusion If you're interested in learning Apache Spark through book then you can check out the below Learning Spark: Lightning-Fast Big Data Analysis
  • 19. Conclusion From every video tutorial, you will learn something new, so I believe that the more you explore, the more you learn Keep Learning :)