SlideShare a Scribd company logo
1 of 257
Download to read offline
General Learning
Data Sciences | AI | Big Data Analytics
Tasks To Do
• Install SQL Server and communicate via some client
• Cloud Deployments
• Understand Linux Architecture and basic commands
• Understand IP Addressing
• Understand Hypervisor
• Understand protocols: DNS, DHCP, HTTP, SSL, TLS, HTTPS, FTP, SMTp
• Master Python & TENSORFLOW
• What are micro-services ? Vs API !
• HashiCorp’s TERRAFORM
• Study of bahria research groups https://bahria.edu.pk/oric/
Companies to work in future
• Ublox Lahore https://www.u-
blox.com/en/job-openings
• NETSOL
• TERESOL
• CONTOUR SOFTWARE
https://contour-
software.com/careers/#Jobs
• TERADATA
http://nicat.pk/
DS Tools and Requirement
Tool Requirement Tool Requirement Tool Requirement
KAFKA BIG Data Messaging TERRAFORM
Multi-Cloud
management through
code
TENSORFLOW
Low-level software library
created by google to implement
ML models and solve complex
numerical problems
HADOOP BIG Data online storage DOCKER KERAS
High Level Deep Learning API in
Python for easy implementation
and computation of neural
networks
APACHE
SPARC
BIG Data Stream
handling real-time
KUBERNETES PYTORCH
Low-Level API developed by
Facbeook for NLP and computer
vision. More powerful version of
numpy
TABELAU
DASHBOARDING TOOLS
LINUX
R/Python
HDFS,HIVE, YARN, MAPREDUCE
Data Scientists Jobs @ DUBAI
• data scientist job dubai (google.com)
• IMP: https://g.co/kgs/AEjBMy
Data Science jobs @ Glassdoor
Data Science jobs @ Glassdoor
TOP COMPANIES WORKING IN DATA SCIENCE
IN DUBAI
Eurasian
Resources Group -
ERG
Cobblestone Kognitiv
Corporation
Careem First Abu Dhabi
Bank
VISA
DATABUZZ LTD Foodics nybl Constellation
Software, Inc.
The Emirates
Group
TRANSFERWISE
TMC Binance.US Careem Al Futtaim Agility
ARTEFACT MARS Landmark Group Amazon Middle
East and NA
UHRS
RAK BANK Millennium Plaza
Hotel Dubai
Standard
Chartered Bank
Affaan
Technologies
Siemens
DataRobot Arthur Lawrence Parsons
International
Manipal Academy
of Higher
Education, Dubai
GMG
WOW AI LLC APCO Worldwide Accenture BlackSky Swvl
Dataiku Emirates NBD Procter & Gamble Zayed University Mastercard
Linux – Shells vs Scripts
Traditional Programming vs. Machine Learning
Polyglot
• When you can use multiple languages in a software platform
Device to interconnect various LANS
Coaxial / Fiber
Optics
Data Center Standards / Compliances
https://www.youtube.com/watch?v=BzJvVBxSEOM
Source
https://www.youtube.com/watch?v=iyES7UwJfvw
excel
Cluster Computing / Programming
• A computer cluster is a set of computers that work together so that
they can be viewed as a single system. Unlike grid computers,
computer clusters have each node set to perform the same task,
controlled and scheduled by software
https://www.youtube.com/watch?v=8BBDxzJL6fY
In a cluster setup, we will bond the one ip to multiple servers. If one
server is down, other can respond.
High Performance Cluster
Processing / Computing requirement is either
- Too large
- Or it takes too long
On standard computers
If A task on ON-PREMISE 16 PC Cluster with 4 core processors
each ( = 64 processing nodes) takes 3 months .. then same task
can be done in just 16 hours on 125,000 cores on cloud at
same or no incremental cost ! >>> CLOUD Computing benefits
On-premisis
cluster
CLOUD BENEFITS
https://youtu.be/WXoIcjA5a9Y
https://www.youtube.com/watch?v=rvqCqK2Lpjg
https://www.youtube.com/watch?v=k7zu3NXEiGY
BATCH PROCESSING
DEDICATED SERVING LAYER
What is
actually
happening?
• Descriptive
Analysis
What will
happen
next?
• Predictive
Analysis
What to do
now?
• Prescriptive
Analysis
What was
the reason?
• Diagnostic
Analysis
(5) Top Big Data Technologies | Big Data Tools
Tutorial | Big Data Hadoop Training | Edureka -
YouTube
For predictive analysis
In-memory computing
capabilities for real-time
big data streams
SPARK VS HADOOP
https://www.youtube.com/watch?v=9mELEARcxJo
The most widely-used
engine for scalable
computing
Thousands of companies,
including 80% of the
Fortune 500, use Apache
Spark™.
Over 2,000 contributors to
the open source project
from industry and
academia.
HADOOP is batch processing only
But SPARK is real time processing also. !!
PySpark
https://www.youtube.com/watch?v=5dARTeE6OpU
WHAT IS KAFKA
A data pipeline messaging system
What is KAFKA – explained again
• A messaging system
• Simplifies management of data pipelines
• Retain messages even when there is issue in a pipeline due to
network issue
• Any sink of message system can subcribe to data pipeline
• Queue and public subscribe Model
(1) What is terraform in Hindi/Urdu | Lec-01 | Terraform
tutorial for beginners | Infrastructure as Code - YouTube
https://www.youtube.com/watch?v=4L86D_fU6sQ
⭐Why Data Science is important?
Data Science is taking over each and every industry domain.
Machine Learning and especially Deep Learning are the most
important aspects of Data Science that are being deployed
everywhere from search engines to online movie
recommendations. Taking the Intellipaat Data Science training
& Data Science Course can help professionals to build a solid
career in a rising technology domain and get the best jobs in
top organizations.
⭐Why Artificial Intelligence is important?
Artificial Intelligence is taking over each and every industry
domain. Machine Learning and especially Deep Learning are
the most important aspects of Artificial Intelligence that are
being deployed everywhere from search engines to online
movie recommendations. Taking the Intellipaat deep learning
training & Artificial Intelligence Course can help professionals
to build a solid career in a rising technology domain and get the
best jobs in top organizations.
(1) Data Science vs Artificial Intelligence | DS vs AI | Intellipaat - YouTube
What is spring boot ? – Microservices are executed using springboot
https://www.youtube.com/watch?v=j1gU2oGFayY
Other topics:
- REST API
- SPRING BOOT
=== Networking Fundamentals - Module 1 === Lesson 1 - Network
Devices
Part 1: https://youtu.be/bj-Yfakjllc
Part 2: https://youtu.be/H7-NR3Q3BeI
Lesson 2 - OSI Model
Part 1: https://youtu.be/LkolbURrtTs
Part 2: https://youtu.be/0aGqGKrRE0g
Lesson 3 - Everything Hosts to do speak on the Internet
Part 1: https://youtu.be/gYN2qN11-wE
Part 2: https://youtu.be/JI9Zm2tbUoE
Lesson 4 - Everything Switches do to facilitate communication
Part 1: https://youtu.be/AhOU2eOpmX0
Part 2: https://youtu.be/G7GyWjJtjNs
Lesson 5 - Everything Routers do to facilitate communication
Part 1: https://youtu.be/AzXys5kxpAM
Part 2: https://youtu.be/Ep-x_6kggKA
Part 3: https://youtu.be/zmxLg4jV0ts
Lesson 6 - Networking Protocols - https://youtu.be/E5bSumTAHZE -
ARP, FTP, SMTP, HTTP, SSL, TLS, HTTPS, DNS, DHCP - Four items
MUST be configured for Internet Connectivity
Lesson 7 - How Data moves through the Internet -
https://youtu.be/YJGGYKAV4pA - Interview question: What happens when
you type "site.com" into a web browser?
https://www.youtube.com/watch?v=E5bSumTAHZE
DHCP server provides
IP/SM,DG and DNS
settings as response to
the host
Host PC
Everything Routers do - Part 1 - Networking Fundamentals -
Lesson 5 - YouTube
Infact, internet is nothing more then jut
series of routers
General Learning Data Sciences, AI, Big Data Analytics & Tasks

More Related Content

Similar to General Learning Data Sciences, AI, Big Data Analytics & Tasks

Tiny Batches, in the wine: Shiny New Bits in Spark Streaming
Tiny Batches, in the wine: Shiny New Bits in Spark StreamingTiny Batches, in the wine: Shiny New Bits in Spark Streaming
Tiny Batches, in the wine: Shiny New Bits in Spark StreamingPaco Nathan
 
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31Timothy Spann
 
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchPivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchEMC
 
Python the lingua franca of FEWS
Python the lingua franca of FEWSPython the lingua franca of FEWS
Python the lingua franca of FEWSLindsay Millard
 
OpenStack Preso: DevOps on Hybrid Infrastructure
OpenStack Preso: DevOps on Hybrid InfrastructureOpenStack Preso: DevOps on Hybrid Infrastructure
OpenStack Preso: DevOps on Hybrid Infrastructurerhirschfeld
 
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructuredevopsdaysaustin
 
Austin,TX Meetup presentation tensorflow final oct 26 2017
Austin,TX Meetup presentation tensorflow final oct 26 2017Austin,TX Meetup presentation tensorflow final oct 26 2017
Austin,TX Meetup presentation tensorflow final oct 26 2017Clarisse Hedglin
 
OpenStack + Cloud Foundry for the OpenStack Boston Meetup
OpenStack + Cloud Foundry for the OpenStack Boston MeetupOpenStack + Cloud Foundry for the OpenStack Boston Meetup
OpenStack + Cloud Foundry for the OpenStack Boston Meetupragss
 
IBM: The Linux Ecosystem
IBM: The Linux EcosystemIBM: The Linux Ecosystem
IBM: The Linux EcosystemKangaroot
 
Session 8 - Creating Data Processing Services | Train the Trainers Program
Session 8 - Creating Data Processing Services | Train the Trainers ProgramSession 8 - Creating Data Processing Services | Train the Trainers Program
Session 8 - Creating Data Processing Services | Train the Trainers ProgramFIWARE
 
GPU and Deep learning best practices
GPU and Deep learning best practicesGPU and Deep learning best practices
GPU and Deep learning best practicesLior Sidi
 
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
TensorFlow meetup: Keras - Pytorch - TensorFlow.jsTensorFlow meetup: Keras - Pytorch - TensorFlow.js
TensorFlow meetup: Keras - Pytorch - TensorFlow.jsStijn Decubber
 
Implementing AI: High Performace Architectures
Implementing AI: High Performace ArchitecturesImplementing AI: High Performace Architectures
Implementing AI: High Performace ArchitecturesKTN
 
Spring and Pivotal Application Service - SpringOne Tour - Boston
Spring and Pivotal Application Service - SpringOne Tour - BostonSpring and Pivotal Application Service - SpringOne Tour - Boston
Spring and Pivotal Application Service - SpringOne Tour - BostonVMware Tanzu
 
Part 2: A Visual Dive into Machine Learning and Deep Learning 

Part 2: A Visual Dive into Machine Learning and Deep Learning 
Part 2: A Visual Dive into Machine Learning and Deep Learning 

Part 2: A Visual Dive into Machine Learning and Deep Learning 
Cloudera, Inc.
 
Machine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlowMachine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlowAditya Bhattacharya
 
Cytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsCytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsKeiichiro Ono
 
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...OCCIware
 
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...OW2
 
EMC Big Data Solutions Overview
EMC Big Data Solutions OverviewEMC Big Data Solutions Overview
EMC Big Data Solutions Overviewwalshe1
 

Similar to General Learning Data Sciences, AI, Big Data Analytics & Tasks (20)

Tiny Batches, in the wine: Shiny New Bits in Spark Streaming
Tiny Batches, in the wine: Shiny New Bits in Spark StreamingTiny Batches, in the wine: Shiny New Bits in Spark Streaming
Tiny Batches, in the wine: Shiny New Bits in Spark Streaming
 
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31
Apache Deep Learning 101 - ApacheCon Montreal 2018 v0.31
 
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchPivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
 
Python the lingua franca of FEWS
Python the lingua franca of FEWSPython the lingua franca of FEWS
Python the lingua franca of FEWS
 
OpenStack Preso: DevOps on Hybrid Infrastructure
OpenStack Preso: DevOps on Hybrid InfrastructureOpenStack Preso: DevOps on Hybrid Infrastructure
OpenStack Preso: DevOps on Hybrid Infrastructure
 
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
 
Austin,TX Meetup presentation tensorflow final oct 26 2017
Austin,TX Meetup presentation tensorflow final oct 26 2017Austin,TX Meetup presentation tensorflow final oct 26 2017
Austin,TX Meetup presentation tensorflow final oct 26 2017
 
OpenStack + Cloud Foundry for the OpenStack Boston Meetup
OpenStack + Cloud Foundry for the OpenStack Boston MeetupOpenStack + Cloud Foundry for the OpenStack Boston Meetup
OpenStack + Cloud Foundry for the OpenStack Boston Meetup
 
IBM: The Linux Ecosystem
IBM: The Linux EcosystemIBM: The Linux Ecosystem
IBM: The Linux Ecosystem
 
Session 8 - Creating Data Processing Services | Train the Trainers Program
Session 8 - Creating Data Processing Services | Train the Trainers ProgramSession 8 - Creating Data Processing Services | Train the Trainers Program
Session 8 - Creating Data Processing Services | Train the Trainers Program
 
GPU and Deep learning best practices
GPU and Deep learning best practicesGPU and Deep learning best practices
GPU and Deep learning best practices
 
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
TensorFlow meetup: Keras - Pytorch - TensorFlow.jsTensorFlow meetup: Keras - Pytorch - TensorFlow.js
TensorFlow meetup: Keras - Pytorch - TensorFlow.js
 
Implementing AI: High Performace Architectures
Implementing AI: High Performace ArchitecturesImplementing AI: High Performace Architectures
Implementing AI: High Performace Architectures
 
Spring and Pivotal Application Service - SpringOne Tour - Boston
Spring and Pivotal Application Service - SpringOne Tour - BostonSpring and Pivotal Application Service - SpringOne Tour - Boston
Spring and Pivotal Application Service - SpringOne Tour - Boston
 
Part 2: A Visual Dive into Machine Learning and Deep Learning 

Part 2: A Visual Dive into Machine Learning and Deep Learning 
Part 2: A Visual Dive into Machine Learning and Deep Learning 

Part 2: A Visual Dive into Machine Learning and Deep Learning 

 
Machine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlowMachine learning and Deep learning on edge devices using TensorFlow
Machine learning and Deep learning on edge devices using TensorFlow
 
Cytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis ToolsCytoscape and External Data Analysis Tools
Cytoscape and External Data Analysis Tools
 
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...
 
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...
 
EMC Big Data Solutions Overview
EMC Big Data Solutions OverviewEMC Big Data Solutions Overview
EMC Big Data Solutions Overview
 

Recently uploaded

OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full Recording
OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full RecordingOpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full Recording
OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full RecordingShane Coughlan
 
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingOpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingShane Coughlan
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesVictoriaMetrics
 
2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shardsChristopher Curtin
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZABSYZ Inc
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogueitservices996
 
Understanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM ArchitectureUnderstanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM Architecturerahul_net
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorTier1 app
 
Introduction to Firebase Workshop Slides
Introduction to Firebase Workshop SlidesIntroduction to Firebase Workshop Slides
Introduction to Firebase Workshop Slidesvaideheekore1
 
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...OnePlan Solutions
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxRTS corp
 
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jNeo4j
 
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...OnePlan Solutions
 
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesAmazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesKrzysztofKkol1
 
Best Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITBest Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITmanoharjgpsolutions
 
Osi security architecture in network.pptx
Osi security architecture in network.pptxOsi security architecture in network.pptx
Osi security architecture in network.pptxVinzoCenzo
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsChristian Birchler
 
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxReal-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxRTS corp
 
eSoftTools IMAP Backup Software and migration tools
eSoftTools IMAP Backup Software and migration toolseSoftTools IMAP Backup Software and migration tools
eSoftTools IMAP Backup Software and migration toolsosttopstonverter
 
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...Bert Jan Schrijver
 

Recently uploaded (20)

OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full Recording
OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full RecordingOpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full Recording
OpenChain Education Work Group Monthly Meeting - 2024-04-10 - Full Recording
 
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingOpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 Updates
 
2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZ
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogue
 
Understanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM ArchitectureUnderstanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM Architecture
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryError
 
Introduction to Firebase Workshop Slides
Introduction to Firebase Workshop SlidesIntroduction to Firebase Workshop Slides
Introduction to Firebase Workshop Slides
 
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
 
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
 
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...
Tech Tuesday Slides - Introduction to Project Management with OnePlan's Work ...
 
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesAmazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
 
Best Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITBest Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh IT
 
Osi security architecture in network.pptx
Osi security architecture in network.pptxOsi security architecture in network.pptx
Osi security architecture in network.pptx
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
 
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxReal-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
 
eSoftTools IMAP Backup Software and migration tools
eSoftTools IMAP Backup Software and migration toolseSoftTools IMAP Backup Software and migration tools
eSoftTools IMAP Backup Software and migration tools
 
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
JavaLand 2024 - Going serverless with Quarkus GraalVM native images and AWS L...
 

General Learning Data Sciences, AI, Big Data Analytics & Tasks

  • 1. General Learning Data Sciences | AI | Big Data Analytics
  • 2. Tasks To Do • Install SQL Server and communicate via some client • Cloud Deployments • Understand Linux Architecture and basic commands • Understand IP Addressing • Understand Hypervisor • Understand protocols: DNS, DHCP, HTTP, SSL, TLS, HTTPS, FTP, SMTp • Master Python & TENSORFLOW • What are micro-services ? Vs API ! • HashiCorp’s TERRAFORM • Study of bahria research groups https://bahria.edu.pk/oric/
  • 3. Companies to work in future • Ublox Lahore https://www.u- blox.com/en/job-openings • NETSOL • TERESOL • CONTOUR SOFTWARE https://contour- software.com/careers/#Jobs • TERADATA http://nicat.pk/
  • 4. DS Tools and Requirement Tool Requirement Tool Requirement Tool Requirement KAFKA BIG Data Messaging TERRAFORM Multi-Cloud management through code TENSORFLOW Low-level software library created by google to implement ML models and solve complex numerical problems HADOOP BIG Data online storage DOCKER KERAS High Level Deep Learning API in Python for easy implementation and computation of neural networks APACHE SPARC BIG Data Stream handling real-time KUBERNETES PYTORCH Low-Level API developed by Facbeook for NLP and computer vision. More powerful version of numpy TABELAU
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 14.
  • 15. Data Scientists Jobs @ DUBAI • data scientist job dubai (google.com) • IMP: https://g.co/kgs/AEjBMy
  • 16. Data Science jobs @ Glassdoor
  • 17. Data Science jobs @ Glassdoor
  • 18. TOP COMPANIES WORKING IN DATA SCIENCE IN DUBAI Eurasian Resources Group - ERG Cobblestone Kognitiv Corporation Careem First Abu Dhabi Bank VISA DATABUZZ LTD Foodics nybl Constellation Software, Inc. The Emirates Group TRANSFERWISE TMC Binance.US Careem Al Futtaim Agility ARTEFACT MARS Landmark Group Amazon Middle East and NA UHRS RAK BANK Millennium Plaza Hotel Dubai Standard Chartered Bank Affaan Technologies Siemens DataRobot Arthur Lawrence Parsons International Manipal Academy of Higher Education, Dubai GMG WOW AI LLC APCO Worldwide Accenture BlackSky Swvl Dataiku Emirates NBD Procter & Gamble Zayed University Mastercard
  • 19.
  • 20. Linux – Shells vs Scripts
  • 21.
  • 22. Traditional Programming vs. Machine Learning
  • 23. Polyglot • When you can use multiple languages in a software platform
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34. Device to interconnect various LANS
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.
  • 49.
  • 50. Data Center Standards / Compliances
  • 52.
  • 53.
  • 54.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61. excel
  • 62.
  • 63.
  • 64.
  • 65.
  • 66.
  • 67.
  • 68.
  • 69.
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.
  • 75.
  • 76.
  • 77. Cluster Computing / Programming • A computer cluster is a set of computers that work together so that they can be viewed as a single system. Unlike grid computers, computer clusters have each node set to perform the same task, controlled and scheduled by software
  • 78.
  • 79.
  • 80. https://www.youtube.com/watch?v=8BBDxzJL6fY In a cluster setup, we will bond the one ip to multiple servers. If one server is down, other can respond.
  • 81.
  • 82.
  • 84.
  • 85. Processing / Computing requirement is either - Too large - Or it takes too long On standard computers
  • 86. If A task on ON-PREMISE 16 PC Cluster with 4 core processors each ( = 64 processing nodes) takes 3 months .. then same task can be done in just 16 hours on 125,000 cores on cloud at same or no incremental cost ! >>> CLOUD Computing benefits On-premisis cluster
  • 88.
  • 90.
  • 91.
  • 92.
  • 93.
  • 94.
  • 95.
  • 98.
  • 99.
  • 100.
  • 101.
  • 102.
  • 103.
  • 104. What is actually happening? • Descriptive Analysis What will happen next? • Predictive Analysis What to do now? • Prescriptive Analysis What was the reason? • Diagnostic Analysis
  • 105.
  • 106.
  • 107.
  • 108.
  • 109.
  • 110.
  • 111.
  • 112.
  • 113.
  • 114.
  • 115.
  • 116. (5) Top Big Data Technologies | Big Data Tools Tutorial | Big Data Hadoop Training | Edureka - YouTube
  • 117.
  • 118.
  • 119.
  • 120.
  • 121.
  • 122.
  • 123.
  • 124.
  • 125.
  • 127.
  • 128.
  • 129.
  • 130.
  • 131. In-memory computing capabilities for real-time big data streams
  • 132.
  • 133.
  • 134.
  • 135.
  • 136.
  • 137.
  • 138.
  • 139.
  • 140.
  • 141.
  • 143.
  • 144.
  • 145.
  • 146. The most widely-used engine for scalable computing Thousands of companies, including 80% of the Fortune 500, use Apache Spark™. Over 2,000 contributors to the open source project from industry and academia.
  • 147.
  • 148.
  • 149.
  • 150.
  • 151.
  • 152.
  • 153.
  • 154.
  • 155.
  • 156. HADOOP is batch processing only But SPARK is real time processing also. !!
  • 157.
  • 158.
  • 159.
  • 160.
  • 161.
  • 162.
  • 163.
  • 164.
  • 165.
  • 166.
  • 167.
  • 168.
  • 169.
  • 170.
  • 171.
  • 173.
  • 174.
  • 175.
  • 176.
  • 177.
  • 178.
  • 179. WHAT IS KAFKA A data pipeline messaging system
  • 180.
  • 181.
  • 182.
  • 183.
  • 184.
  • 185.
  • 186. What is KAFKA – explained again • A messaging system • Simplifies management of data pipelines • Retain messages even when there is issue in a pipeline due to network issue • Any sink of message system can subcribe to data pipeline • Queue and public subscribe Model
  • 187.
  • 188.
  • 189.
  • 190.
  • 191.
  • 192.
  • 193.
  • 194.
  • 195.
  • 196.
  • 197.
  • 198.
  • 199.
  • 200.
  • 201.
  • 202.
  • 203. (1) What is terraform in Hindi/Urdu | Lec-01 | Terraform tutorial for beginners | Infrastructure as Code - YouTube
  • 204.
  • 205.
  • 206.
  • 207.
  • 208.
  • 209.
  • 210.
  • 211.
  • 212.
  • 213.
  • 214.
  • 216. ⭐Why Data Science is important? Data Science is taking over each and every industry domain. Machine Learning and especially Deep Learning are the most important aspects of Data Science that are being deployed everywhere from search engines to online movie recommendations. Taking the Intellipaat Data Science training & Data Science Course can help professionals to build a solid career in a rising technology domain and get the best jobs in top organizations. ⭐Why Artificial Intelligence is important? Artificial Intelligence is taking over each and every industry domain. Machine Learning and especially Deep Learning are the most important aspects of Artificial Intelligence that are being deployed everywhere from search engines to online movie recommendations. Taking the Intellipaat deep learning training & Artificial Intelligence Course can help professionals to build a solid career in a rising technology domain and get the best jobs in top organizations.
  • 217. (1) Data Science vs Artificial Intelligence | DS vs AI | Intellipaat - YouTube
  • 218.
  • 219.
  • 220.
  • 221.
  • 222.
  • 223.
  • 224.
  • 225.
  • 226.
  • 227.
  • 228.
  • 229.
  • 230.
  • 231.
  • 232.
  • 233.
  • 234.
  • 235.
  • 236.
  • 237.
  • 238.
  • 239.
  • 240. What is spring boot ? – Microservices are executed using springboot
  • 241.
  • 242.
  • 243.
  • 245. === Networking Fundamentals - Module 1 === Lesson 1 - Network Devices Part 1: https://youtu.be/bj-Yfakjllc Part 2: https://youtu.be/H7-NR3Q3BeI Lesson 2 - OSI Model Part 1: https://youtu.be/LkolbURrtTs Part 2: https://youtu.be/0aGqGKrRE0g Lesson 3 - Everything Hosts to do speak on the Internet Part 1: https://youtu.be/gYN2qN11-wE Part 2: https://youtu.be/JI9Zm2tbUoE Lesson 4 - Everything Switches do to facilitate communication Part 1: https://youtu.be/AhOU2eOpmX0 Part 2: https://youtu.be/G7GyWjJtjNs Lesson 5 - Everything Routers do to facilitate communication Part 1: https://youtu.be/AzXys5kxpAM Part 2: https://youtu.be/Ep-x_6kggKA Part 3: https://youtu.be/zmxLg4jV0ts Lesson 6 - Networking Protocols - https://youtu.be/E5bSumTAHZE - ARP, FTP, SMTP, HTTP, SSL, TLS, HTTPS, DNS, DHCP - Four items MUST be configured for Internet Connectivity Lesson 7 - How Data moves through the Internet - https://youtu.be/YJGGYKAV4pA - Interview question: What happens when you type "site.com" into a web browser?
  • 247.
  • 248.
  • 249. DHCP server provides IP/SM,DG and DNS settings as response to the host Host PC
  • 250.
  • 251.
  • 252. Everything Routers do - Part 1 - Networking Fundamentals - Lesson 5 - YouTube
  • 253.
  • 254.
  • 255.
  • 256. Infact, internet is nothing more then jut series of routers