SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Empowering Data
Scientists with
Geospatial data at Scale
How to Make Complex Spatial
Processing Simple
Lamont Norman | Product Manager
Housekeeping
Webinar Audio
• Today’s webinar audio is streamed through your computer
speakers
• If you need technical assistance with the web interface or audio,
please refresh your browser window – Chrome is recommended
Questions Welcome
• Submit your questions at any time during the presentation using
the Q&A box
Recording and slides
• This webinar is being recorded. You will receive an email following
the webinar with a link to the recording and slides
Webinar goals
Spatial processing
Reduce LI
processing < 90%
Data science, AI, & ML
Reduce LI data
munging &
wrangling for Data
Scientists <80%
Simplify Spatial Data
• Using catchments
• 4 geo-enrichment
keys
• IDs & data design
• Demo
The value of human
mobility
Using human mobility dramatically
improves understanding of customer
behavior
How many driving minutes away are
your customers from the fire station,
urgent care center, coffee shop, and
gym?
Data science success?
• “July 2019: VentureBeat AI reports:
87% of data science projects never make it into production.
• Jan 2019: NewVantage survey reports:
77% of businesses report that "business adoption" of big data and AI initiatives
continues to represent a big challenge for business.
That means 3/4 of the software being built is apparently collecting dust.
(Ouch.)
• Jan 2019: Gartner says:
80% of analytics insights will not deliver business outcomes through 2022 and
80% of AI projects will “remain alchemy, run by wizards” through 2020.”
Brian T. O'Neill July 23, 2019 designingforanalytics.com
Location intelligence help
• Quickly ingest curated location
information to enrich millions of
customer records
• Automate how to value
location intelligence
information (what’s good vs
what’s not)
• Access valuable location
information for hundreds of
millions of customers with Big
Data and Cloud Native
technology
• Know the keys to big data
geo-enrichment
• How to use the quality
indicators provided in
metadata
• Create a successful
geo-location data integration
strategy for the best data
science value
• Increase the success of your
data science projects while
minimizing costs
• Operational
• Inserts location data
into automated
workflows
• Begins with
geocoded addresses
or positions
(latitude/longitude)
• Enrich the input data
with spatial
information related to
the location
• Helps production use
map analytics and
enables automation
Geo-enrichment
provides
business insight
Four geo-enrichment keys
Where?
Forward geocoding
Latitude/Longitude
Location ID
What’s nearby?
Points
Lines
Areas
What can be learned?
Attributes
Distances
Calculations
Comparisons
What Decisions?
Too risky?
How much?
Model input
AI & ML
Location
Determination
Feature
Selection Business InsightData Extraction
Products in the four geo-enrichment keys
• Spectrum
Geocoding for
Big Data
• PreciselyID
• *Geohash
• Spectrum Location
Intelligence for Big Data
• Spectrum Routing for Big
Data
• **Geohash
• Property valuation
• Insurance underwriting
• Network availability
• All products
Location
Determination
Feature
Selection Business InsightData Extraction
*Geohash from Spectrum Geocoding for Big Data planned for Q1 2021
**Geohash available in Location Intelligence for Big Data
Feature
selection
• Points
• Lines
• Areas
Point in polygon
Choose geographic
features near
defined locations
• Administrative boundaries
• Neighborhoods
• Service areas
• Drivetime
• Drive-distance
Distance selection
• Edge of area
• Linear features
• Points of interest
Location ID
Join geospatial data by:
• PreciselyID
• Geohash
Data Extraction
Extract information
from selected
features
Calculate & Measure
• Distance to high wildfire
risk area
• Count gas stations
within a 10-minute drive
Attributes
• County name
• Flood zone type
• POI business types
Combine & Compare
• In flood zone &
elevation change
• RF signal & POI
Pre-build pattern
Pre-build geo-enriched data (batch)
• Customer data
• Business data
• GIS/Map data
• Address lists
• Mobile trace
• Model data
• Four geo-enrichment keys
• Location ID key-value joins
• PreciselyID
• Geohash
Data lake or other data store
• Spatial join organized by a
location ID:
• PreciselyID
• Geohash
• Using LI and business data
• Customer data
• Third party data
• Transportation data
• Boundary data
• Points of Interest data
• Mobile trace data
Pre-build view
Street
Network
Admin
Boundaries
Mobile
Trace
Points of
Interest
Sales History
Demographics
Parcel
Boundaries
Building
Footprints
School Districts
Modeled Data
Customer
Addresses
Crime
Transactional pattern
Request based querying of the data (real-time)
Requests with
• Policy Addresses
• Lat/Long values
• Key-value assignment
• PreciselyID
• Geohash
• 10x performance using
pre-build
Data lake or data storageIs this address:
• Good for a MDU loan?
• In the tornado path?
• Impacted by > 1” hail?
• Able to use fixed wireless?
Geocoding
• Address level decisions
• Standardized customer
locations
• Duplicates
• Missing information
• Quality
• Spatial information from
location IDs
• Group by administrative,
demographic, and market
areas
Geo-enrichment
from geocoding
Parsed
Address
Latitude/L
ongitude
Address
Identifiers
Genealogy
PreciselyID
Address
Validation
Location
Quality
Street
Address
Range
Demographics
IDs
Geohash ID
Standardized
Address
Administrative
Boundaries IDs
• Determine property fire protection
risk
• Join by Geohash or PreciselyID
• Fire stations
• Street networks
• Municipal boundaries
• Township boundaries
• National address location list
• Drivetime boundaries
• Drive distance boundaries
• Traffic load information
• More flexibility for better risk
estimates that give better insurer
profitability
Fire risk
Fire
Stations
5-Minute Drive
Distance
10-Minute
Drive
Distance
AM Peak
Drivetimes
20-Minute
Drive
Distance
County
Boundaries
National
Address
List
Township
Boundaries
City
Boundaries
Off Peak
Drivetimes
Street
Network
PM Peak
Drivetimes
• Property valuations by considering
neighborhood factors by human
mobility
• Join by Geohash or PreciselyID
• Residential locations
• Business locations
• Population concentration
• Consumer behavior
• Administrative boundaries
• Drivetime boundaries
• Drive distance boundaries
• Human mobility provides detailed
tenant behavior tendencies for
better occupancy predictions
Mortgage value Single
Family
Homes Business
Locations
5-Mile Drive
Distance
10-Mile
Drive
Distance
Geo-Fences
County
Boundaries
Neighborhood
Boundaries
City
Boundaries
ZIP Code
Boundaries
Demographics
Multi-dwelling
Units
Geo-
Demographics
• Customer behavior data
correlated to mobile trace
• Join by Geohash or PreciselyID
• Mobile trace data sources
• Consumer home locations
• Business locations
• Consumer behavior
• Administrative boundaries
• Drivetime boundaries
• Drive distance boundaries
• Tying complex spatial data such as
mobile trace history, drive distance, and
drivetime creates an informed customer
profile which leads to better decisions
Human mobility Single
Family
Homes Business
Locations
5-Mile Drive
Distance
10-Mile
Drive
Distance
Mobile
Trace
Admin
Boundaries
Demographics
Subscriber
History
Drivetime
Boundaries
20-Mile Drive
Distance
Multi-dwelling
Units
Geo-
Demographics
Kubernetes demo
Code samples
Lorum ipsum
• Lorem ipsum dolor sit
amet, cons ecte tu
radipiscing
• radipiscing elit, sed do
eiusmo det tempor
cons ecte
• incididunt ut labore et
dolore radipiscing
• Lorem ipsum dolor sit
amet, cons ecte
turadipiscing elit, sed
do eiusmo det tempor
• radipiscing elit, sed do
eiusmo det tempor
ecte tu radipiscing
Example code &
configurations
• GitHub
• Spark
• Docker
• Kubernetes
Big data samples
• Point in polygon
• Find nearest
• Aggregating with
geohash
• Multi-pass
geocoding
Cloud native
samples
• Forward geocoding
• Reverse geocoding
• Auto complete
• PreciselyID and
G-NAF look up
Empowering Data Scientists to Utilize Geospatial
Data at Scale Webinar Series
Topic 1 Topic 2 Topic 3
register now!View on-demand Today
Q&A
Kubernetes Demo:
Contact Lamont Norman at
Lamont.Norman@precisely.com
Thank you

Weitere ähnliche Inhalte

Ähnlich wie How to Make Complex Spatial Processing Simple

Power Decision-making at Scale with Address-based Spatial Data Science
Power Decision-making at Scale with Address-based Spatial Data SciencePower Decision-making at Scale with Address-based Spatial Data Science
Power Decision-making at Scale with Address-based Spatial Data Science
Precisely
 
Tmw20101 hayden.j and spaar
Tmw20101 hayden.j and spaarTmw20101 hayden.j and spaar
Tmw20101 hayden.j and spaar
navaidkhan
 

Ähnlich wie How to Make Complex Spatial Processing Simple (20)

Solving Volume, Velocity, and Variety Challenges with Location
Solving Volume, Velocity, and Variety Challenges with LocationSolving Volume, Velocity, and Variety Challenges with Location
Solving Volume, Velocity, and Variety Challenges with Location
 
Empowering Data Scientists to Utilize Geospatial Data at Scale – Why “Where” ...
Empowering Data Scientists to Utilize Geospatial Data at Scale – Why “Where” ...Empowering Data Scientists to Utilize Geospatial Data at Scale – Why “Where” ...
Empowering Data Scientists to Utilize Geospatial Data at Scale – Why “Where” ...
 
Learn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
Learn How to Turbocharge Your AI/ML Data Workflows with Data EnrichmentLearn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
Learn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
 
Power Decision-making at Scale with Address-based Spatial Data Science
Power Decision-making at Scale with Address-based Spatial Data SciencePower Decision-making at Scale with Address-based Spatial Data Science
Power Decision-making at Scale with Address-based Spatial Data Science
 
ADV Slides: Increasing Artificial Intelligence Success with Master Data Manag...
ADV Slides: Increasing Artificial Intelligence Success with Master Data Manag...ADV Slides: Increasing Artificial Intelligence Success with Master Data Manag...
ADV Slides: Increasing Artificial Intelligence Success with Master Data Manag...
 
Data Enrichment in MapInfo Pro
Data Enrichment in MapInfo ProData Enrichment in MapInfo Pro
Data Enrichment in MapInfo Pro
 
Unlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data IntegrityUnlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data Integrity
 
Improve site selection and network planning with Dynamic Demographics
Improve site selection and network planning with Dynamic DemographicsImprove site selection and network planning with Dynamic Demographics
Improve site selection and network planning with Dynamic Demographics
 
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
 
Korem's Corporate presentation
Korem's Corporate presentationKorem's Corporate presentation
Korem's Corporate presentation
 
Efficiently Incorporating Data Enrichment into Business Operations for More I...
Efficiently Incorporating Data Enrichment into Business Operations for More I...Efficiently Incorporating Data Enrichment into Business Operations for More I...
Efficiently Incorporating Data Enrichment into Business Operations for More I...
 
Keeping the Pulse of Your Data:  Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data:  Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data:  Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data:  Why You Need Data Observability to Improve D...
 
Learn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
Learn How to Turbocharge Your AI/ML Data Workflows with Data EnrichmentLearn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
Learn How to Turbocharge Your AI/ML Data Workflows with Data Enrichment
 
Understanding the Data Behind Programmatic
Understanding the Data Behind ProgrammaticUnderstanding the Data Behind Programmatic
Understanding the Data Behind Programmatic
 
How a Logical Data Fabric Enhances the Customer 360 View
How a Logical Data Fabric Enhances the Customer 360 ViewHow a Logical Data Fabric Enhances the Customer 360 View
How a Logical Data Fabric Enhances the Customer 360 View
 
Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017
 
Tmw20101 hayden.j and spaar
Tmw20101 hayden.j and spaarTmw20101 hayden.j and spaar
Tmw20101 hayden.j and spaar
 
Dista Insight Feature Overview.pdf
Dista Insight Feature Overview.pdfDista Insight Feature Overview.pdf
Dista Insight Feature Overview.pdf
 
Gis as a service
Gis as a serviceGis as a service
Gis as a service
 
Network and IT Ops Series: Build Production Solutions
Network and IT Ops Series: Build Production Solutions Network and IT Ops Series: Build Production Solutions
Network and IT Ops Series: Build Production Solutions
 

Mehr von Precisely

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
Precisely
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Precisely
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Precisely
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Precisely
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
Precisely
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
Precisely
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
Precisely
 

Mehr von Precisely (20)

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Crucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdfCrucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdf
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
 
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
 
Data Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity TrendsData Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity Trends
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Optimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAPOptimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAP
 
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige InvestitionenSAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
 
Automatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIsAutomatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIs
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
 
Effective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to KnowEffective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to Know
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
 
5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management
 
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter TomorrowUnlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
 
Navigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar DeckNavigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar Deck
 

Kürzlich hochgeladen

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 

How to Make Complex Spatial Processing Simple

  • 1. Empowering Data Scientists with Geospatial data at Scale How to Make Complex Spatial Processing Simple Lamont Norman | Product Manager
  • 2. Housekeeping Webinar Audio • Today’s webinar audio is streamed through your computer speakers • If you need technical assistance with the web interface or audio, please refresh your browser window – Chrome is recommended Questions Welcome • Submit your questions at any time during the presentation using the Q&A box Recording and slides • This webinar is being recorded. You will receive an email following the webinar with a link to the recording and slides
  • 3. Webinar goals Spatial processing Reduce LI processing < 90% Data science, AI, & ML Reduce LI data munging & wrangling for Data Scientists <80% Simplify Spatial Data • Using catchments • 4 geo-enrichment keys • IDs & data design • Demo
  • 4. The value of human mobility Using human mobility dramatically improves understanding of customer behavior How many driving minutes away are your customers from the fire station, urgent care center, coffee shop, and gym?
  • 5. Data science success? • “July 2019: VentureBeat AI reports: 87% of data science projects never make it into production. • Jan 2019: NewVantage survey reports: 77% of businesses report that "business adoption" of big data and AI initiatives continues to represent a big challenge for business. That means 3/4 of the software being built is apparently collecting dust. (Ouch.) • Jan 2019: Gartner says: 80% of analytics insights will not deliver business outcomes through 2022 and 80% of AI projects will “remain alchemy, run by wizards” through 2020.” Brian T. O'Neill July 23, 2019 designingforanalytics.com
  • 6. Location intelligence help • Quickly ingest curated location information to enrich millions of customer records • Automate how to value location intelligence information (what’s good vs what’s not) • Access valuable location information for hundreds of millions of customers with Big Data and Cloud Native technology • Know the keys to big data geo-enrichment • How to use the quality indicators provided in metadata • Create a successful geo-location data integration strategy for the best data science value • Increase the success of your data science projects while minimizing costs
  • 7. • Operational • Inserts location data into automated workflows • Begins with geocoded addresses or positions (latitude/longitude) • Enrich the input data with spatial information related to the location • Helps production use map analytics and enables automation Geo-enrichment provides business insight
  • 8. Four geo-enrichment keys Where? Forward geocoding Latitude/Longitude Location ID What’s nearby? Points Lines Areas What can be learned? Attributes Distances Calculations Comparisons What Decisions? Too risky? How much? Model input AI & ML Location Determination Feature Selection Business InsightData Extraction
  • 9. Products in the four geo-enrichment keys • Spectrum Geocoding for Big Data • PreciselyID • *Geohash • Spectrum Location Intelligence for Big Data • Spectrum Routing for Big Data • **Geohash • Property valuation • Insurance underwriting • Network availability • All products Location Determination Feature Selection Business InsightData Extraction *Geohash from Spectrum Geocoding for Big Data planned for Q1 2021 **Geohash available in Location Intelligence for Big Data
  • 10. Feature selection • Points • Lines • Areas Point in polygon Choose geographic features near defined locations • Administrative boundaries • Neighborhoods • Service areas • Drivetime • Drive-distance Distance selection • Edge of area • Linear features • Points of interest Location ID Join geospatial data by: • PreciselyID • Geohash
  • 11. Data Extraction Extract information from selected features Calculate & Measure • Distance to high wildfire risk area • Count gas stations within a 10-minute drive Attributes • County name • Flood zone type • POI business types Combine & Compare • In flood zone & elevation change • RF signal & POI
  • 12. Pre-build pattern Pre-build geo-enriched data (batch) • Customer data • Business data • GIS/Map data • Address lists • Mobile trace • Model data • Four geo-enrichment keys • Location ID key-value joins • PreciselyID • Geohash Data lake or other data store
  • 13. • Spatial join organized by a location ID: • PreciselyID • Geohash • Using LI and business data • Customer data • Third party data • Transportation data • Boundary data • Points of Interest data • Mobile trace data Pre-build view Street Network Admin Boundaries Mobile Trace Points of Interest Sales History Demographics Parcel Boundaries Building Footprints School Districts Modeled Data Customer Addresses Crime
  • 14. Transactional pattern Request based querying of the data (real-time) Requests with • Policy Addresses • Lat/Long values • Key-value assignment • PreciselyID • Geohash • 10x performance using pre-build Data lake or data storageIs this address: • Good for a MDU loan? • In the tornado path? • Impacted by > 1” hail? • Able to use fixed wireless? Geocoding
  • 15. • Address level decisions • Standardized customer locations • Duplicates • Missing information • Quality • Spatial information from location IDs • Group by administrative, demographic, and market areas Geo-enrichment from geocoding Parsed Address Latitude/L ongitude Address Identifiers Genealogy PreciselyID Address Validation Location Quality Street Address Range Demographics IDs Geohash ID Standardized Address Administrative Boundaries IDs
  • 16. • Determine property fire protection risk • Join by Geohash or PreciselyID • Fire stations • Street networks • Municipal boundaries • Township boundaries • National address location list • Drivetime boundaries • Drive distance boundaries • Traffic load information • More flexibility for better risk estimates that give better insurer profitability Fire risk Fire Stations 5-Minute Drive Distance 10-Minute Drive Distance AM Peak Drivetimes 20-Minute Drive Distance County Boundaries National Address List Township Boundaries City Boundaries Off Peak Drivetimes Street Network PM Peak Drivetimes
  • 17. • Property valuations by considering neighborhood factors by human mobility • Join by Geohash or PreciselyID • Residential locations • Business locations • Population concentration • Consumer behavior • Administrative boundaries • Drivetime boundaries • Drive distance boundaries • Human mobility provides detailed tenant behavior tendencies for better occupancy predictions Mortgage value Single Family Homes Business Locations 5-Mile Drive Distance 10-Mile Drive Distance Geo-Fences County Boundaries Neighborhood Boundaries City Boundaries ZIP Code Boundaries Demographics Multi-dwelling Units Geo- Demographics
  • 18. • Customer behavior data correlated to mobile trace • Join by Geohash or PreciselyID • Mobile trace data sources • Consumer home locations • Business locations • Consumer behavior • Administrative boundaries • Drivetime boundaries • Drive distance boundaries • Tying complex spatial data such as mobile trace history, drive distance, and drivetime creates an informed customer profile which leads to better decisions Human mobility Single Family Homes Business Locations 5-Mile Drive Distance 10-Mile Drive Distance Mobile Trace Admin Boundaries Demographics Subscriber History Drivetime Boundaries 20-Mile Drive Distance Multi-dwelling Units Geo- Demographics
  • 20. Code samples Lorum ipsum • Lorem ipsum dolor sit amet, cons ecte tu radipiscing • radipiscing elit, sed do eiusmo det tempor cons ecte • incididunt ut labore et dolore radipiscing • Lorem ipsum dolor sit amet, cons ecte turadipiscing elit, sed do eiusmo det tempor • radipiscing elit, sed do eiusmo det tempor ecte tu radipiscing Example code & configurations • GitHub • Spark • Docker • Kubernetes Big data samples • Point in polygon • Find nearest • Aggregating with geohash • Multi-pass geocoding Cloud native samples • Forward geocoding • Reverse geocoding • Auto complete • PreciselyID and G-NAF look up
  • 21. Empowering Data Scientists to Utilize Geospatial Data at Scale Webinar Series Topic 1 Topic 2 Topic 3 register now!View on-demand Today
  • 22. Q&A Kubernetes Demo: Contact Lamont Norman at Lamont.Norman@precisely.com

Hinweis der Redaktion

  1. Why do 87% of data science projects never make it into production? - https://venturebeat.com/2019/07/19/why-do-87-of-data-science-projects-never-make-it-into-production/ Volume, Variety & Velocity Access to the data From: https://designingforanalytics.com/resources/failure-rates-for-analytics-bi-iot-and-big-data-projects-85-yikes/ July 23, 2019 by Brian T. O'Neill July 2019: VentureBeat AI reports 87% of data science projects never make it into production Jan 2019: NewVantage survey reports 77% of businesses report that "business adoption" of big data and AI initiatives continues to represent a big challenge for business. That means 3/4 of the software being built is apparently collecting dust. Ouch. Jan 2019: Gartner says 80% of analytics insights will not deliver business outcomes through 2022 and 80% of AI projects will “remain alchemy, run by wizards” through 2020.
  2. Consider animating these for emphasis
  3. Most large enterprises have made major investments in data environments over a period of many years These environments contain the data that these business run on and that today power the strategic initiatives driving the business forward – machine learning, AI and predictive analytics - Legacy platforms (mainframe and IBM i) continue to adapt with each new wave of technology and are not going away anytime soon
  4. Highly responsive real time service that responds to load - elasticity
  5. Add slide with detailed descriptions of POI by boundary, flood elevation and wildfire distance