SlideShare ist ein Scribd-Unternehmen logo
1 von 32
Downloaden Sie, um offline zu lesen
Building The Spatial Enterprise
for Denver Public Schools
Matthew Baker
Department of Planning and Analysis
...Or:
How I learned to stop
worrying and love
SQL Spatial.
DPS Overview
● Fastest Growing District in USA
● 84,424 Students
– Largest district in CO
● 120 Languages
● 172 Schools
DPS Student Ethnicity
DPS Student Performance
Overview Planning & Analysis
● DPS Administration Building (900 Grant)
– 1870 Lincoln (Summer 2014)
● Demographic Analysis and Projections
– Student demand and performance
● Capacity and Resource Planning
– Strategic Regional Analysis (SRA)
Spatial Data and Client Applications
Infinite Campus (IC)
Students
Teachers
Principals
Superintendent
Administration
Planning
&
Analysis
All DPS database tables
Spatial Data Primary
● School Points
● Boundaries
● Address Points
● Student Households (addresses)
● Planning and Forecast Regions
● October Count (Student count on Oct. 1)
Address Point File
● Currently ~280,000 geocoded address points
● Central Database: Infinite Campus (IC)
– Origin and source of truth for student data
● Weekly sync to IC addresses and GIS
addresses
– IC doesn't (yet) store spatial data!
Spatial Data Other
City & County of Denver
● Parcels
● Neighborhoods
● Street Centerlines
● Election Precincts
● Police Districts
● Historic Landmark Districts
● Zoning
● Land Use
● Council Districts
Census
● Block Groups
● Blocks
● Tracts
● Birth data
Clients DPS Enterprise
● IC - School Matrix
● School by Grade for each address point
● DPS Business Intelligence (BI)
● DPS Transportation Department
● Operational Data Store (ODS)
● Colorado Department of Education
– CDE Pipeline
DPS School Locator
● Enter Address
● Get:
– Boundary Schools
● Elem
● Mid
● High
– Transportation Info
● ArcGIS Server
● Google Maps API
http://maps.dpsk12.org/
Building the Spatial Enterprise
Design Tasks Initial
● Identify and interview users and stakeholders
● Design GIS database
– ArcGIS 9.3.1 to 10.1
● Dev / QA database design
● Implement production
● Applications
– Re-build ArcGIS Server
– Re-build web applications (school locator, etc.)
Workflow Challenges
IC
SQL Data Pull
What's broken?
● Links to Data
– Enterprise to GIS
– SQL to Map
● ArcGIS
– Access and create spatial data, no link to Enterprise
● SQL Server
– Access tabular data
– Enables enterprise-wide analysis
– No access to spatial data
Solution SQL Server Spatial
Improvements
● SQL Server “workspace”
– MS SQL Server 2012
– Analysts build and use spatial functions
– Create and modify database views
● Use in Excel
● Use in ArcMap
● ETL Automation
– To / From SDE
– Analysis to DPS Enterprise, etc.
Enabling SQL Spatial with FME
● FME Workbench
– From SDE to SQL Spatial Native format
– Create spatial index
– Create Unique Object ID
● “Take What We Need”
– Some fields for GIS
– Some for SQL Analysis
Creating Spatial Data with FME
● Assemble query in SQL
● Join Spatial data (shape field)
– Using AddressID
– Must also use OBJECTID for use in ArcMap
● Pull data from SQL to ArcSDE for use in GIS
FME Workbench Example
● ~280,000 points x3 feature classes
● Reproject while loading
● Create SQL Spatial Index
Other Benefits ETL with FME
● Promoting SDE Tables
– Dev to QA
– QA to Prod
● Simple tool for DBA to run
● Enter User/Pass
● ETL runs transparently
SQL Spatial Example
● Need:
– Grade 9 students
– Projected School Assignment for 2015
– Within Specific Boundary
● Pulls from:
– Projected Students
– Address Master
SELECT
count( [Student_Number]) as StudentCount
FROM [GISWork].[dpsdata].[ProjectedStudents]
join
[GISWork].dpsdata.[Address_Master]
on (ProjectedStudents.addressID = Address_Master.AddressID)
join
GISWork.dpsdata.SchoolBoundaries_All
on (Address_Master.shape.STIntersects(SchoolBoundaries_All.shape) = 1)
where ProjectedGrade = '9'
and SchoolBoundaries_All.HIGH_NUM = '464'
group by ProjectedSchool
order by StudentCount desc
SQL Spatial Example
● Assign special needs transition-grade students
to feeder or closest center program
– Give top 3 closest schools by program
– Distance to each school
SELECT BT.[StudentID]
,BT.[LastName]
,BT.[FirstName]
,BT.[CurrentGrade]
,BT.[CurrentSchoolNum]
,BT.[CurrentSchoolName]
,BT.[ProjResSch]
,BT.[ProjectedEdLevel]
,BT.[CenterProgram]
,BT.[CenterProgramGroup]
,BT.[shape]
,ROW_NUMBER() OVER(PARTITION BY BT.[StudentID] ORDER BY ROUND((SC.Shape.STDistance(BT.Shape)/5280),2)
,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN '466'
WHEN BT.[CenterProgramGroup] in ('AUT', 'MI-Severe') and BT.[CurrentSchoolNum] = '419' THEN '469'
ELSE SC.[CenterSchNum] END as [ProjFeederCenterSchNum]
,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN 'DCIS/NCAS'
WHEN BT.[CenterProgramGroup] in ('AUT', 'MI-Severe') and BT.[CurrentSchoolNum] = '419' THEN 'MLK'
ELSE SC.[CenterSchName] END as [ProjFeederCenterSchName]
--,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN
,ROUND((SC.Shape.STDistance(BT.Shape)/5280),2) as [DistancetoFeeder]
FROM
(SELECT ST.[StudentID]
,ST.[LastName]
,ST.[FirstName]
,ST.[Grade] as [CurrentGrade]
,ST.[SchoolNum] as [CurrentSchoolNum]
,ST.[SchoolName] as [CurrentSchoolName]
,CASE WHEN ST.[grade] = '5th' THEN ST.[SCHOOL_6] WHEN ST.[Grade] = '8th' THEN ST.[SCHOOL_9] WHE
[resschnum] END as [ProjResSch]
--,ST.[ResSchNum]
--,ST.[ResSchName]
,CASE WHEN ST.[grade] = '2nd' THEN 'ElemInt' WHEN ST.[grade] = 'Pre-K' THEN 'ElemPri' ELSE ST.[
--,ST.[DOB]
--,ST.[Disability]
,ST.[CenterProgram]
SQL Spatial Functions
● MSSQL Spatial
– STIntersects
– STContains
– STDistance
– STCentroid
Tools Used
● SQL Server 2012
– Native Spatial Data / Geometry
● ArcGIS 10.1
– ArcGIS Server 10.2
● FME Workbench
● PGModeler
–
Thank you!
Matthew Baker
Department of Planning and Analysis
matthew_baker@dpsk12.org
@MapBaker

Weitere ähnliche Inhalte

Ähnlich wie Building the Spatial Enterprise of Denver Public Schools

data-scientist-learning-path.pptx
data-scientist-learning-path.pptxdata-scientist-learning-path.pptx
data-scientist-learning-path.pptxsandipkishore
 
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...VMware Tanzu
 
Current-Active Resume
Current-Active ResumeCurrent-Active Resume
Current-Active Resumergtyh
 
Genet Tadesse Resume
Genet Tadesse ResumeGenet Tadesse Resume
Genet Tadesse ResumeGenet Tadesse
 
Genet tadesse resume
Genet tadesse resumeGenet tadesse resume
Genet tadesse resumeGenet Tadesse
 
Santosh Prasad-Resume (2)
Santosh Prasad-Resume (2)Santosh Prasad-Resume (2)
Santosh Prasad-Resume (2)Santosh Prasad
 
Jyothi_Ganta_Oracle_BI_Developer
Jyothi_Ganta_Oracle_BI_DeveloperJyothi_Ganta_Oracle_BI_Developer
Jyothi_Ganta_Oracle_BI_DeveloperJyothi srirama
 
EvaSys module survey dashboard
EvaSys module survey dashboardEvaSys module survey dashboard
EvaSys module survey dashboardDavid Mackland
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIshivajirao12345
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIkanimozhikannan1
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIvinothraja12345
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIshivajirao12345
 

Ähnlich wie Building the Spatial Enterprise of Denver Public Schools (20)

data-scientist-learning-path.pptx
data-scientist-learning-path.pptxdata-scientist-learning-path.pptx
data-scientist-learning-path.pptx
 
Resume_DOC1
Resume_DOC1Resume_DOC1
Resume_DOC1
 
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...
A Modern Interface for Data Science on Postgres/Greenplum - Greenplum Summit ...
 
Current-Active Resume
Current-Active ResumeCurrent-Active Resume
Current-Active Resume
 
Genet Tadesse Resume
Genet Tadesse ResumeGenet Tadesse Resume
Genet Tadesse Resume
 
Genet tadesse resume
Genet tadesse resumeGenet tadesse resume
Genet tadesse resume
 
Santosh Prasad-Resume (2)
Santosh Prasad-Resume (2)Santosh Prasad-Resume (2)
Santosh Prasad-Resume (2)
 
Jyothi_Ganta_Oracle_BI_Developer
Jyothi_Ganta_Oracle_BI_DeveloperJyothi_Ganta_Oracle_BI_Developer
Jyothi_Ganta_Oracle_BI_Developer
 
EvaSys module survey dashboard
EvaSys module survey dashboardEvaSys module survey dashboard
EvaSys module survey dashboard
 
CV1-Sadaf_Siddiqui
CV1-Sadaf_SiddiquiCV1-Sadaf_Siddiqui
CV1-Sadaf_Siddiqui
 
Pratyush cv
Pratyush cvPratyush cv
Pratyush cv
 
Pratyush cv
Pratyush cvPratyush cv
Pratyush cv
 
Pratyush cv
Pratyush cvPratyush cv
Pratyush cv
 
Role of ML engineer
Role of ML engineerRole of ML engineer
Role of ML engineer
 
CV1
CV1CV1
CV1
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAI
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAI
 
Data science training
Data science trainingData science training
Data science training
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAI
 
DATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAIDATA SCIENCE TRAINING IN CHENNAI
DATA SCIENCE TRAINING IN CHENNAI
 

Mehr von Safe Software

Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Safe Software
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Safe Software
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleSafe Software
 

Mehr von Safe Software (20)

Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) People
 

Kürzlich hochgeladen

Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 

Kürzlich hochgeladen (20)

Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 

Building the Spatial Enterprise of Denver Public Schools

  • 1. Building The Spatial Enterprise for Denver Public Schools Matthew Baker Department of Planning and Analysis
  • 2. ...Or: How I learned to stop worrying and love SQL Spatial.
  • 3. DPS Overview ● Fastest Growing District in USA ● 84,424 Students – Largest district in CO ● 120 Languages ● 172 Schools
  • 6.
  • 7. Overview Planning & Analysis ● DPS Administration Building (900 Grant) – 1870 Lincoln (Summer 2014) ● Demographic Analysis and Projections – Student demand and performance ● Capacity and Resource Planning – Strategic Regional Analysis (SRA)
  • 8. Spatial Data and Client Applications
  • 10. Spatial Data Primary ● School Points ● Boundaries ● Address Points ● Student Households (addresses) ● Planning and Forecast Regions ● October Count (Student count on Oct. 1)
  • 11. Address Point File ● Currently ~280,000 geocoded address points ● Central Database: Infinite Campus (IC) – Origin and source of truth for student data ● Weekly sync to IC addresses and GIS addresses – IC doesn't (yet) store spatial data!
  • 12. Spatial Data Other City & County of Denver ● Parcels ● Neighborhoods ● Street Centerlines ● Election Precincts ● Police Districts ● Historic Landmark Districts ● Zoning ● Land Use ● Council Districts Census ● Block Groups ● Blocks ● Tracts ● Birth data
  • 13. Clients DPS Enterprise ● IC - School Matrix ● School by Grade for each address point ● DPS Business Intelligence (BI) ● DPS Transportation Department ● Operational Data Store (ODS) ● Colorado Department of Education – CDE Pipeline
  • 14. DPS School Locator ● Enter Address ● Get: – Boundary Schools ● Elem ● Mid ● High – Transportation Info ● ArcGIS Server ● Google Maps API http://maps.dpsk12.org/
  • 15. Building the Spatial Enterprise
  • 16. Design Tasks Initial ● Identify and interview users and stakeholders ● Design GIS database – ArcGIS 9.3.1 to 10.1 ● Dev / QA database design ● Implement production ● Applications – Re-build ArcGIS Server – Re-build web applications (school locator, etc.)
  • 18. What's broken? ● Links to Data – Enterprise to GIS – SQL to Map ● ArcGIS – Access and create spatial data, no link to Enterprise ● SQL Server – Access tabular data – Enables enterprise-wide analysis – No access to spatial data
  • 20. Improvements ● SQL Server “workspace” – MS SQL Server 2012 – Analysts build and use spatial functions – Create and modify database views ● Use in Excel ● Use in ArcMap ● ETL Automation – To / From SDE – Analysis to DPS Enterprise, etc.
  • 21. Enabling SQL Spatial with FME ● FME Workbench – From SDE to SQL Spatial Native format – Create spatial index – Create Unique Object ID ● “Take What We Need” – Some fields for GIS – Some for SQL Analysis
  • 22. Creating Spatial Data with FME ● Assemble query in SQL ● Join Spatial data (shape field) – Using AddressID – Must also use OBJECTID for use in ArcMap ● Pull data from SQL to ArcSDE for use in GIS
  • 23. FME Workbench Example ● ~280,000 points x3 feature classes ● Reproject while loading ● Create SQL Spatial Index
  • 24. Other Benefits ETL with FME ● Promoting SDE Tables – Dev to QA – QA to Prod ● Simple tool for DBA to run ● Enter User/Pass ● ETL runs transparently
  • 25.
  • 26. SQL Spatial Example ● Need: – Grade 9 students – Projected School Assignment for 2015 – Within Specific Boundary ● Pulls from: – Projected Students – Address Master
  • 27. SELECT count( [Student_Number]) as StudentCount FROM [GISWork].[dpsdata].[ProjectedStudents] join [GISWork].dpsdata.[Address_Master] on (ProjectedStudents.addressID = Address_Master.AddressID) join GISWork.dpsdata.SchoolBoundaries_All on (Address_Master.shape.STIntersects(SchoolBoundaries_All.shape) = 1) where ProjectedGrade = '9' and SchoolBoundaries_All.HIGH_NUM = '464' group by ProjectedSchool order by StudentCount desc
  • 28. SQL Spatial Example ● Assign special needs transition-grade students to feeder or closest center program – Give top 3 closest schools by program – Distance to each school
  • 29. SELECT BT.[StudentID] ,BT.[LastName] ,BT.[FirstName] ,BT.[CurrentGrade] ,BT.[CurrentSchoolNum] ,BT.[CurrentSchoolName] ,BT.[ProjResSch] ,BT.[ProjectedEdLevel] ,BT.[CenterProgram] ,BT.[CenterProgramGroup] ,BT.[shape] ,ROW_NUMBER() OVER(PARTITION BY BT.[StudentID] ORDER BY ROUND((SC.Shape.STDistance(BT.Shape)/5280),2) ,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN '466' WHEN BT.[CenterProgramGroup] in ('AUT', 'MI-Severe') and BT.[CurrentSchoolNum] = '419' THEN '469' ELSE SC.[CenterSchNum] END as [ProjFeederCenterSchNum] ,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN 'DCIS/NCAS' WHEN BT.[CenterProgramGroup] in ('AUT', 'MI-Severe') and BT.[CurrentSchoolNum] = '419' THEN 'MLK' ELSE SC.[CenterSchName] END as [ProjFeederCenterSchName] --,CASE WHEN BT.[CenterProgramGroup] in ('AN','MI') and BT.[CurrentSchoolNum] = '447' THEN ,ROUND((SC.Shape.STDistance(BT.Shape)/5280),2) as [DistancetoFeeder] FROM (SELECT ST.[StudentID] ,ST.[LastName] ,ST.[FirstName] ,ST.[Grade] as [CurrentGrade] ,ST.[SchoolNum] as [CurrentSchoolNum] ,ST.[SchoolName] as [CurrentSchoolName] ,CASE WHEN ST.[grade] = '5th' THEN ST.[SCHOOL_6] WHEN ST.[Grade] = '8th' THEN ST.[SCHOOL_9] WHE [resschnum] END as [ProjResSch] --,ST.[ResSchNum] --,ST.[ResSchName] ,CASE WHEN ST.[grade] = '2nd' THEN 'ElemInt' WHEN ST.[grade] = 'Pre-K' THEN 'ElemPri' ELSE ST.[ --,ST.[DOB] --,ST.[Disability] ,ST.[CenterProgram]
  • 30. SQL Spatial Functions ● MSSQL Spatial – STIntersects – STContains – STDistance – STCentroid
  • 31. Tools Used ● SQL Server 2012 – Native Spatial Data / Geometry ● ArcGIS 10.1 – ArcGIS Server 10.2 ● FME Workbench ● PGModeler –
  • 32. Thank you! Matthew Baker Department of Planning and Analysis matthew_baker@dpsk12.org @MapBaker