3. Today's objectives
1. Learn about the Open Addresses project
2. Contribute to Discovery Phase
• help us understand requirements
• help us explore feasible approaches
3. Connect with each other
6. Ground rules
• Chatham House (except presentations)
• you can report something was said, not who said it
• Save your questions for discussion time
• Own your opinion & listen to others'
• There are no wrong ideas
• we are exploring this territory
11. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Ministry for Housing, Urban and Rural Affairs
Address: Gammel Mønt 4, 1117 Copenhagen
Ministry’s Logo
The Ministry
Minister Carsten Hansen
12. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 12
Disclaimer
The basic facts are approved
… but personal statements are mine
13. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 13
”Mr. and Mrs. Dursley of number four, Privet Drive
was proud to say that they were perfectly normal …”
J.K. Rowlands: ”Harry Potter and
the Philosophers Stone” (Chapter 1, p. 1)
15. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 15
Christopher Corbin,
Address Data, PSI, Open data
Michael Nicholson,
Intelligent Addressing, EURADIN
Rob Walker,
ISO Address Standard
17. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Concept of Addressing
ODI-UK, 08-08-2014 DK Addresses and Address Data 17
A
B
“Structured information that allows the
unambiguous determination of an object
for purposes of identification and location”
From ISO 19160 DIS
21. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 21
Bratislava, August 1968
(Nordfoto, DK)
… without addresses
navigation is difficult
22. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 22
CC Paul Townsend
(Flickr: brizzle born and bred)
… so road signs were painted
out in the UK during WWII
23. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 23
… and should be easy to understand
24. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 24
… initiative launched 2009 by the
Universal Postal Union, UPU
25. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 25
“As a network, addresses allow individuals to be connected to everyday life,
have a legal identity, participate in the democratic process, be part of the
society, as well as the formal economy, receive public and private services and
participate in the information and communication age.
Governments and public and private services also benefit from the address
network by using it to optimize the reach of policies, communicate with
individuals and support goods and service delivery.
Addresses are the underlying thread connecting these different actors and
their activities, effectively functioning as a network of networks.”
Universal Postal Union, UPU
26. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 26
Delivery Services
Communication networks
Vehicle navigation
Civil registration
Marketing
Statistics
Location planning
Yellow pages, mapping
Social services
Tax, assessmentInsurance/finacing
Property market
Transport
Customer relations
Emergency
Health care
Geo enabled applications
ADDR
3A
28. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
… 1960 Addresses
covers urban areas only
ODI-UK, 08-08-2014 DK Addresses and Address Data 28
1967 Post code system
introduced
1970-73 Addresses
extended to rural areas
29. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 29
1978-80: Standard Address Format
Jennifer Red
Blue Street 14A, 1.tv
4990 Grenville C
Mun.C Street AddNo Floor Door
413 0915 14A 1 tv
30. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 30
1995-2001: Geocoding and Harmonization
Basic method:
Collect addresses from 2-3 property base registers
and combine them with the “house-number layer”
in the first generation of digital maps.
Store the resulting data in the public Building and
Dwelling Register
MapKRR
Property
Data
Registers
BBR
Building-
and Dwelling
Register
Municipal
Technical
Base Maps
31. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 31
1995-2001: Geocoding and Harmonization
Mun StrC AdNo X-coord. Y-coord. Arc.
--- ---- ---- -------,-- -------,-- -----
619 4605 _17A 248.510,45 153.345,08 175,0
The initiative was a volunteer municipal project
supported by the government and the local
government association by standards, access to
public registers and project coordination
36. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 36
From “Address as an Attribute”
Population Register
Tax
Property Register
Building Register
Health Care
Register of
Business Entities
Utilities
37. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 37
… which encourages Inconsistency
Property register
Orchards Lane 2
DB1Utility data base:
Old Kings Road 88
DB1
38. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 38
Towards “Address as an Object”
Population Register
Tax
Property Register
Building Register
Customer
management
Business Entities
Utilities
Address Register
39. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 39
Addresses as a Common Asset for Society
22
Before
2
Oak Lane
After
0a3f507f-c5df-32b8-e044-0003ba298018
40. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 40
Addresses as a Common Asset for Society
Address
System
Concept of Addresses
as a common, public
asset and resource
Person
(CPR, health,
social, Tax …)
Business
Legal entities
production units…
Building, dwelling,
utilities,
property …
41. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 41
2000-2001: Supported by Legal Framework
Public and
Common Private
Road
Legislation
§
Population
Register
Legislation
§
Building
Register
Legislation
§
Until 2001
Building
Register Act
Sect. 3a-3g
§ 2001: All legal regulation of
addressing transferred to the Act on
Building and Dwelling Registration
(Last revision 2012)
Statutory order
on road names
and Addresses
§ 2003: Detailed regulation on
rules for addressing
(Latest revision May 2014)
From 2001 - …
42. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Address Data Agreement
The 2002 agreement to provide address data
as “Open data”, without fee or license restrictions
43. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
2000-2002 Deadlock Situation
Situation:
• State of the art address data, 97 % with HQ geo codes
• Very large potential for use; Could be joined with data from other public
base registries
• Large user demand from: emergency, police, county administration,
transport sector, health …
But:
• Data owned by 275 individual municipalities; no common license
agreement or data distribution
Therefore:
• Almost no re-use of data outside municipalities; but competing private
sector collections/datasets
ODI-UK, 08-08-2014DK Addresses and Address Data 43
45. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 45
2002 …: Free of Charge Data Agreement
Prepared by Danish e-Government Taskforce in
Ministry of Finance
Purpose: Increase use of address data including
geo codes
Covers full public and private sector use and
add-on valueing
Payment only of marginal costs of distribution
No license fee or any other payment based on
IPR
Re-distribution to 3rd parties without payment
Economic compensation to municipalities; also
for maintenance
46. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Drivers behind the
agreement
– and the Evaluation of the Socio-Economic
Impact
47. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Public Transport Services
ODI-UK, 08-08-2014 DK Addresses and Address Data 47
”When we started our first ’Journey
Planner project’we had to manage
individual agreements with every
single municipality on the use of
their address data – in the long run
this was not a feasible solution.
Without the ”free-of-charge data
agreement our project would have
been almost impossible”
Ulla Skjelbo, Project Manager
”Rejseplanen”/Journey Planner 1999-2000
48. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Public Safety and Crime Detection
ODI-UK, 08-08-2014 DK Addresses and Address Data 48
”Access to the official geo coded
addresses proved to be one of the most
important milestones in the
implementation of GIS in the police
force” Ole Jacobsen,
National Investigation Center,
Danish National Police
49. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Disease Monitoring and Control
ODI-UK, 08-08-2014 DK Addresses and Address Data 49
Legionella
Examples showing monitoring Legionella infections over a period of 2
decades and detection of the transmission source of a
recent Campylobacter outbreak.
”Geo coded address data is a
crucial tool to the national
monitoring of infectious diseases
and to the analysis for detection
of transmission source of
outbreaks.” Ivan Bæhr, GIS specialist,
Statens Serum Institut – SSI
(Danish Center for Disease Control)
Campylobacter
50. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Cancer Research
ODI-UK, 08-08-2014 DK Addresses and Address Data 50
“In studies of environmental
pollutants and human health, the
assessment of individual exposure to
pollutants are a major challenge.
Without geo coded addresses our
recent estimations of radon in the
homes of children with leukemia and
air pollution at the residences of
lung cancer patients, had not been
possible.” Ole Raaschou-Nielsen.
Institute of Cancer Epidemiology,
Danish Cancer Society
51. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Postal Delivery Services
ODI-UK, 08-08-2014 DK Addresses and Address Data 51
Address based planning of mail delivery (courtesy: Post Denmark)
“Post Denmark assesses that the new
route planning tool ’TOR’will reduce
delivery costs by 7,5 millions EUR every
year. This corresponds to 3,3% of the
overall time used for delivery”
(’TOR’ is based on geo coded address data)
Lars Kristensen, Post Denmark
in ”Fyens Stiftstidende” 03-12-2004
52. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Emergency Dispatch Services
ODI-UK, 08-08-2014 DK Addresses and Address Data 52
“When people call 1-1-2, the first
thing to know is where the accident
happened.
Address and street name is the most
important tools to confirm the
location – in order for us to dispatch
the right ambulance.” Erling Larsen,
Danish 112 Centers’ Secretariat
(112 was one of the first address data users)
53. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Commercial use
ODI-UK, 08-08-2014 DK Addresses and Address Data 53
“In the first year after the Free-of-
Charge agreement, everybody thought
they could make simple business just by
re-selling the original address data.
It very quickly became clear, though, that
the opportunities for business was in
value-adding and development of new,
smart products based on the addresses as
a common reference.”
Martin Glarvig,
Managing Director, Geomatic DK
54. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Assessing the Impact
Estimated Socio-Economic Benefits 2005-2009 of
the Free-of-Charge Agreement
55. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 55
2010: Assessment of Benefits 2005-2010
2000 2005 2010 2015
Good
Better
Best
Average
Start ’Zero’
Today
How shall we assess
the benefits of the
increased address
data re-use?
56. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 56
Chain of Address Data Re-use
ADDR
‘Public Data Server’
(PDS)
2nd level
Licensed
Data Distributors
3rd 5th4th …
End users
Data distribution from a
common hub managed by
DECA (www.ois.dk)
Municipalities
Re-use and re-re-use
57. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 57
Increase in Re-use 2002-2009
Use of address data sets
25
1.250
0
200
400
600
800
1.000
1.200
1.400
2001 2009
Datasetsdistributed/year
2002 2009
Number of Address data sets distributed or updated to 3rd parties in 2002 and 2009
(of the 1250, approximately 300 was ’full cover Denmark’
70%
20%
10%
Private sector
State, region
Municipality
58. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 58
Result: Assessment of Benefits
Direct, measurable economic benefits from
re-use of public address data 2005-2009:
~ 63 mill. EUR (~471 mill. DKK)
Assessed benefits in 2010:
~ 14 mill. EUR (~105 mill. DKK)
Cost of data agreement 2003-2009:
~ 2.6 mill. EUR (~20 mill. DKK)
~ In 2010: 0.2 mill. EUR (~1.5 mill. DKK)
59. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 59
Results Confirmed by EU Commission
Pricing of Public Sector Information
Study (POPSIS) selected the Danish
provision of address data as one of
the case studies.
The Study used another method, but
the conclusion, that the Free-of-
Charge agreement on address data
had a significant positive socio-
economic impact, was the same.
EU DG InfSoc, October 2011
60. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
OSM Paris, 04-04-2014 DK Addresses and Address Data 60
Potential Cost-benefit of a Danish Address
1 1000 5.000.000
Address authority Industry Products
The municipal address authority
allocates and registers an address or
a road name
1000 application developers or data
producers integrates the address or
road name in their product or service
5 mill. users now have access to the
new address or road name in their it-
system, GPS, smartphone or tablet
Few cost
Huge benefit
62. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 62
We are in a New World
> 50 % of all Households! (1,25 mill.)
Antal husstande med GPS navigation og smartphone
(Kilde: Danmarks Statistik)
0%
10%
20%
30%
40%
50%
60%
70%
2006 2007 2008 2009 2010 2011 2012
GPS navigation
Smartphone
*) Add to this number of GPS, smartphones and tablets
used in private businesses and public sector
63. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 63
Where Emergency Response is Data-driven
500 times every day, an ambulance is dispatched to an incident
where the response time is critical – i.e. few minutes delay could
cause death or another serious situation
64. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 64
On the Political Agenda
TV2/Fyn 8. oktober 2012”Unfortunately there are many places without an accurate address”
67. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
DK Addresses and Address Data 67
The data quality
– E.g. timeliness, accuracy, coverage,
harmonization, standardization
The back end infrastructure
– E.g. base register systems, coherence with
other basic data sets etc.
The services
– E.g. by reliable, high-effect, open services
for mapping, online access and download
… and everything within the concept
of Open Data and Open Services
The Address Program shall Improve
ODI-UK, 08-08-2014
68. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
External Interest in Improvement *)
• Public sector – at all levels:
– Waste of time in management of in-formal, local address registers
– Waste of time to sort out data inconsistency from different sources
• Business – Utilities, LBS service providers, transport sector:
– Higher accuracy, better address coverage and improved timeliness
– Improved data services, reduced costs of acquisition
• Citizens:
– Are worried if GPS and emergency service will not find them
– Are troubled when services are poor because of bad addressing
*) Based on several stakeholder reports and feed back from users and citizens
DK Addresses and Address Data 68ODI-UK, 08-08-2014
69. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 69
National TV-spot from May 2014
70. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Benefits for Society
Expected and experienced socio-economic
benefits of the Address Program – and examples
71. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Benefits of the Address Program
Improved
Data Quality
and timeliness
Improved
infrastructure
Systematic
Re-use
IT-Infrastructure:
(Implementation + operation)
New address register
Data Distribution/Services
Improved Data Quality:
(implementation costs)
Extra FTE’s in municipalities and
MBBL
Address authority tasks:
(operational costs)
Extra FTE’s in municipalities and
MBBL
Benefits from digital self-
service, electronic forms,
applications, reporting
Reduced cost of new it-
applications and systems
Reduced cost and time of
present it and address data
management
Other business process
benefits In total
~30 mill EUR/yr
from 2015
~ 5 mill EUR
(one time) +
1 mill EUR/yr
~ 85 FTE
(one time)
~ 40 FTE
every year
ODI-UK, 08-08-2014 DK Addresses and Address Data 71
72. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
The Address Program Business Case
2012 2016 2020
Even
Better
Almost
perfect?
Good
Today
’Zero’
(Do nothing)
Future
situation
Estimated annual
net benefit:
30 mill. EUR/yr
ODI-UK, 08-08-2014 DK Addresses and Address Data 72
73. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
DK Addresses and Address Data 73
• Because our address data are open they are widely in use
for many applications
• Because our data are in use and open, users see the
mutual benefits in reporting errors
• Because we receive error reports, we are able to improve
our address data
Note
ODI-UK, 08-08-2014
74. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Any government wants to create new jobs,
private innovation and entrepreneurship
– and tax revenue
ODI-UK, 08-08-2014 DK Addresses and Address Data 74
75. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Data is the new Gold
– Open data is a great
opportunity for pushing
our economy
Neelie Kroes, Vice President EC
ODI-UK, 08-08-2014 DK Addresses and Address Data 75
76. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Joys Law
"No matter who you are, most of
the smartest people work for
someone else.”
Bill Joy, the co-founder of
Sun Microsystems
ODI-UK, 08-08-2014 DK Addresses and Address Data 76
77. MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 77
Open Address Data: Business Opportunities
81. An Open National Address Gazetteer
Open Addresses Symposium
Vision for an Open Address Database
8 August 2014
Hugh Neffendorf
82. BIS feasibility review
z Prompted by ODUG paper to Data Strategy Board
z Request from Ministers
z BIS review working with data owners, representative
bodies and government officials
z Independent report by Katalysis
z Report and comments published
https://www.gov.uk/government/publications/an-open-national-address-gazetteer
z Now with BIS and Cabinet Office
83. Why Open Addressing?
z Critical element of our identity for personal and business
reasons
z Open Data is changing attitudes and behaviours
z Addresses are a key core reference and would be a big win
for Open Data
z The potential for innovation stimulated growth is the prize
But, it was recognised that:
z Costs may be high to government
z Ownership is complex
z Compelling and quantifiable benefits case is elusive
84. Definitive or Open?
z Definitive addressing is the priority goal
z Many users will pay reasonable prices for good data
z But many are deterred by licensing and/or price
z Open can support definitive – more usage, more
feedback
Can we achieve both?
85. Establishing evidence
z Does Open mean growth?
z Little hard evidence on Open Data
y Tracking often stops when no licensing
y APPSI seminar was inconclusive
z Some good cases of ‘Open’ growth
y Population census
y PSMA
y OS OpenData
y Companies House
z Considerable need for (good) evidence
z Open Addresses should have monitoring
86. The address system today
OS
VOA
LG
LG
LR
NAG PAF
SN&N
+ many
roles
Addresses
UARN UPRN
GeoPlace
LLPGs
NGRs
Land parcels
& addresses
OWPAs
TOIDs
Users
Postmen
Royal
Mail
PSMA
Commercial
AddressBase
Postal
address
Postcode
UDPRN
Aliases
MultiRes.
BS7666
address
UPRN
Linkage files
TOID
UARN
UPDRN
VARs
Tax data links
Provides new addresses
Receives postcodes
The Address System Today
87. Usage sector Open View Benefit
H/M/L
Open Lite
OK?
Notes
Academics ✓✓✓ H Y Better quality research from more accurate data
Individual citizens -- M Y/N Indirect benefit from improved identity authentication and service delivery; better e-products
Devolved
administrations
✓✓ H N Scotland strongly in favour; NI interested; Wales?
Land Registry ✓ L N No great consequences. Can see wider benefits
Local government ✓✓ H N Good for citizen engagement. Worried about any resource impacts
Mail and delivery
industry
-- L N Some benefit from better quality addresses. Concerned to maintain quality
Market research ✓✓ M Y Will save money on buying addresses; more consistent research
Not for Profit
Enterprises
✓✓ M Y Better quality use of data and data exchange
Open data community ✓✓✓ H Y Open Addresses is one of their most important requirements
PAF Solutions
Providers
✓✓ M N Generally positive views from larger resellers. Smaller ones may feel threatened. Quality is a concern
Private sector generally ✓✓ H Y Considerable saving and simpler licensing will free up activity
Public sector generally ✓✓ M Y/N Already well covered by PSMA/PSL but can see merits in wider extension
SME market ✓✓✓ H Y Considerable value for software developers
Statistics users ✓✓ M Y Interested in wider data linkage benefits
Vehicle navigation ✓ L Y Some gain from reliable benchmark updates
Valuation Office ✓ L N No great consequences. Can see wider benefits
Web search providers ✓✓✓ H Y Will open considerable growth opportunities
88. Review conclusions
z Seven main options
y Totally Open
y Evolving status quo
y Extended bulk purchases
y New charging models
y Addresses as an Open online service
y Freemium (Free ‘Lite’ products)
y Commissioned ‘basic’ Open product - recommended
• Also considering scope for efficiencies
y Hub operation
y Shared intelligence
y Less duplication
91. Wider context
• Data culture is changing
• long term, inexorable move to open
• We have seen this before
• software, music, books
• changes in technical delivery
• changes in cultural expectations
92. What can we learn?
• Mixed economy persists
• customer base for closed shrinks
• Shift from products to services
• new opportunities to make money
• Existing providers can adapt
• but it can be hard
93. "The sale of the PAF with the Royal Mail was a
mistake. Public access to public sector data
must never be sold or given away again. This
type of information, like census information
and many other data sets, is very expensive to
collect and collate into useable form, but it
also has huge potential value to the economy
and society as a whole if it is kept as an open,
public good."
Bernard Jenkin, Chair of Public Administration Select Committee
94. “Open data is data that can be freely used,
reused and redistributed by anyone –
subject only, at most, to the requirement to
attribute and share alike.”
Opendefinition.org
95. Open is not equivalent to free
open
data
free
service
96. Hypothesis 1: closed address files are monopoly
information assets, embedded in huge amounts
of public data, but which cannot be reproduced
to a usable quality
Hypothesis 2: it is possible to build & maintain a
sustainable open address database better suited
to today's requirements using modern,
collaborative approaches to data management
97. Open Addresses Project
• Discovery Phase funded from
Release of Data Fund
• administered by Open Data User
Group within Cabinet Office
• Legal feasibility
• Technical feasibility
• Sustainability feasibility
98. Open Addresses Vision
• Meeting the expectations of the
modern information economy
• Collaboratively maintained to
benefit everyone
• Providing plenty of scope for
value-added products & services
that avoid lock-in
99. Modern requirements
• Addresses are not just for posting mail
• Other requirements:
• validation & auto-completion
• geocoding for route finding
• associating people with areas
• classification of addresses for targeting interventions
• linking datasets together
100. Modern maintenance
• Through collaboration
• professional / expert engagement
• the wider crowd
• Supplemented by
• targeted (funded) activity
• Addresses are well suited for this
102. Where we are
• Legal feasibility
• received legal opinion
• doing due diligence on key open datasets
• Technical feasibility
• data integration & inference
• architecture for service provision
• Sustainability feasibility
• customer needs & business model
103. What next
• Pending approval
• Alpha phase – Oct-Nov
• incorporating Open Addresses Ltd
• building minimum viable product
• Beta phase – Dec-Mar
• developing operational service
• Independent operation – Mar
104. Unique opportunity
• Green field development
• do not need to be limited by legacy
• You can help this succeed
• contribute today
• collaborate in the future
• You can benefit from its success
• reduce costs, build new products
107. Requirements Carousel
• Six tables
• you will visit four
• Go to a table of your choice
• listen to the presentation
• ask questions & discuss
• When whistle blows, move on
108. Requirements from:
Table 1 BBC Chris Henden
Table 2 GDS Paul Downey
Table 3 Direct Marketing Assoc. Tim Drye
Table 4 ONS Alistair Calder
114. Meeting the Challenges
• Lots of things to work out
• green(ish) field development
• Focus on five challenges
• hear a talk from an expert
• hear a little of our thoughts
• discuss in the workshop
• fill in your worksheets!
116. Tracking provenance
• Three types of sources
• data project sources & processes
• data contributed by third parties
• data inferred from data already in database
• Need to record each source
• including licence made available for reuse
• including information about processing
117. Due Diligence
• Need certainty for reusers
• Where did addresses originate?
• in initial database
• through subsequent additions
• Is there any validation?
• if so against what?
119. Calculating Certainty
• More or less certainty about data
• Supporting information
• using known localities / streets
• other addresses on same street
• location of contributor
• Bayesian network?
122. Sources of Addresses
• Land Registry
• Companies House
• National Social Housing Register (NROSH)
• NHS – GP surgeries, hospitals etc
• Lists of schools
• Government department asset lists
• Scottish gazetteers (are they really open?)
8 August 2014 Open Addresses Symposium 122
123. Sources of Spatial Information
• Ordnance Survey:
– Codepoint Open
– OS Locator
– OS Gazetteer
– Street view
– Named places, settlement seeds, DLUA boundaries, parishes.
• ONS
– ONSPD Postcode directory
– Built up areas.
– Census boundaries.
• Land Registry
– Cadestral Polygons (dispute about whether they are open)
• DfT
– National Public Transport Gazetteer.
8 August 2014 Open Addresses Symposium 123
124. Proposal
• Build a street and places gazetteer, to which address points (PAON and
SAON) may be attached.
• Use spatial data to verify veracity of loaded data from open sources.
• Apply confidence score to each record based on:
– Spatial integrity
– Frequency of appearance within and across sources.
• Towns and localities inferred by filling gaps.
• Street layout analysis:
– Position of buildings by pixel analysis.
– Postcode to numbering: e.g. odds and evens
8 August 2014 Open Addresses Symposium 124
125. Pixel Analysis
• Overlay vector streets and postcode centroids on OS
StreetView
• Use in conjunction with OS locator for context and extent.
• Analyse pixel colour within buffer either side of road to
estimate buildings extent.
• Can be used to:
– Ensure veracity of other data
– Infill missing properties
– More accurately assign streets to postcodes
8 August 2014 Open Addresses Symposium 125
128. Maximising Available Data
• Using ONSPD, correcting postcodes where there
is an unambiguous coordinate match from a
terminated postcode to new one.
• Accounts for 50% of retired codes.
• Correcting misspellings by reference to
dictionaries using lexical analysis.
• Reference earlier versions of the data.
8 August 2014 Open Addresses Symposium 128
129. Source Audits
• Land Registry – Good quality, kept up to date,
few errors. Covers England and Wales.
• Companies House – Data quality issues,
particularly older companies. Covers UK.
• NROSH – Variable quality. Covers England
8 August 2014 Open Addresses Symposium 129
130. Prototype
• Contains all current GB postcodes.
• Streets added where possible.
• Localities added where possible.
• Corrects retired postcodes where possible.
• Shows nearest postcodes if not.
• Built from 4 sources, with gaps filled by inference.
8 August 2014 Open Addresses Symposium 130
132. Weaknesses
• Lack of addresses for Scotland
• Inference not always accurate due to:
– Non-vehicular streets
– Streets in close proximity
– Not all addresses have a street
– Address elements not unique at postcode sector
• Questions about openness of some data
8 August 2014 Open Addresses Symposium 132
133. Conclusion
• More study needed on veracity to:
– Understand issues in data.
– Ensure integrity of database.
– Make more accurate assumptions.
• Crowdsourcing:
– Same methods could be used to ensure veracity.
– Could be offered a free/low cost service to SMEs
• Lobbying for more data to be made open.
8 August 2014 Open Addresses Symposium 133
135. Building Gazetteer
• Existing open data
• from OS (& Royal Mail)
• from ONS
• Areas & indicative points
• OpenStreetMap
• would require share-alike licence
136. Getting Addresses
• General sources
• Land Registry price point data
• Companies House addresses
• Specific lists of
• NHS locations
• schools
• public buildings
• Inference
138. The BS7666 Approach to Structuring
Data
Rob Walker
BSI IST/36 Geographic information
138Rob Walker 2014-08-08
139. 139
What is BS 7666?
• A standard for gazetteers of geographic objects
• Defines a system of spatial references based upon
identifiable real-world locations
• Specifies gazetteers of commonly used location
types for spatial referencing
• Provides a structure for creating addresses
Rob Walker 2014-08-08
140. Overall purpose of BS 7666
• For defining common geo-referencing systems for
entities within scope
• Provides a standard way for identifying and defining
geographic entities
• Provides a way of sharing and accessing information
about the geographic entities
• Permits the creation of local datasets or gazetteers
• Enables the creation of national datasets or gazetteers
140Rob Walker 2014-08-08
141. Multi-part standard
• Part 0 – General model for gazetteers and spatial
referencing
• Part 1 – Specification for a street gazetteer
• Part 2 – Specification for a land and property
gazetteer
• Part 5 – Specification for a delivery point
gazetteer
141Rob Walker 2014-08-08
142. 142
Gazetteer
• Record of locations of particular type or types
with sufficient information to find and identify
each uniquely
• Does not contain detailed (attribute) data
about the objects themselves
Rob Walker 2014-08-08
143. Characteristics of a geographic object
Geographic
Object
Position Identification Classification
reference point
extent
descriptive location
name
reference number
object type
usage classification
Address
name/number
street
locality
town
country
143Rob Walker 2014-08-08
144. 144
Address
• Identifies a real-world location (addressable
object)
• Type of Land and Property Identifier (LPI)
• Provides a hierarchical structure of location types
• Uses commonly understood names
• Not routing instructions
• Different from a unique key
Rob Walker 2014-08-08
146. Scope - entities
Addressable object
Land and property identifier
Public
right
of way
Street
Basic land
and property
unit
Address
incorporates
covers
references
has
ofidentifies
identified by
Mandatory
Optional
Optional/mandatory
One-One
One-Many
referenced by
146Rob Walker 2014-08-08
147. 147
Structure of Land and Property
Gazetteer (Part 2)
• Scope
• Definition of terms
• Conceptual schema for land and property
• Conformance levels
• Gazetteer requirements
• BLPU identification, description and referencing
• Coordinate referencing
• Annex – Description of extents
• Annex – Data Quality Report
Rob Walker 2014-08-08
148. Issues beyond the Standard
• Guidelines for creation of data
• Property numbering and street naming
• Data quality
• Verification of conformance to specification
• Scope creep
• Ownership and access rights to data
Rob Walker 2014-08-08 148
149. Summary
• BS 7666 is a specification for gazetteers of geographic objects
• Particularly for Basic Land and Property Units (BLPUs)
• Applicable not just to occupied property
• Addressing system based on streets
• Address structure of:
– Secondary addressable object
– Primary addressable object
– Street
– Locality
– Town
– Administrative Area
149Rob Walker 2014-08-08
150. What is an Address?
• What should the scope be?
• Delivery points?
• Buildings?
• Households?
• Rooms?
153. Never mind the quality feel
the width?
Quality measures for a UK Open Address File
Prof Robert Barr OBE
Manchester Geomatics and The University of Liverpool
Expert member APPSI and ODUG
The SLA Forum - 8th August 2014 - ODI
157. Secrecy and Quality
• Proprietary data sets are seldom available for comprehensive quality
assurance
• Where data has been made available for cross matching, results
supressed
• Internal quality control measures neither documented nor auditable
• Customers seldom in a position to asses overall quality or fitness for
purpose
• As quality cannot be audited tested or checked there is little incentive
to improve it – will not increase sales only costs
159. Domain
• What is being addressed?
• Postal delivery points
• Dwellings
• Taxable hereditaments
• Buildings
• Infrastructure
• e.g:
• Electricity sub-stations
• Cashpoints
160. Completeness
• When % completeness is claimed, how independent is the measure of
the total number of addressable objects in the domain
• Duplication can exaggerate completeness while missing addresses
• Most likely to be achieved if:
• Address required for certain activities and it is generated if missing
• Public enabled and encouraged to identify missing addresses
161. Currency
• When is an address added and how soon does it appear in the public
file
• When is an address deleted / archived
• Most likely to be achieved if:
• Address required for certain activities and it is generated if missing
• Public enabled and encouraged to identify missing addresses
162. Positional Accuracy
• Does any geocode (Lat.Long or OSGR) correctly identify the addressed
object?
• Are numbered properties correctly identified, order on street and
side of street?
• Do locational attributes of address lie within the correct bounded
areas?
• Are any objects ambiguously addressed with multiple different
addresses?
• Are any objects that should be addressed missing?
163. Attribute Accuracy
• Address attributes such as residential non-residential flags need to be
correct
• Other address attributes such as the status of the position of the
address also need checking
164. Address Content Accuracy
• Is the right and correct information stored in each address field in the
database
• Does the address comply with published specifications for the file
• Does the address comply with relevant standards e.g. BS7666
166. Open Address Quality
• By releasing address intelligence on an open platform quality can be checked
and corrections made or suggested
• This works for OpenStreet Map
• Providing Open Access on a record by record basis from closed data sets, on a
single platform,would at least allow the evidence from each source to be
assessed
• Open Addressing will not create a high quality by itself, however if the major
maintainers and providers of address data made their data more open quality
could and would be independently assessed and willingness to correct could
be checked
167. Conclusions
• Addressing in the UK is NOT:
• Definitive
• Authoritative
• A Public Good
• Of measurable quality
• Fit for many specific purposes
• Used as widely as it could be
• Maintained cost effectively
WHY?
168. Conclusions
BECAUSE:
• Since 1979 the primary motivation for maintaining national address
files has been to make a profit or surplus through trading (often only
loosely related to costs)
• BIS (parts), The Treasury, Royal Mail PLC and the Public Data Group
appear to have won the argument in government.
• This is likely to be subject to a wide range of continuing challenges….
• One of which will be an Open Address File whose quality will be
publicly checked and openly assessed
170. Quality metrics
• Number of addresses
• Coverage
• what baseline can we use?
• estimate against census stats?
• check against Open Street Map?
• against Gazetteer?
• Who can measure & how often?
173. Correct Your Address
• Let people control their address
• new builds
• house names
• devotion to locality
• Let look-ups be up to date
• easing online sales means more
customers
174. Sustainability
• Core database open & free
• Some lookups open & free
• What can we charge for?
• service-level agreement?
• unlimited lookups?
• Sponsorship opportunities?
179. Next Steps
• We will write this up
• we hope you do too!
• tweet on #openaddresses
• Discovery Phase documentation
• mid September
• Alpha & beta approval
• during August
180. Get Involved
• Hiring for Open Addresses
• project lead
• independent Board members
• https://theodi.org/jobs
• Complete the survey
• tell us how you want to contribute