- Analysing Irish Water survey data using the Attribute Exploder and the Null Attribute Replacer - Writing out Litter Quantity Survey data with the new Excel Writer [2015] - Emailing with Python Caller - Drive Time analysis with Network Cost Calculator and OSi Prime 2 data - Look at the SharePoint Reader and Writer

1. Analysing, Writing, Emailing,
Sharing FME does it all
Jon Hawkins
GIS Projects, Waterford City and County Council

2. Content
 Analysing Irish Water survey data using the
Attribute Exploder and the Null Attribute Replacer
 Writing out Litter Quantity Survey data with the
new Excel Writer [2015]
 Emailing with Python Caller
 Drive Time analysis with Network Cost Calculator
and OSi Prime 2 data
 Look at the SharePoint Reader and Writer

3. 34 Local
Authorities
2013
Analysing Survey Data
Water
Services
Transition
Office

4. Analysing Survey Data
 9 Themes covering Assets, IT, Facilities, HR,
Finance, Health & Safety, Legal
 Each theme had a questionnaire
 Fact Finding Summary 42+ questions
 Individual items 20+ forms
 WSTO charged with
 Coordinating the circulation and collection
 Initial review / validation of questionnaires
 Checking associated documents uploaded
 Transfer to Irish Water Programme

5. Analysing Survey Data
 What they wanted us to analyse
 WSTO said “no, have you never heard of FME”
 After some late nights and a lot of lobbying we
finalised on this

6. Analysing Survey Data
 After multiple versions I ended up with 53 control
workspaces
 Produced Compliance Reports, National
Summaries, National Data, Files Uploaded
Reports etc…
 And after all this the two transformers I found
and grew to love, were the Null Attribute
Replacer and the Attribute Exploder

7. Null Attribute Replacer and
Attribute Exploder
 Over 5 months of work in 2013, I learnt I could
go from testing each attribute in turn. With 100’s
of individual tester transformers

8. Null Attribute Replacer and
Attribute Exploder
 To 2 transformers and 1 tester

9. Excel Writer [2015]
 Litter Quantity Survey
 National surveys, Waterford City and
County undertake about 200 a year
 Paper based survey carried out by field
staff
 Administration staff then input survey
information into a fixed excel template
 ArcGIS Collector and FME to the rescue

10. Excel Writer [2015] – Old Way
Data Entry into excelPaper Form

11. Excel Writer [2015] – New Way
Excel XLSXW2 WriterArcGIS Collector

12. Excel Writer [2015]
 Use a template
 Don’t output Field Names
 Set column position
 Expose row_id & use lookup
 Update cells don’t insert

13. Excel Writer [2015]
 Demo

14. Emailing with Python Caller
[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole
example which I downloaded from safe.com in 2011]
 Use to send summary
emails using a
ListBuilder
 With a
ListElementCounter

15. Emailing with Python Caller
[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole
example which I downloaded from safe.com in 2011]
 And PythonCaller

16. Emailing with Python Caller
[With thanks to Andy Bates, City Of Armadale, WA, Australia, for his Bore Hole
example which I downloaded from safe.com in 2011]
 Settings
 Control frequency and who gets what when,
with a Scheduler and some testers
 Quick demo

17. NetworkCostCalculator
[thank you safe.com]
 Further to a national request to all Fire Services,
FME and OSi Prime 2 were used in house to
calculate response times for our Fire Stations.
Sorry Mr Consultant
 GDF2 layer used as source for network.
 Data prepared by removing impassable roads,
PathSplitter, ArcStroker and snapper

18. NetworkCostCalculator
[thank you safe.com]

19.  Demo
NetworkCostCalculator
[thank you safe.com]

20. SharePoint Reader and Writer
 A lot of databases and spreadsheets are starting
to be maintained in SharePoint lists rather than
excel and access
 SharePoint does use SQL and can be accessed
using file explorer, but good luck finding your
data and trying to write to folder locations

21. SharePoint Reader
 Lots of potential for
reading
 Current limitations
 Can’t expose views
 Can’t read lookups

22. SharePoint Writer
 Lots of potential for
writing and sharing
data
 Current limitations
 Speed [but could
be our set up]
 Unable to Truncate

23. Thank You!
 Questions?
 For more information:
 Jon Hawkins jhawkins@waterfordcouncil.ie
 Resources
 See safe.com for DriveTime: Search Calculating
emergency response travel times