SlideShare a Scribd company logo
1 of 16
Download to read offline
iRail and open data
            @pietercolpaert




Hack democracy
5 minutes
●   Scraping
●   The law
●   Project problems
Why?
Really no other option?
DON'T wait
     ●   For big forms to be filled in
     ●   For officials to respond


     DON'T talk too much about your ideas



     DO
A Lot Of Laws
Different explanations for scraping
●   Legal: «show data, differently» (~Browser)
●   +/-: «already public data»
●   Illegal: «steal data»
Public transport: iRail
●   Second database law
    ●   Result of activity = no copyright



●   Others don't agree?
    ●   iRail vzw/asbl/npo supports you!
But!

Who cares
about laws?
Web2.0: If people like it



             It's okay!




Just be awesome
Design problems
So much choice!
●   Java servlets
●   PHP
●   Perl
●   Python
●   ...
?
●   Limit dirtiness?
●   How modular?
●   Reusability?
Help each other!
●   API
    ●   one time job
    ●   Open source
        –   Everyone helps fixing
●   Patch «the» system!
Conclusion
●   SCRAPE
    ●   When no other possibility
●   WORK
    ●   Together!
●   QUICK & DIRTY
    ●   But clean it up
Q&A


@pietercolpaert
Project.iRail.be

Github.com/iRail

More Related Content

What's hot

What's hot (17)

The One Way
The One WayThe One Way
The One Way
 
Besut Kode Challenge 1
Besut Kode Challenge 1Besut Kode Challenge 1
Besut Kode Challenge 1
 
VirtualJUG24 - Testing with Spock: The logical choice
VirtualJUG24 - Testing with Spock: The logical choiceVirtualJUG24 - Testing with Spock: The logical choice
VirtualJUG24 - Testing with Spock: The logical choice
 
Besut Kode - Workshop 1
Besut Kode - Workshop 1Besut Kode - Workshop 1
Besut Kode - Workshop 1
 
The what, how and why of scaling git repositories
The what, how and why of scaling git repositoriesThe what, how and why of scaling git repositories
The what, how and why of scaling git repositories
 
Nordic Testing Days - Tallinn 2017 - Test your Java applications with Spock
Nordic Testing Days - Tallinn 2017 - Test your Java applications with SpockNordic Testing Days - Tallinn 2017 - Test your Java applications with Spock
Nordic Testing Days - Tallinn 2017 - Test your Java applications with Spock
 
Code:Nation Tech Stack
Code:Nation Tech StackCode:Nation Tech Stack
Code:Nation Tech Stack
 
Towards a Commons RDF Java library
Towards a Commons RDF Java libraryTowards a Commons RDF Java library
Towards a Commons RDF Java library
 
Operational MongoDB
Operational MongoDBOperational MongoDB
Operational MongoDB
 
First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016
First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016
First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016
 
London Java Community 2016 - Testing with Spock: The logical choice
London Java Community 2016 - Testing with Spock: The logical choiceLondon Java Community 2016 - Testing with Spock: The logical choice
London Java Community 2016 - Testing with Spock: The logical choice
 
XOHW19 @ NECSTLab
XOHW19 @ NECSTLabXOHW19 @ NECSTLab
XOHW19 @ NECSTLab
 
HandsOn: git (or version control in general...)
HandsOn: git (or version control in general...)HandsOn: git (or version control in general...)
HandsOn: git (or version control in general...)
 
Ready, set, go! An introduction to the Go programming language
Ready, set, go! An introduction to the Go programming languageReady, set, go! An introduction to the Go programming language
Ready, set, go! An introduction to the Go programming language
 
MongoDB at LAHacks :)
MongoDB at LAHacks :)MongoDB at LAHacks :)
MongoDB at LAHacks :)
 
ADDO 2019: Looking back at over 10 years of Devops
ADDO 2019:    Looking back at over 10 years of DevopsADDO 2019:    Looking back at over 10 years of Devops
ADDO 2019: Looking back at over 10 years of Devops
 
Pravin s glibc-unicode_and_cldr
Pravin s glibc-unicode_and_cldrPravin s glibc-unicode_and_cldr
Pravin s glibc-unicode_and_cldr
 

Viewers also liked (13)

Happy exit to 2011
Happy exit to 2011Happy exit to 2011
Happy exit to 2011
 
Umysl sprzedawcy
Umysl sprzedawcyUmysl sprzedawcy
Umysl sprzedawcy
 
Akupresura w-praktyce
Akupresura w-praktyceAkupresura w-praktyce
Akupresura w-praktyce
 
Кригер Амалия 2В
 Кригер Амалия 2В Кригер Амалия 2В
Кригер Амалия 2В
 
Родительский лекторий
Родительский лекторийРодительский лекторий
Родительский лекторий
 
Conte abans d'anar a dormir 1
Conte abans d'anar a dormir 1Conte abans d'anar a dormir 1
Conte abans d'anar a dormir 1
 
Open and close forms
Open and close formsOpen and close forms
Open and close forms
 
Models by Percent Discount
Models by Percent DiscountModels by Percent Discount
Models by Percent Discount
 
NBS corporate brochure
NBS corporate brochureNBS corporate brochure
NBS corporate brochure
 
7TH ST A102 APR.29.16 Z
7TH ST A102 APR.29.16 Z7TH ST A102 APR.29.16 Z
7TH ST A102 APR.29.16 Z
 
Sertifikat - Recruitment & Selection
Sertifikat - Recruitment & SelectionSertifikat - Recruitment & Selection
Sertifikat - Recruitment & Selection
 
Quantum vacation broucher
Quantum vacation broucherQuantum vacation broucher
Quantum vacation broucher
 
MGT 255-2 Group 1 Amazon's CSR Paper
MGT 255-2 Group 1 Amazon's CSR PaperMGT 255-2 Group 1 Amazon's CSR Paper
MGT 255-2 Group 1 Amazon's CSR Paper
 

Similar to iRail at hack democracy

Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerpApps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
Jonathan Carter
 
Open Source Secret Sauce - Lugor Sep 2011
Open Source Secret Sauce - Lugor Sep 2011Open Source Secret Sauce - Lugor Sep 2011
Open Source Secret Sauce - Lugor Sep 2011
Ted Husted
 

Similar to iRail at hack democracy (20)

Python in Industry
Python in IndustryPython in Industry
Python in Industry
 
Ploneide
PloneidePloneide
Ploneide
 
Introduce Python
Introduce PythonIntroduce Python
Introduce Python
 
Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerpApps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp
 
Python For All | Software Professionals, QA & DevOps professionals
Python For All | Software Professionals, QA & DevOps professionalsPython For All | Software Professionals, QA & DevOps professionals
Python For All | Software Professionals, QA & DevOps professionals
 
Python for All
Python for All Python for All
Python for All
 
Introduction to Idem for Microsoft Azure
Introduction to Idem for Microsoft AzureIntroduction to Idem for Microsoft Azure
Introduction to Idem for Microsoft Azure
 
برنامه نویسی بات تلگرام در پایتون
برنامه نویسی بات تلگرام در پایتونبرنامه نویسی بات تلگرام در پایتون
برنامه نویسی بات تلگرام در پایتون
 
Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)
Build, deploy and scale: Django, GraphQL and SPA  (DjangoCon EU 2021)Build, deploy and scale: Django, GraphQL and SPA  (DjangoCon EU 2021)
Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)
 
Zope is dead - Long live Zope
Zope is dead - Long live ZopeZope is dead - Long live Zope
Zope is dead - Long live Zope
 
Teaching Open Source In The University
Teaching Open Source In The UniversityTeaching Open Source In The University
Teaching Open Source In The University
 
Advantages of Python Learning | Why Python
Advantages of Python Learning | Why PythonAdvantages of Python Learning | Why Python
Advantages of Python Learning | Why Python
 
Comingle Arse 2014
Comingle   Arse 2014Comingle   Arse 2014
Comingle Arse 2014
 
Techhub Riga - tm 27.07
Techhub Riga - tm  27.07Techhub Riga - tm  27.07
Techhub Riga - tm 27.07
 
Mixing Plone and Django for explosive results
Mixing Plone and Django for explosive resultsMixing Plone and Django for explosive results
Mixing Plone and Django for explosive results
 
Open source, What | Why | How
Open source, What | Why | How Open source, What | Why | How
Open source, What | Why | How
 
Os hardware meets os software
Os hardware meets os softwareOs hardware meets os software
Os hardware meets os software
 
Open Source Secret Sauce - Lugor Sep 2011
Open Source Secret Sauce - Lugor Sep 2011Open Source Secret Sauce - Lugor Sep 2011
Open Source Secret Sauce - Lugor Sep 2011
 
OSDC 2016 | Another 7 tools for your #devops stack by Kris Buytaert
OSDC 2016 | Another 7 tools for your #devops stack by Kris BuytaertOSDC 2016 | Another 7 tools for your #devops stack by Kris Buytaert
OSDC 2016 | Another 7 tools for your #devops stack by Kris Buytaert
 
Introduction to Open Data and Data Science
Introduction to Open Data and Data ScienceIntroduction to Open Data and Data Science
Introduction to Open Data and Data Science
 

More from Pieter Colpaert

Open transport workshop intro slides
Open transport workshop   intro slidesOpen transport workshop   intro slides
Open transport workshop intro slides
Pieter Colpaert
 
Apps For Flanders at Random Hacks of Kindness
Apps For Flanders at Random Hacks of KindnessApps For Flanders at Random Hacks of Kindness
Apps For Flanders at Random Hacks of Kindness
Pieter Colpaert
 
V-ICT-OR Shopt IT - OKFN Belgium
V-ICT-OR Shopt IT - OKFN BelgiumV-ICT-OR Shopt IT - OKFN Belgium
V-ICT-OR Shopt IT - OKFN Belgium
Pieter Colpaert
 
The DataTank at ogdcamp Warsaw
The DataTank at ogdcamp WarsawThe DataTank at ogdcamp Warsaw
The DataTank at ogdcamp Warsaw
Pieter Colpaert
 

More from Pieter Colpaert (19)

Open transport workshop intro slides
Open transport workshop   intro slidesOpen transport workshop   intro slides
Open transport workshop intro slides
 
Situation of open data in Flanders
Situation of open data in FlandersSituation of open data in Flanders
Situation of open data in Flanders
 
iRail general info
iRail general infoiRail general info
iRail general info
 
iRail: History & current issues
iRail: History & current issuesiRail: History & current issues
iRail: History & current issues
 
Project management at iRail Summer of code
Project management at iRail Summer of codeProject management at iRail Summer of code
Project management at iRail Summer of code
 
Apps For Flanders
Apps For FlandersApps For Flanders
Apps For Flanders
 
[Okfn] sncf
[Okfn] sncf[Okfn] sncf
[Okfn] sncf
 
Apps For Flanders at Random Hacks of Kindness
Apps For Flanders at Random Hacks of KindnessApps For Flanders at Random Hacks of Kindness
Apps For Flanders at Random Hacks of Kindness
 
V-ICT-OR Shopt IT - OKFN Belgium
V-ICT-OR Shopt IT - OKFN BelgiumV-ICT-OR Shopt IT - OKFN Belgium
V-ICT-OR Shopt IT - OKFN Belgium
 
Verdediging masterproef
Verdediging masterproefVerdediging masterproef
Verdediging masterproef
 
The DataTank @ weblinks barcamp
The DataTank @ weblinks barcampThe DataTank @ weblinks barcamp
The DataTank @ weblinks barcamp
 
Creatic
CreaticCreatic
Creatic
 
The DataTank at ogdcamp Warsaw
The DataTank at ogdcamp WarsawThe DataTank at ogdcamp Warsaw
The DataTank at ogdcamp Warsaw
 
iRail summer of code
iRail summer of codeiRail summer of code
iRail summer of code
 
Open data with public transport at GentM
Open data with public transport at GentMOpen data with public transport at GentM
Open data with public transport at GentM
 
iRail fosdem
iRail fosdemiRail fosdem
iRail fosdem
 
iRail meetup
iRail meetupiRail meetup
iRail meetup
 
Bash 4
Bash 4Bash 4
Bash 4
 
Free culture
Free cultureFree culture
Free culture
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Recently uploaded (20)

Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 

iRail at hack democracy