SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post)  Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions  http://pipes.yahoo.com
Example mashup
convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System  (HTML + CSS  + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google  FusionTables Query (XML) CSV Picture Australia data
Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
Yahoo Pipes
JSON { "count" : 1,     "value" : {         "title" : "ConvictIDGet",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717",         "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "convictid" : "200",             "name" : "Frederick Beadle",             "one_of" : "one of 296 convicts transported on the Pyrenees",             "convicted" : "Central Criminal Court",             "term_duration" : "10 years",             "conviction_date" : "",             "notes" : "Ticket of Leave.",             "vessel" : "Pyrenees",             "departure_date" : "31 January 1853",             "destination" : "Western Australia",             "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)",             "surname" : "Beadle",             "given_names" : "Frederick",             "y:row" : "2",             "description" : null,             "title" : null         }] }} Tip: Use http://jsonlint.com/ to  validate and format JSON
JSON for Trove People query {     "count" : 1,     "value" : {         "title" : "TrovePeople",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5",         "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "xmlns" : "http:www.loc.govzingsrw",             "version" : "1.1",             "numberOfRecords" : "265",             "resultSetId" : "kc2umf",             "resultSetIdleTime" : "300",             "records”:  {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm",  "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}},  "recordPosition" : "1” },  … }]}}
Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;             outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"                + record.title   + "</a></li>";         });         $('#output').html(outputHTML);      }); }); $(document).ready(function(){ findPeople(‘Lawson’);  }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data

Weitere ähnliche Inhalte

Was ist angesagt?

زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِDr. GM Sherbini
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsDirk Roorda
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi NotesSirajRock
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16Akhil Bharat Mahasabha
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for printsnehalcnp
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12snehalcnp
 

Was ist angesagt? (10)

Bachelor Diploma.PDF
Bachelor Diploma.PDFBachelor Diploma.PDF
Bachelor Diploma.PDF
 
Aap manifesto delhi power
Aap manifesto delhi powerAap manifesto delhi power
Aap manifesto delhi power
 
زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِ
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, Lessons
 
Apn log
Apn logApn log
Apn log
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi Notes
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for print
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12
 
TRB323_023-RR
TRB323_023-RRTRB323_023-RR
TRB323_023-RR
 

Ähnlich wie Using Yahoo Pipes to access web data in 40 chars or less

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQueryDoncho Minkov
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.PubYohei Sasaki
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorialmikel_maron
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Tatsuhiko Miyagawa
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1Fabien Gandon
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feedsMatt Harris
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?Andrej Koelewijn
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)Joel Lord
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)MongoSF
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)Joel Lord
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the webJorge Zapico
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”dhammasociety
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesAmbles Kwok
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4Dimitris Psounis
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Mark Wubben
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedDan Theurer
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lightingRolandSyntens
 

Ähnlich wie Using Yahoo Pipes to access web data in 40 chars or less (20)

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQuery
 
JSON Viewer XPATH Workbook
JSON Viewer XPATH WorkbookJSON Viewer XPATH Workbook
JSON Viewer XPATH Workbook
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.Pub
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorial
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feeds
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the web
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search Engines
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy Applied
 
Yahoo - Open Applied
Yahoo - Open AppliedYahoo - Open Applied
Yahoo - Open Applied
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lighting
 
HTML5 Web Forms
HTML5 Web FormsHTML5 Web Forms
HTML5 Web Forms
 

Mehr von Anna Gerber

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) IntroAnna Gerber
 
How the Web works
How the Web worksHow the Web works
How the Web worksAnna Gerber
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robotAnna Gerber
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" expressAnna Gerber
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAnna Gerber
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action HeroesAnna Gerber
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action HeroesAnna Gerber
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)Anna Gerber
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript RoboticsAnna Gerber
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in PythonAnna Gerber
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Anna Gerber
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationAnna Gerber
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationAnna Gerber
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Anna Gerber
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Anna Gerber
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisationAnna Gerber
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnna Gerber
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove APIAnna Gerber
 

Mehr von Anna Gerber (20)

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) Intro
 
How the Web works
How the Web worksHow the Web works
How the Web works
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robot
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" express
 
Iot 101
Iot 101Iot 101
Iot 101
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action Heroes
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action Heroes
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action Heroes
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript Robotics
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in Python
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly Annotation
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly Annotation
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisation
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly Editing
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove API
 
Intro to Java
Intro to JavaIntro to Java
Intro to Java
 

Kürzlich hochgeladen

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 

Kürzlich hochgeladen (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 

Using Yahoo Pipes to access web data in 40 chars or less

  • 1. Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
  • 2. Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post) Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions http://pipes.yahoo.com
  • 4.
  • 5. convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System (HTML + CSS + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google FusionTables Query (XML) CSV Picture Australia data
  • 6. Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
  • 8.
  • 9. JSON { "count" : 1, "value" : { "title" : "ConvictIDGet", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717", "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "convictid" : "200", "name" : "Frederick Beadle", "one_of" : "one of 296 convicts transported on the Pyrenees", "convicted" : "Central Criminal Court", "term_duration" : "10 years", "conviction_date" : "", "notes" : "Ticket of Leave.", "vessel" : "Pyrenees", "departure_date" : "31 January 1853", "destination" : "Western Australia", "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)", "surname" : "Beadle", "given_names" : "Frederick", "y:row" : "2", "description" : null, "title" : null }] }} Tip: Use http://jsonlint.com/ to validate and format JSON
  • 10. JSON for Trove People query { "count" : 1, "value" : { "title" : "TrovePeople", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5", "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "xmlns" : "http:www.loc.govzingsrw", "version" : "1.1", "numberOfRecords" : "265", "resultSetId" : "kc2umf", "resultSetIdleTime" : "300", "records”: {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm", "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}}, "recordPosition" : "1” }, … }]}}
  • 11. Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;            outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"               + record.title   + "</a></li>";         });         $('#output').html(outputHTML);     }); }); $(document).ready(function(){ findPeople(‘Lawson’); }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data