Parse Weather Data from Any Site with Ruby and Hpricot
•
2 gefällt mir•1,547 views
The document discusses using the Ruby programming language and tools like Hpricot and XPath to parse HTML documents, highlighting how Hpricot can be used to easily extract information like country names and URLs from a weather website that has a poorly structured table layout. Steps provided include inspecting the site with Firebug to get element XPaths and then parsing the HTML using Hpricot to retrieve the desired data.
Empfohlen
Weitere ähnliche Inhalte
Ähnlich wie Parse Weather Data from Any Site with Ruby and Hpricot
Ähnlich wie Parse Weather Data from Any Site with Ruby and Hpricot (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Parse Weather Data from Any Site with Ruby and Hpricot
- 1. Linux Creative Group Hpricot – Dig The Impossible With Ruby By: Subhransu Behera arya.subhransu@gmail.com
- 3. So … Let’s See ! • Dynamic • Easy to Learn • Easy to maintain and grow • Convenient Short‐Cuts Ex: Str = “Linux Crea=ve Group” Str_join = Str.split(“ “).join(“+”) • Transparent, code faster • Few Syntax Errors, Fewer Bugs • It’s Fun
- 4. Ruby Gems • Package Management System for Ruby Applica=ons and Libraries • Resolve Dependencies. • Provides Central Repository of SoUware. • One Command Rules: ‐ gem install <gem_name> • Can Have your Own Local Gem Server ‐ gem install <gem_name> ‐‐source <gem_server_ip_and_port>
- 5. Hpricot makes it easy to Parse
- 6. Hpricot • Pull informa=on from virtually any website. • Search by Element ID, Tags, CSS Selectors. • Parse HTML including broken HTML • Update HTML • Use this data anywhere and anyway you want! • Parse by XPath for directly parsing an element. • Let’s see …. How it works.
- 7. Let’s Parse A Badly Designed Site !! • h^p://www.worldweather.org • It’s a site that provides weather informa=on for different loca=ons across the globe. • In the main page they have a badly nested table structure !! • An ideal Web‐Developer could have put them nicely in divs with meaningful IDs. • But let’s face the truth and parse the Country Names and their URLs.
- 8. Easy Steps – 1. Open The Site
- 9. Easy Steps – 2. Inspect With Firebug
- 10. Easy Steps – 3. Copy X-Path of the Element
- 11. Easy Steps – 4. Parse By X- Path Using Hpricot
- 12. Use some Logic & You’ll Get
- 13. Just Try it Out Questions?
- 14. References • Ruby Programming Language: h^p:// www.ruby‐lang.org/en/ • Hpricot: h^p://code.whytheluckys=ff.net/ hpricot/ • X‐Path: h^p://en.wikipedia.org/wiki/XPath • Firebug: h^p://gecirebug.com/
- 15. Thanks