SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Downloaden Sie, um offline zu lesen
Content Import in
Drupal 7 Using Feeds
DrupalCamp Berlin, November 2014
About me• Jens Beltofte
• CTO, Denmark & Drupal Architect
• Propeople since 2003 / 2007
• Drupal since 2007
• Acquia Certified Drupal Developer
• Co-founder & Vice Chairman, Drupal Denmark
• d.o: beltofte
• @beltofte
Agenda• What is Feeds?
• Key components / concepts
• 3rd part plugins
• Feeds Tamper
• Client cases
• Demos
• Ressources
• Questions
What is Feeds?• Flexible solution for importing data
• Easy to setup imports in no time
• Multiple simultaneous configurations (importers)
• UI for granular mapping of source and target
• Manually or scheduled import
• Stand-alone or content type for import
What is Feeds?• Formats: RSS, ATOM, CSV, OPML
• Data types: nodes, users, taxonomy terms
• Ctools plugins
• Features support
• Hooks / API
Key components● Fetcher:
○ Download, load or receive feed from a source
○ Standard: HTTP + upload
● Parser
○ Parse fetched source data
○ Standard: RSS/Atom, CSV, OPML, XML Sitemap
● Processor
○ Process the parsed data and store it in the target data type
○ Standard: Node, User, Taxonomy term
3rd part plugins● Fetcher:
○ Directory Fecther
○ Feeds HTTPFetcher Append Headers
○ Feeds HTTPFetcher AA (Advanced Authentication)
○ SOAP/WDSL Fetcher
● Parser
○ Feeds XPath Parser
○ Feeds JSONPath Parser
○ Feeds extensible parsers (replace the two above)
● Processor
○ Commerce Feeds
○ Feeds Comment Processor
Feeds Tamper• Manipulate single fields before it is saved
• Examples:
○ Replace every instance of 'dog' with 'cat'.
○ Make every letter uppercase, lowercase, or capitalize every first letter.
○ Break a comma separated list of words into Taxonomy terms or a multivalued text field.
○ Combine separate 'firstname' and 'lastname' fields into one 'name' field.
○ Convert URL’s from relative to absolute.
• 20+ build in plugins for manipulation
• Custom tamper plugins using ctools
Client cases• Migration of nodes, files and taxonomy terms
• Import of departments and employees from local phone book.
• Import of events from external event system.
• Import of jobs / vacancies from HR system.
• Aggregation of multiple RSS feeds
Now demo time...
Ressources• Feeds: https://www.drupal.org/project/feeds
• Feeds XPath Parser: https://www.drupal.org/project/feeds_xpathparser
• Feeds JSONPath Parser: https://www.drupal.org/project/feeds_jsonpath_parser
• Feeds QueryPath Parser: https://www.drupal.org/project/feeds_querypath_parser
• Feeds Extensible Parsers: https://www.drupal.org/project/feeds_ex
• Feeds Tamper: https://www.drupal.org/project/feeds_tamper
• Documentation: https://www.drupal.org/node/622696
• 3rd part plugins: https://www.drupal.org/node/856644
Questions?

Weitere ähnliche Inhalte

Was ist angesagt?

JavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJSJavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJS
NLJUG
 

Was ist angesagt? (20)

Future of pandas
Future of pandasFuture of pandas
Future of pandas
 
Deep Dive on ArangoDB
Deep Dive on ArangoDBDeep Dive on ArangoDB
Deep Dive on ArangoDB
 
JavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJSJavaScript applicaties voor Enterprise met AngularJS
JavaScript applicaties voor Enterprise met AngularJS
 
How Apache Arrow and Parquet boost cross-language interoperability
How Apache Arrow and Parquet boost cross-language interoperabilityHow Apache Arrow and Parquet boost cross-language interoperability
How Apache Arrow and Parquet boost cross-language interoperability
 
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...
 
HDF Cloud: HDF5 at Scale
HDF Cloud: HDF5 at ScaleHDF Cloud: HDF5 at Scale
HDF Cloud: HDF5 at Scale
 
Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015
 
ACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data FramesACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data Frames
 
Apache Arrow - An Overview
Apache Arrow - An OverviewApache Arrow - An Overview
Apache Arrow - An Overview
 
Apache Arrow Flight: A New Gold Standard for Data Transport
Apache Arrow Flight: A New Gold Standard for Data TransportApache Arrow Flight: A New Gold Standard for Data Transport
Apache Arrow Flight: A New Gold Standard for Data Transport
 
HDF for the Cloud
HDF for the CloudHDF for the Cloud
HDF for the Cloud
 
Bleeding Edge Databases
Bleeding Edge DatabasesBleeding Edge Databases
Bleeding Edge Databases
 
Building a knowledge graph of the Belgian War Press
Building a knowledge graph of the Belgian War PressBuilding a knowledge graph of the Belgian War Press
Building a knowledge graph of the Belgian War Press
 
Knowledge graph
Knowledge graphKnowledge graph
Knowledge graph
 
Performance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4jPerformance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4j
 
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
Hello, Enterprise! Meet Presto. (Presto Boston Meetup 10062015)
 
Practical Use of a NoSQL Database
Practical Use of a NoSQL DatabasePractical Use of a NoSQL Database
Practical Use of a NoSQL Database
 
Big Data Certifications Workshop - 201711 - Introduction and Database Essentials
Big Data Certifications Workshop - 201711 - Introduction and Database EssentialsBig Data Certifications Workshop - 201711 - Introduction and Database Essentials
Big Data Certifications Workshop - 201711 - Introduction and Database Essentials
 
Strata NY 2017 Parquet Arrow roadmap
Strata NY 2017 Parquet Arrow roadmapStrata NY 2017 Parquet Arrow roadmap
Strata NY 2017 Parquet Arrow roadmap
 
SQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The MoveSQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The Move
 

Andere mochten auch

Slidshare
SlidshareSlidshare
Slidshare
kluay88
 
Nitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoilohNitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoiloh
Bor Baska
 
Again Life Italia Product Information
Again Life Italia Product InformationAgain Life Italia Product Information
Again Life Italia Product Information
rahm1290
 

Andere mochten auch (16)

Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
Shanghai big tradeshow calendar 2014 collection by MARKYE@LIERJIA.CN
 
AR
ARAR
AR
 
Clayesmore staff visit Italy
Clayesmore staff visit ItalyClayesmore staff visit Italy
Clayesmore staff visit Italy
 
Think Generic - Add API's To Your Custom Modules
Think Generic - Add API's To Your Custom ModulesThink Generic - Add API's To Your Custom Modules
Think Generic - Add API's To Your Custom Modules
 
Fmc china 2015 stand builder markye@lierjia.cn
Fmc china 2015 stand builder markye@lierjia.cn Fmc china 2015 stand builder markye@lierjia.cn
Fmc china 2015 stand builder markye@lierjia.cn
 
Slidshare
SlidshareSlidshare
Slidshare
 
Nitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoilohNitrat,nitrit todorhoiloh
Nitrat,nitrit todorhoiloh
 
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
Üniversite Yazılım Mühendisliği programları müfredatının SWEBOK kılavuzu kull...
 
Again Life Italia Product Information
Again Life Italia Product InformationAgain Life Italia Product Information
Again Life Italia Product Information
 
Wheat
WheatWheat
Wheat
 
Yimu exhibition services CHINA EXHIBITION CONTRACTOR
Yimu exhibition services   CHINA EXHIBITION CONTRACTORYimu exhibition services   CHINA EXHIBITION CONTRACTOR
Yimu exhibition services CHINA EXHIBITION CONTRACTOR
 
Design brief form from YiMu ExhibitS services
Design brief  form from YiMu ExhibitS servicesDesign brief  form from YiMu ExhibitS services
Design brief form from YiMu ExhibitS services
 
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
In Turkish: Yazılım Test-Kod Mühendisliği (YTKM): Kaliteli Test-Kodu Geliştir...
 
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...UML-Driven Software Performance Engineering: A systematic mapping and a revie...
UML-Driven Software Performance Engineering: A systematic mapping and a revie...
 
Sugar beet presentation
Sugar beet presentationSugar beet presentation
Sugar beet presentation
 
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...In English: Latest Trends in Software Engineering (Yazılım Mühendisliğinde S...
In English: Latest Trends in Software Engineering ( Yazılım Mühendisliğinde S...
 

Ähnlich wie Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds

Solr Recipes Workshop
Solr Recipes WorkshopSolr Recipes Workshop
Solr Recipes Workshop
Erik Hatcher
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
Tillmann Eitelberg
 
A Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's RoadmapA Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's Roadmap
Itai Yaffe
 

Ähnlich wie Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds (20)

How to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer CertificationHow to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer Certification
 
Solr Recipes Workshop
Solr Recipes WorkshopSolr Recipes Workshop
Solr Recipes Workshop
 
Building bridges - Plone Conference 2015 Bucharest
Building bridges   - Plone Conference 2015 BucharestBuilding bridges   - Plone Conference 2015 Bucharest
Building bridges - Plone Conference 2015 Bucharest
 
DITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
DITA Quick Start Webinar Series: Getting Started with the DITA Open ToolkitDITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
DITA Quick Start Webinar Series: Getting Started with the DITA Open Toolkit
 
Performing successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloudPerforming successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloud
 
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Apache Flume
Apache FlumeApache Flume
Apache Flume
 
Solving real world data problems with Jerakia
Solving real world data problems with JerakiaSolving real world data problems with Jerakia
Solving real world data problems with Jerakia
 
Web Services PHP Tutorial
Web Services PHP TutorialWeb Services PHP Tutorial
Web Services PHP Tutorial
 
Web Services Tutorial
Web Services TutorialWeb Services Tutorial
Web Services Tutorial
 
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stackAccelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
 
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
Solving Data Discovery Challenges at Lyft with Amundsen, an Open-source Metad...
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
 
Drupal 7 and SolR
Drupal 7 and SolRDrupal 7 and SolR
Drupal 7 and SolR
 
Data Onboarding Breakout Session
Data Onboarding Breakout SessionData Onboarding Breakout Session
Data Onboarding Breakout Session
 
QueryPath, Mash-ups, and Web Services
QueryPath, Mash-ups, and Web ServicesQueryPath, Mash-ups, and Web Services
QueryPath, Mash-ups, and Web Services
 
Web services tutorial
Web services tutorialWeb services tutorial
Web services tutorial
 
A Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's RoadmapA Day in the Life of a Druid Implementor and Druid's Roadmap
A Day in the Life of a Druid Implementor and Druid's Roadmap
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

Drupal Camp Berlin 2014 - Content Import in Drupal 7 Using Feeds

  • 1. Content Import in Drupal 7 Using Feeds DrupalCamp Berlin, November 2014
  • 2. About me• Jens Beltofte • CTO, Denmark & Drupal Architect • Propeople since 2003 / 2007 • Drupal since 2007 • Acquia Certified Drupal Developer • Co-founder & Vice Chairman, Drupal Denmark • d.o: beltofte • @beltofte
  • 3. Agenda• What is Feeds? • Key components / concepts • 3rd part plugins • Feeds Tamper • Client cases • Demos • Ressources • Questions
  • 4. What is Feeds?• Flexible solution for importing data • Easy to setup imports in no time • Multiple simultaneous configurations (importers) • UI for granular mapping of source and target • Manually or scheduled import • Stand-alone or content type for import
  • 5. What is Feeds?• Formats: RSS, ATOM, CSV, OPML • Data types: nodes, users, taxonomy terms • Ctools plugins • Features support • Hooks / API
  • 6. Key components● Fetcher: ○ Download, load or receive feed from a source ○ Standard: HTTP + upload ● Parser ○ Parse fetched source data ○ Standard: RSS/Atom, CSV, OPML, XML Sitemap ● Processor ○ Process the parsed data and store it in the target data type ○ Standard: Node, User, Taxonomy term
  • 7. 3rd part plugins● Fetcher: ○ Directory Fecther ○ Feeds HTTPFetcher Append Headers ○ Feeds HTTPFetcher AA (Advanced Authentication) ○ SOAP/WDSL Fetcher ● Parser ○ Feeds XPath Parser ○ Feeds JSONPath Parser ○ Feeds extensible parsers (replace the two above) ● Processor ○ Commerce Feeds ○ Feeds Comment Processor
  • 8. Feeds Tamper• Manipulate single fields before it is saved • Examples: ○ Replace every instance of 'dog' with 'cat'. ○ Make every letter uppercase, lowercase, or capitalize every first letter. ○ Break a comma separated list of words into Taxonomy terms or a multivalued text field. ○ Combine separate 'firstname' and 'lastname' fields into one 'name' field. ○ Convert URL’s from relative to absolute. • 20+ build in plugins for manipulation • Custom tamper plugins using ctools
  • 9. Client cases• Migration of nodes, files and taxonomy terms • Import of departments and employees from local phone book. • Import of events from external event system. • Import of jobs / vacancies from HR system. • Aggregation of multiple RSS feeds
  • 11. Ressources• Feeds: https://www.drupal.org/project/feeds • Feeds XPath Parser: https://www.drupal.org/project/feeds_xpathparser • Feeds JSONPath Parser: https://www.drupal.org/project/feeds_jsonpath_parser • Feeds QueryPath Parser: https://www.drupal.org/project/feeds_querypath_parser • Feeds Extensible Parsers: https://www.drupal.org/project/feeds_ex • Feeds Tamper: https://www.drupal.org/project/feeds_tamper • Documentation: https://www.drupal.org/node/622696 • 3rd part plugins: https://www.drupal.org/node/856644