SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
Migration Practice

                              October 26, 2011
                                Boston, MA
Wednesday, October 26, 2011
Moshe Weitzman

         •    1st core patch in 2001
         •    1st USA developer
         •    #1 contributor on Ohloh.
              Rank 11 on CTR
         •    Drush, Devel, Organic
              Groups,
         •    groups.drupal.org founder


Wednesday, October 26, 2011
Mike Ryan

         •    Lead engineer
         •    Drupal dev since 2005
         •    Pathauto module
         •    Migrate module
         •    CTR score of 8.




Wednesday, October 26, 2011
Clients




Wednesday, October 26, 2011
Data migration fears

            High risk
            Lots of manual work
            Always goes over budget
            Full of gotchas and bad surprises
            Not a reusable investment
            Lots of downtime during cutover
            I’ll get fired if we fail

Wednesday, October 26, 2011
Methodology
         ✓ Client is heavily engaged from the beginning.
         ✓ Client has web app for monitoring progress.
         ✓ Show early results, and frequent progress.
         ✓ Completely scripted. No manual steps. No surprises.
         ✓ Migrate module is already battle tested.
         ✓ Incremental migrations. Drupal lags by only 5 minutes.


                              Goal: Confidence
Wednesday, October 26, 2011
Migrate Module
         •    A Drush application written by Cyrve.
         •    Only enterprise grade migration tool for Drupal.
         •    Robust - many site changes don’t affect migration
         •    Fully code driven. No config in DB. Easy to deploy.
         •    UI for clients and developers to collaborate.
               •    Shows not yet dispositioned source data.
               •    Shows progress for any un-progress import.


Wednesday, October 26, 2011
Import Flow
                   Fetch               Map             Munge Save      Log


                         id   name   source   drupal                source drupal
                        11    sue    name     uname                  11      33
                        22    fred   email     mail                  22      44
                        44    alan
<xml>




Wednesday, October 26, 2011
Intimate with data sources
         • DB: mysql, postgres, mssql, oracle
         • Formats: csv, xml, json
         • Local sources or remote web services
         • See Migrate/plugins for example code


Wednesday, October 26, 2011
Build Drupal content types
    and fields
         •    Forum post
         •    User profile
         •    Community (an Organic group)
         •    Tutorial
         •    Reference document
         •    Announcement
         •    Image, Video, Audio
Wednesday, October 26, 2011
Write migration classes

         •    A class for each import. The guts of the code.
               •    Defines a fetch SQL query (or media file path, ...)
               •    Mapping source column to Drupal field
               •    Dependency declaration (Y must run before X)
               •    Hooks for data massaging
               •    Hooks for referenced item creation
               •    Kick off any post-import routines

Wednesday, October 26, 2011
Import and rollback
         •    Can choose one migration or all.
         •    Can limit import to N records or specific records.
         •    Maintains a map between source and destination IDs.
         •    Error reporting and logging.
         •    Facilitates the import/rollback/code/re-import loop.
         •    Reports throughput and % complete.
         •    XHProf integration for speed and memory optimization.
         •    Developer or sysadmin can perform imports.
Wednesday, October 26, 2011
Go Live

              Client has been reviewing Drupal site for weeks.
              Drupal site gets tweaked and improved until ...
              Client is satisfied - point load balancer to Drupal.
                    No major data migration. We are always synched.
              Champagne.




Wednesday, October 26, 2011
Success with Acquia
         ✓ We have never failed. Nobody gets fired ☺

         ✓ Extremely experienced in Drupal and Migration.
         ✓ We achieve high confidence and comfort via:
               ✓ Highly repeatable process.
               ✓ Data is constantly synched. Easy to evaluate new site.
               ✓ Client is continously involved and informed.



Wednesday, October 26, 2011

Weitere ähnliche Inhalte

Ähnlich wie Migrating Social Content to Drupal

GT Logiciel Libre - Convention Systematic 2011
GT Logiciel Libre - Convention Systematic 2011GT Logiciel Libre - Convention Systematic 2011
GT Logiciel Libre - Convention Systematic 2011
Stefane Fermigier
 
No sql now2011_review_of_adhoc_architectures
No sql now2011_review_of_adhoc_architecturesNo sql now2011_review_of_adhoc_architectures
No sql now2011_review_of_adhoc_architectures
Nicholas Goodman
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
Tillmann Eitelberg
 

Ähnlich wie Migrating Social Content to Drupal (20)

Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015
 
Data Pipelines with Python - NWA TechFest 2017
Data Pipelines with Python - NWA TechFest 2017Data Pipelines with Python - NWA TechFest 2017
Data Pipelines with Python - NWA TechFest 2017
 
PaaSTA: Running applications at Yelp
PaaSTA: Running applications at YelpPaaSTA: Running applications at Yelp
PaaSTA: Running applications at Yelp
 
GT Logiciel Libre - Convention Systematic 2011
GT Logiciel Libre - Convention Systematic 2011GT Logiciel Libre - Convention Systematic 2011
GT Logiciel Libre - Convention Systematic 2011
 
Drupal 8 introduction
Drupal 8 introductionDrupal 8 introduction
Drupal 8 introduction
 
DevOps and the DBA- 24 Hours of Pass
DevOps and the DBA-  24 Hours of PassDevOps and the DBA-  24 Hours of Pass
DevOps and the DBA- 24 Hours of Pass
 
Drupal and Devops , the Survey Results
Drupal and Devops , the Survey ResultsDrupal and Devops , the Survey Results
Drupal and Devops , the Survey Results
 
DevQAOps - Surviving in a DevOps World
DevQAOps - Surviving in a DevOps WorldDevQAOps - Surviving in a DevOps World
DevQAOps - Surviving in a DevOps World
 
No sql now2011_review_of_adhoc_architectures
No sql now2011_review_of_adhoc_architecturesNo sql now2011_review_of_adhoc_architectures
No sql now2011_review_of_adhoc_architectures
 
SQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsightSQL Server Konferenz 2014 - SSIS & HDInsight
SQL Server Konferenz 2014 - SSIS & HDInsight
 
Performing successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloudPerforming successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloud
 
Future of Sysadmin 2014
Future of Sysadmin 2014Future of Sysadmin 2014
Future of Sysadmin 2014
 
EBSCO Digital Transformation with AWS
EBSCO Digital Transformation with AWS EBSCO Digital Transformation with AWS
EBSCO Digital Transformation with AWS
 
Dremio introduction
Dremio introductionDremio introduction
Dremio introduction
 
Iwmn architecture
Iwmn architectureIwmn architecture
Iwmn architecture
 
DevOps tools for winning agility
DevOps tools for winning agilityDevOps tools for winning agility
DevOps tools for winning agility
 
Demystifying Containerization Principles for Data Scientists
Demystifying Containerization Principles for Data ScientistsDemystifying Containerization Principles for Data Scientists
Demystifying Containerization Principles for Data Scientists
 
[HKDUG] #20151017 - BarCamp 2015 - Drupal 8 is Coming! Are You Ready?
[HKDUG] #20151017 - BarCamp 2015 - Drupal 8 is Coming! Are You Ready?[HKDUG] #20151017 - BarCamp 2015 - Drupal 8 is Coming! Are You Ready?
[HKDUG] #20151017 - BarCamp 2015 - Drupal 8 is Coming! Are You Ready?
 
Top 10 dev ops tools (1)
Top 10 dev ops tools (1)Top 10 dev ops tools (1)
Top 10 dev ops tools (1)
 
Introduction to Drupal 7
Introduction to Drupal 7Introduction to Drupal 7
Introduction to Drupal 7
 

Mehr von Acquia

Taking Your Multi-Site Management at Scale to the Next Level
Taking Your Multi-Site Management at Scale to the Next LevelTaking Your Multi-Site Management at Scale to the Next Level
Taking Your Multi-Site Management at Scale to the Next Level
Acquia
 

Mehr von Acquia (20)

Acquia_Adcetera Webinar_Marketing Automation.pdf
Acquia_Adcetera Webinar_Marketing Automation.pdfAcquia_Adcetera Webinar_Marketing Automation.pdf
Acquia_Adcetera Webinar_Marketing Automation.pdf
 
Acquia Webinar Deck - 9_13 .pdf
Acquia Webinar Deck - 9_13 .pdfAcquia Webinar Deck - 9_13 .pdf
Acquia Webinar Deck - 9_13 .pdf
 
Taking Your Multi-Site Management at Scale to the Next Level
Taking Your Multi-Site Management at Scale to the Next LevelTaking Your Multi-Site Management at Scale to the Next Level
Taking Your Multi-Site Management at Scale to the Next Level
 
CDP for Retail Webinar with Appnovation - Q2 2022.pdf
CDP for Retail Webinar with Appnovation - Q2 2022.pdfCDP for Retail Webinar with Appnovation - Q2 2022.pdf
CDP for Retail Webinar with Appnovation - Q2 2022.pdf
 
May Partner Bootcamp 2022
May Partner Bootcamp 2022May Partner Bootcamp 2022
May Partner Bootcamp 2022
 
April Partner Bootcamp 2022
April Partner Bootcamp 2022April Partner Bootcamp 2022
April Partner Bootcamp 2022
 
How to Unify Brand Experience: A Hootsuite Story
How to Unify Brand Experience: A Hootsuite Story How to Unify Brand Experience: A Hootsuite Story
How to Unify Brand Experience: A Hootsuite Story
 
Using Personas to Guide DAM Results: How Life Time Pumped Up Their UX and CX
Using Personas to Guide DAM Results: How Life Time Pumped Up Their UX and CXUsing Personas to Guide DAM Results: How Life Time Pumped Up Their UX and CX
Using Personas to Guide DAM Results: How Life Time Pumped Up Their UX and CX
 
Improve Code Quality and Time to Market: 100% Cloud-Based Development Workflow
Improve Code Quality and Time to Market: 100% Cloud-Based Development WorkflowImprove Code Quality and Time to Market: 100% Cloud-Based Development Workflow
Improve Code Quality and Time to Market: 100% Cloud-Based Development Workflow
 
September Partner Bootcamp
September Partner BootcampSeptember Partner Bootcamp
September Partner Bootcamp
 
August partner bootcamp
August partner bootcampAugust partner bootcamp
August partner bootcamp
 
July 2021 Partner Bootcamp
July  2021 Partner BootcampJuly  2021 Partner Bootcamp
July 2021 Partner Bootcamp
 
May Partner Bootcamp
May Partner BootcampMay Partner Bootcamp
May Partner Bootcamp
 
DRUPAL 7 END OF LIFE IS NEAR - MIGRATE TO DRUPAL 9 FAST AND EASY
DRUPAL 7 END OF LIFE IS NEAR - MIGRATE TO DRUPAL 9 FAST AND EASYDRUPAL 7 END OF LIFE IS NEAR - MIGRATE TO DRUPAL 9 FAST AND EASY
DRUPAL 7 END OF LIFE IS NEAR - MIGRATE TO DRUPAL 9 FAST AND EASY
 
Work While You Sleep: The CMO’s Guide to a 24/7/365 Lead Machine
Work While You Sleep: The CMO’s Guide to a 24/7/365 Lead MachineWork While You Sleep: The CMO’s Guide to a 24/7/365 Lead Machine
Work While You Sleep: The CMO’s Guide to a 24/7/365 Lead Machine
 
Acquia webinar: Leveraging Drupal to Bury Your Sales Team In B2B Leads
Acquia webinar: Leveraging Drupal to Bury Your Sales Team In B2B LeadsAcquia webinar: Leveraging Drupal to Bury Your Sales Team In B2B Leads
Acquia webinar: Leveraging Drupal to Bury Your Sales Team In B2B Leads
 
April partner bootcamp deck cookieless future
April partner bootcamp deck  cookieless futureApril partner bootcamp deck  cookieless future
April partner bootcamp deck cookieless future
 
How to enhance cx through personalised, automated solutions
How to enhance cx through personalised, automated solutionsHow to enhance cx through personalised, automated solutions
How to enhance cx through personalised, automated solutions
 
DRUPAL MIGRATIONS AND DRUPAL 9 INNOVATION: HOW PAC-12 DELIVERED DIGITALLY FOR...
DRUPAL MIGRATIONS AND DRUPAL 9 INNOVATION: HOW PAC-12 DELIVERED DIGITALLY FOR...DRUPAL MIGRATIONS AND DRUPAL 9 INNOVATION: HOW PAC-12 DELIVERED DIGITALLY FOR...
DRUPAL MIGRATIONS AND DRUPAL 9 INNOVATION: HOW PAC-12 DELIVERED DIGITALLY FOR...
 
Customer Experience (CX): 3 Key Factors Shaping CX Redesign in 2021
Customer Experience (CX): 3 Key Factors Shaping CX Redesign in 2021Customer Experience (CX): 3 Key Factors Shaping CX Redesign in 2021
Customer Experience (CX): 3 Key Factors Shaping CX Redesign in 2021
 

Kürzlich hochgeladen

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Kürzlich hochgeladen (20)

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Migrating Social Content to Drupal

  • 1. Migration Practice October 26, 2011 Boston, MA Wednesday, October 26, 2011
  • 2. Moshe Weitzman • 1st core patch in 2001 • 1st USA developer • #1 contributor on Ohloh. Rank 11 on CTR • Drush, Devel, Organic Groups, • groups.drupal.org founder Wednesday, October 26, 2011
  • 3. Mike Ryan • Lead engineer • Drupal dev since 2005 • Pathauto module • Migrate module • CTR score of 8. Wednesday, October 26, 2011
  • 5. Data migration fears High risk Lots of manual work Always goes over budget Full of gotchas and bad surprises Not a reusable investment Lots of downtime during cutover I’ll get fired if we fail Wednesday, October 26, 2011
  • 6. Methodology ✓ Client is heavily engaged from the beginning. ✓ Client has web app for monitoring progress. ✓ Show early results, and frequent progress. ✓ Completely scripted. No manual steps. No surprises. ✓ Migrate module is already battle tested. ✓ Incremental migrations. Drupal lags by only 5 minutes. Goal: Confidence Wednesday, October 26, 2011
  • 7. Migrate Module • A Drush application written by Cyrve. • Only enterprise grade migration tool for Drupal. • Robust - many site changes don’t affect migration • Fully code driven. No config in DB. Easy to deploy. • UI for clients and developers to collaborate. • Shows not yet dispositioned source data. • Shows progress for any un-progress import. Wednesday, October 26, 2011
  • 8. Import Flow Fetch Map Munge Save Log id name source drupal source drupal 11 sue name uname 11 33 22 fred email mail 22 44 44 alan <xml> Wednesday, October 26, 2011
  • 9. Intimate with data sources • DB: mysql, postgres, mssql, oracle • Formats: csv, xml, json • Local sources or remote web services • See Migrate/plugins for example code Wednesday, October 26, 2011
  • 10. Build Drupal content types and fields • Forum post • User profile • Community (an Organic group) • Tutorial • Reference document • Announcement • Image, Video, Audio Wednesday, October 26, 2011
  • 11. Write migration classes • A class for each import. The guts of the code. • Defines a fetch SQL query (or media file path, ...) • Mapping source column to Drupal field • Dependency declaration (Y must run before X) • Hooks for data massaging • Hooks for referenced item creation • Kick off any post-import routines Wednesday, October 26, 2011
  • 12. Import and rollback • Can choose one migration or all. • Can limit import to N records or specific records. • Maintains a map between source and destination IDs. • Error reporting and logging. • Facilitates the import/rollback/code/re-import loop. • Reports throughput and % complete. • XHProf integration for speed and memory optimization. • Developer or sysadmin can perform imports. Wednesday, October 26, 2011
  • 13. Go Live Client has been reviewing Drupal site for weeks. Drupal site gets tweaked and improved until ... Client is satisfied - point load balancer to Drupal. No major data migration. We are always synched. Champagne. Wednesday, October 26, 2011
  • 14. Success with Acquia ✓ We have never failed. Nobody gets fired ☺ ✓ Extremely experienced in Drupal and Migration. ✓ We achieve high confidence and comfort via: ✓ Highly repeatable process. ✓ Data is constantly synched. Easy to evaluate new site. ✓ Client is continously involved and informed. Wednesday, October 26, 2011