This presentation provides an overview how CQ was implemented at ESO. It reviews the approaches and concepts that were chosen, making sure that all operational and authors’ requirements were satisfied, and how it was achieved to have an implementation and rollout of CQ5 in only three months. Also, the presentation will provide an overview of the architecture of the Day CQ system at ESO and its marriage with pre-CQ system.
Rein Warmels, Astronomer & Christina Garcia de Juan, Management Consultant, European Southern Observatory
2. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 2
@ ESO
ESO
Overview
• Headquarters in Garching/Munich. Observatories in Chile:
Paranal, La Silla, Chajnantor and …?
• Budget 160 M Euro per year.
• Personnel ~720 Staff (International and Local)
• Foremost intergovernmental astronomy organization in
Europe and the world s most productive astronomical
observatory.
• Supported by Austria, Belgium, the Czech Republic,
Denmark, Finland, France, Germany, Italy, the
Netherlands, Portugal, Spain, Sweden, Switzerland and
the United Kingdom.
ESO, the European Southern Observatory, builds and
operates a suite of the world's most advanced ground-
based astronomical telescopes
3. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 3
@ ESO
Sites and
Locations
5. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 5
@ ESO
Core
Activities
Operations – Development – Science
• 3 + 4++ Telescopes
• 3 + 12++ Instruments
• Data Calibration
• Quality Control
• Instrument Monitoring
• Maintenance
• Development and Upgrades
Service Observing Telescopes and Instruments
• In Garching and at
the Observatories
• 1,800 Proposals per year
• 1,000 Observing Runs p/y
• Currently 65 TBytes
• Growth rate 15 Tbytes p/y
• After 2013 150 TBytes
per year
• 10,000 data requests per year
Observing
User Support
Archive Operations –
Virtual Observatory
6. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 6
@ ESO
ESO Web
Operations
Statistics (www.eso.org only):
• 1 Gbps incoming, 300 Mbps outgoing; Backbone 10 Gbps
• 30+ servers, mostly Dell Blades (Linux), VMware virtual
servers
• 50+ Web sites
• ~ 80 IP addresses for Web related servers
• Pages
• > 100,000 HTML pages
• > 10,000 pdf files
• Visits:
• ~ 50,000,000 hits/month
• ~ 5,000,000 page views/month
• Transfer > ~ 1 Pbytes/year (excl. Science Archive)
7. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 7
@ ESO
CQ Project
Goals
Replace the old authoring and publishing procedures
and systems.
Migrate the content from the old system to CQ
Explore and Install
CQ functionalities to
substantially ease
authoring.
System, User
and Content
Management
overheads
Easy to Use
(non-technical staff)
Enforce standards
Support Efforts
Reduce
ESO Common Look and Feel
Central Control
Content Structure
Syndication and Synergies
Bind Scripts and Applications
Reorganize
and streamline
8. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 8
@ ESO
Initial
Conditions • Large fraction of content
operations critical
• Maintenance intense
• High Support needs
• Competing development
activities in the Organization
Operations and Maintenance
• Static and dynamic
• HTML, PHP
• Perl, Java, Shell, Javascript,
…
• Small (and rather) CMS
Solutions
• Propriety and home-build
applications
• Different formats and
layouts
• Images, images, images,
images, … videos, pdfs, …
Content and Assets
• No CQ Knowledge
• Limited manpower
• Many delays in the past:
Loss of credit and authors
confidence
WoMen Power and Knowledge
9. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 9
@ ESO
Constraints
Budget limitations = Hw/Sw Limitations
Without DAM License
Without Clustering
2 Instances
10. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 10
@ ESO
Boundary
Conditions Limited Budget – Limited Staffing
No interruption of critical
operations and services (Observing!)
Continue operations, maintenance
and support of old system
Moderate changes of content structure
TIME
11. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 11
@ ESO
Approaches
& Methods
• Basic Project/Implementation Plan
• No large documentation efforts: TWiki-based
• Rapid Prototyping – Continuous testing on users
• Split the migration in packages
Be Pragmatic
• Short communication lines
• Regular meetings
(Project Team, Steering Committee, Users)
• Make future authors/users part of the project
Communications
Philosophy
12. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 12
@ ESO
Project
Organisation
Project Steering
Committee
• Chairperson
• Stakeholders
WoManPower
User/Authors
• Testers
• Validation
Project Team (4)
• Architecture
• Design
• Development
• Migration
• Testing
• Administration
• Training
• Support
• Management
13. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 13
@ ESO
Project
Stages
Phase I
Getting Started
• Project Organization
• Stakeholders Meetings
(Project Board)
• Basic Project Plan
• Basic Risk Analysis
• Authors Demonstration
Phase II
Analysis
• Architecture Analysis
• CQ Architectural Design
• Layout and Content
Analysis
• Review Authors
Requirements
14. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 14
@ ESO
ESO Agile
Approach
Architecture Vision
Architecture Agreement
PHP App. and CQ5 Live together
CQ5
PHP
PHP
PHP
PHP
15. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 15
@ ESO
Internet Users Intranet Users
Load Balancer
Publish Side
PHP
COLD/StandBy
16. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 16
@ ESO
Project
Stages
Phase III
Proto-typing
• Hardware and
Software Configuration
(Production / Testing)
• Development Component
and Templates
• Prototype Look
and Feel
• Demonstrations
and Feedback
Phase IV
Migration I – N
• Clearly defined content
• Well defined in
time and efforts
• Tailored migration script
and development efforts
• User Interaction!
17. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 17
@ ESO
Migration
18. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 18
@ ESO
Migration
Process
Content
Analysis
Migration
Validation
Deployment
Development
Old System
Training
Users
19. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 19
@ ESO
Migration Iterative Cycle - 3 Months
• Content Analysis and Migration Package Definition
• Migration Package Tuning
• Creation of mirrors (curl commands)
• Automated Migration: Parsing HTML
and mapping site structures
• Agreement: migration in 95% of the site
content to Rich Text Edit Component
• Risk: Performance on client side
• Quality Check
• Training and additional Support
• Configuration and Performance Check
• Deployment
• Migration Package Going Live
20. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 20
@ ESO
Technical
Challenges
Handling with Links, Navigation and Sitemap
• Dispatcher and Load Balancer Configuration
(URL Mapping)
• Rewrite & Redirect Rules
• Vanity URLs
• "Blank" Pages on CQ side
Import of
Digital Assets
Activation Queues
after Migration
Performance
issues
Disable certain
DAM Workflow
instantiations
Process
improvement
and planning
Migration to CRX
2.1, Performance
Packages
21. Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 21
@ ESO
• CQ Installed, Hardware and Software configured
Fully operational and living in harmony with old system
• Implementation L&F and Styles completed
• Three Migration Packages released
• Demonstrations and Trainings provided, Support in place
Achievements and Status – Nine months
• Migration of small packages
• The Observatories (Chile)
• Inclusion of data bases (SQL)
• SSO and LDAP server implementation
Outlook
Conclusions