SlideShare a Scribd company logo
1 of 10
Download to read offline
Hector Quintero Casanova
       University of Edinburgh




Distributed Scientific Computing in
              Practice
Distributed Scientific Computing?

    Also known as e-Science.

    According to Dr. John Taylor, 2 dimensions:
      –   Global collaboration effort
            •   Cross-organisational effort demanded.
            •   Technical and formal differences are likely.

      –   Infrastructure that will enable it
            •   Middleware hides differences and complexities
            •   Aims at seamless instant access to resources
            •   Much like a utility. Hence, the grid.
Current state of affairs

    Shift to data: find hypothesis for a pattern
       –   Cosmology: dark flow in WMAP data.

    Emphasis depends on area of application:
       –   Astronomy: uniform data access
             •   Data and its correct annotation. E.g: VO

       –   Particle Physics: universal job submission
             •   Processing of jobs. E.g: JDL

       –   Biology: workflow.
             •   Research activity model-based. E.g: Myexperiment
Current state of affairs

    Differences in emphasis reflect on tools:
      –   Astronomy: analysis of data
            •   Multiple approaches ⇒ extensive user interaction.
      –   Biology: workflow design
            •   Decide order mainly ⇒ some user interaction.
      –   Particle Physics: job submission
            •   Define job and submit ⇒ minimal user interaction


    Scientific research is also conducted in arts:
      –   E-science also applied to them
            •   E-Dance project: annotation of coreography videos
Challenges: semantics

    Transition from annotation to semantics:
      –   Biology very advanced. E.g: Gene ontology
            •    Describe experimental models.
      –   In Astronomy not so easy despite rich meta-data
            •    Problems such as description of units.

    Semantics leading to over-standardisation?
      –   Not yet since scientists still play a big role.
      –   Common model of knowledge could limit
          creativity.
            •    Thinking processes shaped by common framework.
 Balance       between standardisation & flexibility
Challenges: politics

    Politics does affect scientific decisions:
       –   Astronomy: TAP protocol
             •   Compromise between US and UK.
             •   Each side implements the options it wants.
       –   In effect 2 flavours of TAP available:
             •   Organisations: which TAP to implement?
             •   Undermines standard access to data.
       –   Similar situation with CORBA ended in failure.

    Solution: avoid compromises. Hold things up?
 Balance:       standard's robustness vs. advancement
Challenges: collaboration

    Focus still on sharing and not on collaborating:
      –   Astronomy: uniform access to data
            •   Data can be shared.
            •   No platform to exchange views on that data.
      –   Exception: myexperiment. Caters only biologists.


    Also, targeted collaboration during development.
      –   Developers should actively engage with
          scientists.
      –   Example: evolution of EDIKT project.
EDIKT

    First, generic solutions that found applications
      –   Holistic approach to e-science problems.
            •   General solutions: BinX and Eldas.
            •   Specific applications: AstroBinX and BioDAS.

    Change: active engagement with would-be users.
      –   Regular talks involving developers & researchers
      –   Embedded developer: specific to research
          activity.

    Example: ECDF portal.
      –   Draws on experience with RAPID.
      –   Fidelity to scientists reqs: command-line look.
Future

    E-science just started: multi-disciplinary science
      –   New challenges cover wider areas of knowledge.
      –   Example: effects of climate change in migration
            •   Climate change complex already.
            •   Couple that with sociology and geography. Nice!

    Will push for more standards and collaboration
      –   Semantics would ease establishment of
          correlations.
      –   Example: social unrest and increase temperature.

    E-science begging for funding? Hope not.
¿?

More Related Content

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

E-Science: distributed scientific computing in practice.

  • 1. Hector Quintero Casanova University of Edinburgh Distributed Scientific Computing in Practice
  • 2. Distributed Scientific Computing?  Also known as e-Science.  According to Dr. John Taylor, 2 dimensions: – Global collaboration effort • Cross-organisational effort demanded. • Technical and formal differences are likely. – Infrastructure that will enable it • Middleware hides differences and complexities • Aims at seamless instant access to resources • Much like a utility. Hence, the grid.
  • 3. Current state of affairs  Shift to data: find hypothesis for a pattern – Cosmology: dark flow in WMAP data.  Emphasis depends on area of application: – Astronomy: uniform data access • Data and its correct annotation. E.g: VO – Particle Physics: universal job submission • Processing of jobs. E.g: JDL – Biology: workflow. • Research activity model-based. E.g: Myexperiment
  • 4. Current state of affairs  Differences in emphasis reflect on tools: – Astronomy: analysis of data • Multiple approaches ⇒ extensive user interaction. – Biology: workflow design • Decide order mainly ⇒ some user interaction. – Particle Physics: job submission • Define job and submit ⇒ minimal user interaction  Scientific research is also conducted in arts: – E-science also applied to them • E-Dance project: annotation of coreography videos
  • 5. Challenges: semantics  Transition from annotation to semantics: – Biology very advanced. E.g: Gene ontology • Describe experimental models. – In Astronomy not so easy despite rich meta-data • Problems such as description of units.  Semantics leading to over-standardisation? – Not yet since scientists still play a big role. – Common model of knowledge could limit creativity. • Thinking processes shaped by common framework.  Balance between standardisation & flexibility
  • 6. Challenges: politics  Politics does affect scientific decisions: – Astronomy: TAP protocol • Compromise between US and UK. • Each side implements the options it wants. – In effect 2 flavours of TAP available: • Organisations: which TAP to implement? • Undermines standard access to data. – Similar situation with CORBA ended in failure.  Solution: avoid compromises. Hold things up?  Balance: standard's robustness vs. advancement
  • 7. Challenges: collaboration  Focus still on sharing and not on collaborating: – Astronomy: uniform access to data • Data can be shared. • No platform to exchange views on that data. – Exception: myexperiment. Caters only biologists.  Also, targeted collaboration during development. – Developers should actively engage with scientists. – Example: evolution of EDIKT project.
  • 8. EDIKT  First, generic solutions that found applications – Holistic approach to e-science problems. • General solutions: BinX and Eldas. • Specific applications: AstroBinX and BioDAS.  Change: active engagement with would-be users. – Regular talks involving developers & researchers – Embedded developer: specific to research activity.  Example: ECDF portal. – Draws on experience with RAPID. – Fidelity to scientists reqs: command-line look.
  • 9. Future  E-science just started: multi-disciplinary science – New challenges cover wider areas of knowledge. – Example: effects of climate change in migration • Climate change complex already. • Couple that with sociology and geography. Nice!  Will push for more standards and collaboration – Semantics would ease establishment of correlations. – Example: social unrest and increase temperature.  E-science begging for funding? Hope not.
  • 10. ¿?