SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Your results from disk to device
Stream Encode Explore and Disseminate My Experiments
SeedMe name inspired by
Seed : proliferate and grow
National Science Foundation
This material is based upon work supported by the National Science
Foundation under Grant No. OCI-1235505
Acknowledgements
Kristen Levy, Mahidhar Tatineni, Michael Dwyer, Tom Hutton, & Doug Weimer, SDSC
Apple Inc. : Provided test hardware/software on loan during conceptualization phase
Team
Amit Chourasia
Mona Wong
David Nadeau
Andrew Ferbert
Michael Norman
Presentation Overview
• Situate context & define problem
• Introduce SeedMe
• Sample use cases
• Sample end user interaction
• Q & A
Computation Cycle
Compute/Ingest
Post Process
Analyze
Monitor
?
Validate
?
Abstract
?
Monitoring
Validation
Derived
Products
Abstraction
Direct Access
Direct Web
Sharing
Not All
Members
Have Access
----
Need Exact
Location +
Permissions
Inflexible
Security
Policy
Derived Products
(Preliminary Results)
(Transient Content)
Many customers
WebpageEmail
Download + Send
Scattered Results
Can’t share larger content
Manual
Download + Upload
Handle Privacy
Significant time commitment
Manual
Cloud Drive
Download + Upload
Cannot describe content
Manual
Sharing Derived Products
(Many customers)
Compute Anticipate React
Waterworld (1995)
Accessibility Irony
1993
“NCSA Mosaic, or
simply Mosaic, is the
web browser credited
with popularizing the
World Wide Web.”
Mosaic (Web browser), Wikipedia
http://en.wikipedia.org/wiki/Mosaic_(w
eb_browser)
1990
“The web was originally
conceived and developed
to meet the demand for
automatic information-
sharing between
scientists in universities
and institutes around the
world.”
The birth of the web. CERN
http://home.web.cern.ch/topics/birth-web
Mission Dashboard at NASA – JPL
Voyager space crafts have been sharing
information since 1977
2007
Mobile devices can
share content instantly
2014
Computation simulations cannot
share information with us
• No place to push information
(no infrastructure)
• Lack of easy tools
Pitfalls in sharing derived content
Download
Upload
Download
(Round Trip + 1)
Video
Encoding
Complexity
Missing Easy
Automation
How To
Describe &
Discuss
Content
Replication
&
Scalability
Why not use existing tools?
Your results from disk to device
SeedMe offers you to
• Seamlessly seed (upload) your research content
• Share and access your content
• Generate dashboards for your simulation or expt.
• Describe your content (everything is not a file)
• Discuss your work, right next to your content
Features and Benefits
Ubiquitous
Access your results anywhere on any device
Collaborate
Discuss & keep your colleagues updated with latest results at one spot
Near Real Time
Track progress from your simulation or instrument
Share and Reuse
Share your research results and reusable content widely
Sequence to Video
Convert sequence of images to videos at desired frame rate
Automate
Easily integrate your scripts, workflow or app using SeedMe tools
Security
All your communications with SeedMe are encrypted
Privacy
Control access to your content with private, group or public privileges
SeedMe Collection
Ticker
(Text)
Ephemeral
Sequences
(Image set)
Videos
(video)
Files
(Catch all)
Meta Data
(Title, Description, Tags, Key Value Pairs, Credits, License)
Privacy + Collaborators
(Public, Group, Private) + (emails)
Plots
(Image)
SeedMe: How it Works
Create
Collection
SignUp
1 2
Create
Collection
Web Browser Command Line or REST
(Automate scripts, workflow or app)
SignUp
1 2
Set
Metadata
Create
Collection
Set
Privacy &
Sharing
Upload
Content
Web Browser Command Line or REST
(Automate scripts, workflow or app)
SignUp
1 52 3 4
Set
Metadata
Create
Collection
Set
Privacy &
Sharing
Upload
Content
Update as
desired
Web Browser Command Line or REST
(Automate scripts, workflow or app)
SignUp
1 52 3 4
Set
Metadata
Create
Collection
Set
Privacy &
Sharing
Upload
Content
View or
Download
on Web
Update as
desired
Web Browser Command Line or REST
(Automate scripts, workflow or app)
SignUp
Phone or Tablet or Computer
(Web Browser)
1 52 3 4
SeedMe User Interactions
• Create Collection ( CLI, API, Web Browser)
• Update Collection ( CLI, API, Web Browser)
• View Collection (Web Browser only)
Hardware
Software
MySQL
Drupal
Apache
Gearman Scheduler
Web
nodes
Storage
Video
encoding
nodes
Responsive
Web Output
Desktops
Phones
Tablets
Ingestion
HTTPS
Web
Browser
REST
SeedMe Architecture
Network Switch 20 gbe20 gbe
SeedMe Processing
Ingestion
(Atomic or
Recurring)
Instant
Processing
(Text, Images)
Notification
Responsive
Content
Access
Batch
Processing
(Videos)
Use Case: Sequence to Video
Sequences of images are
generated by
Visualizations
Confocal scans
Time lapse recording
Requirements
Frame rate
High Quality Encoding
Universal playback
Automation
seedme.cmd -t “Seq Collection”  # Collection title
-sp "sample/sequences/steam"  # Seq Path
-st "sequence title"  # Seq Title
-sd "Desc of sequence"  # Seq Description
-sr "5"  # Seq frame Rate
-se # Trigger Seq Encode
Command line example, but you can upload content simply via Web Browser
Use Case: Create Dashboards
Results from simulations,
instruments, analysis
Files
Plots
Sequences
Videos
Requirements
Managed Sharing
Universal access
Automation
seedme.cmd -t “Quick Start”  # Collection title
-privacy group  # Privacy
-email nobody@sdsc.edu  # Share
-notify  # Notify (not automatic)
-pp "sample/plots/node.png"  # Plot Path
-sp "sample/sequences/steam"  # Seq Path
-vp "sample/videos/air.mp4"  # Video Path
-fp "sample/files/doc.pdf” # File Path
Command line example, but you can upload content simply via Web Browser
Use Case: Monitor
Computation state
Progress %
Progress parameters
Last file created
Requirements
Sharing
Universal access
Automation
seedme.cmd -t “Progress Tracking”  # Create new Collection
seedme.cmd -update 29643  # Update collection ID
-tic "step 1"  # Ticker Text
-tic "step 2"  # Ticker Text
-fp "sample/files/doc.pdf” # File Path
Command line example, but you can upload content simply via Web Browser
Use Case: Share & Reuse
Disseminate
Share and reuse content
IPython notebook
State files from vis tools
R scripts
Matlab scripts
Applications
Exploring :
‘Save to SeedMe’
Kepler Workflow
VisIt software
YT software
Integrate SeedMe Python Module or write your own REST client
Demo: Web Browser
Types of Collections: My Shared Public
http://www.seedme.org/collections
You may Add, Edit and Notify collaborators
Add a new collection
https://www.seedme.org/collections/add
View a collection with monitoring info
https://www.seedme.org/collection/14924
View a collection with variety of content
https://www.seedme.org/collection/16567
seedme.cmd -title "SeedMe Quick Start"
seedme.cmd -update 29643  # Update
-fp "sample/files/doc.pdf"  # File Path
-pp "sample/plots/node.png"  # Plot Path
-sp "sample/sequences/steam"  # Seq Dir
Path
-vp "sample/videos/air.mp4"  # Video Path
seedme.cmd -update 29643 
-privacy group 
-email abc@sdsc.edu 
-email xyz@sdsc.edu
seedme.cmd -update 29643 -notify
Demo: Command Line Interaction
Create a new
collection
Add image seq.
+ create video
from it
Setup sharing
Notify Group
Getting Started
Interaction
• Web Browser
• Standalone executable
(command line)
• Python module with API
(demo.py)
• Curl
Information
• Quick Start Guide
• Use Cases
• Documentation
• Tips for C, Fortran codes
• Blog
Signup / Share
http://www.seedme.org
Contact Us
amit sdsc.edu
https://www.seedme.org/contact
Twitter
@SeedmeOrg

Weitere ähnliche Inhalte

Andere mochten auch

Волонтерское движение
Волонтерское движениеВолонтерское движение
Волонтерское движениеvikaevp
 
доклад
докладдоклад
докладvikaevp
 
EXCELLENCE PROGRAM - Mars 2015
EXCELLENCE PROGRAM - Mars 2015EXCELLENCE PROGRAM - Mars 2015
EXCELLENCE PROGRAM - Mars 2015BVAMS
 
e-branding Fanta
e-branding Fantae-branding Fanta
e-branding Fantaposmktdig 4
 
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...Radar Información y Conocimiento
 
PMP Hult International Business School 031011
PMP Hult International Business School 031011PMP Hult International Business School 031011
PMP Hult International Business School 031011mplawless
 
Calendarios Navarrete 2015
Calendarios Navarrete 2015Calendarios Navarrete 2015
Calendarios Navarrete 2015Jesus Paipay
 
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...SCM Fussball
 
Reparar windows 7 si no arranca o falla
Reparar windows 7 si no arranca o fallaReparar windows 7 si no arranca o falla
Reparar windows 7 si no arranca o fallaCHOQUISOFT S.A.S
 
Orden meritoexec 2013
Orden meritoexec 2013Orden meritoexec 2013
Orden meritoexec 2013mariamedero
 
Plan estrategico de una empresa
Plan estrategico de una empresaPlan estrategico de una empresa
Plan estrategico de una empresaGabytorres20
 
Pequeño reporte de maquillaje artístico para halloween esther leon
Pequeño reporte de maquillaje artístico para halloween  esther leonPequeño reporte de maquillaje artístico para halloween  esther leon
Pequeño reporte de maquillaje artístico para halloween esther leonEsther Leon
 
Alan turing tercer evaluacion
Alan turing tercer evaluacionAlan turing tercer evaluacion
Alan turing tercer evaluacionnoelia_00
 
Clasificacion natacion 2011
Clasificacion natacion 2011Clasificacion natacion 2011
Clasificacion natacion 2011mandewind
 

Andere mochten auch (18)

Волонтерское движение
Волонтерское движениеВолонтерское движение
Волонтерское движение
 
доклад
докладдоклад
доклад
 
EXCELLENCE PROGRAM - Mars 2015
EXCELLENCE PROGRAM - Mars 2015EXCELLENCE PROGRAM - Mars 2015
EXCELLENCE PROGRAM - Mars 2015
 
e-branding Fanta
e-branding Fantae-branding Fanta
e-branding Fanta
 
Lecture 8-pom-full
Lecture 8-pom-fullLecture 8-pom-full
Lecture 8-pom-full
 
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...
Gobierno Abierto: Experiencias de Implementación. Casos de EEUU, Reino Unido,...
 
InstalacióN
InstalacióNInstalacióN
InstalacióN
 
PMP Hult International Business School 031011
PMP Hult International Business School 031011PMP Hult International Business School 031011
PMP Hult International Business School 031011
 
Sentencia 4.7.2013
Sentencia 4.7.2013Sentencia 4.7.2013
Sentencia 4.7.2013
 
Calendarios Navarrete 2015
Calendarios Navarrete 2015Calendarios Navarrete 2015
Calendarios Navarrete 2015
 
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...
Stadionecho 14. Spieltag Derby SC Melle 03 gegen SSC Dodesheide Landesliag We...
 
Reparar windows 7 si no arranca o falla
Reparar windows 7 si no arranca o fallaReparar windows 7 si no arranca o falla
Reparar windows 7 si no arranca o falla
 
Orden meritoexec 2013
Orden meritoexec 2013Orden meritoexec 2013
Orden meritoexec 2013
 
Plan estrategico de una empresa
Plan estrategico de una empresaPlan estrategico de una empresa
Plan estrategico de una empresa
 
Pequeño reporte de maquillaje artístico para halloween esther leon
Pequeño reporte de maquillaje artístico para halloween  esther leonPequeño reporte de maquillaje artístico para halloween  esther leon
Pequeño reporte de maquillaje artístico para halloween esther leon
 
Alan turing tercer evaluacion
Alan turing tercer evaluacionAlan turing tercer evaluacion
Alan turing tercer evaluacion
 
Clasificacion natacion 2011
Clasificacion natacion 2011Clasificacion natacion 2011
Clasificacion natacion 2011
 
Grampo na Internet Brasileira
Grampo na Internet BrasileiraGrampo na Internet Brasileira
Grampo na Internet Brasileira
 

Kürzlich hochgeladen

Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 

Kürzlich hochgeladen (20)

Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 

SeedMe Platform for Sharing Research Results

  • 1. Your results from disk to device Stream Encode Explore and Disseminate My Experiments SeedMe name inspired by Seed : proliferate and grow
  • 2. National Science Foundation This material is based upon work supported by the National Science Foundation under Grant No. OCI-1235505 Acknowledgements Kristen Levy, Mahidhar Tatineni, Michael Dwyer, Tom Hutton, & Doug Weimer, SDSC Apple Inc. : Provided test hardware/software on loan during conceptualization phase Team Amit Chourasia Mona Wong David Nadeau Andrew Ferbert Michael Norman
  • 3. Presentation Overview • Situate context & define problem • Introduce SeedMe • Sample use cases • Sample end user interaction • Q & A
  • 6. Direct Access Direct Web Sharing Not All Members Have Access ---- Need Exact Location + Permissions Inflexible Security Policy Derived Products (Preliminary Results) (Transient Content) Many customers
  • 7. WebpageEmail Download + Send Scattered Results Can’t share larger content Manual Download + Upload Handle Privacy Significant time commitment Manual Cloud Drive Download + Upload Cannot describe content Manual Sharing Derived Products (Many customers)
  • 9. Accessibility Irony 1993 “NCSA Mosaic, or simply Mosaic, is the web browser credited with popularizing the World Wide Web.” Mosaic (Web browser), Wikipedia http://en.wikipedia.org/wiki/Mosaic_(w eb_browser) 1990 “The web was originally conceived and developed to meet the demand for automatic information- sharing between scientists in universities and institutes around the world.” The birth of the web. CERN http://home.web.cern.ch/topics/birth-web Mission Dashboard at NASA – JPL Voyager space crafts have been sharing information since 1977 2007 Mobile devices can share content instantly 2014 Computation simulations cannot share information with us • No place to push information (no infrastructure) • Lack of easy tools
  • 10. Pitfalls in sharing derived content Download Upload Download (Round Trip + 1) Video Encoding Complexity Missing Easy Automation How To Describe & Discuss Content Replication & Scalability
  • 11. Why not use existing tools?
  • 12. Your results from disk to device SeedMe offers you to • Seamlessly seed (upload) your research content • Share and access your content • Generate dashboards for your simulation or expt. • Describe your content (everything is not a file) • Discuss your work, right next to your content Features and Benefits Ubiquitous Access your results anywhere on any device Collaborate Discuss & keep your colleagues updated with latest results at one spot Near Real Time Track progress from your simulation or instrument Share and Reuse Share your research results and reusable content widely Sequence to Video Convert sequence of images to videos at desired frame rate Automate Easily integrate your scripts, workflow or app using SeedMe tools Security All your communications with SeedMe are encrypted Privacy Control access to your content with private, group or public privileges
  • 13. SeedMe Collection Ticker (Text) Ephemeral Sequences (Image set) Videos (video) Files (Catch all) Meta Data (Title, Description, Tags, Key Value Pairs, Credits, License) Privacy + Collaborators (Public, Group, Private) + (emails) Plots (Image)
  • 14. SeedMe: How it Works Create Collection SignUp 1 2 Create Collection Web Browser Command Line or REST (Automate scripts, workflow or app) SignUp 1 2 Set Metadata Create Collection Set Privacy & Sharing Upload Content Web Browser Command Line or REST (Automate scripts, workflow or app) SignUp 1 52 3 4 Set Metadata Create Collection Set Privacy & Sharing Upload Content Update as desired Web Browser Command Line or REST (Automate scripts, workflow or app) SignUp 1 52 3 4 Set Metadata Create Collection Set Privacy & Sharing Upload Content View or Download on Web Update as desired Web Browser Command Line or REST (Automate scripts, workflow or app) SignUp Phone or Tablet or Computer (Web Browser) 1 52 3 4
  • 15. SeedMe User Interactions • Create Collection ( CLI, API, Web Browser) • Update Collection ( CLI, API, Web Browser) • View Collection (Web Browser only)
  • 17. SeedMe Processing Ingestion (Atomic or Recurring) Instant Processing (Text, Images) Notification Responsive Content Access Batch Processing (Videos)
  • 18. Use Case: Sequence to Video Sequences of images are generated by Visualizations Confocal scans Time lapse recording Requirements Frame rate High Quality Encoding Universal playback Automation seedme.cmd -t “Seq Collection” # Collection title -sp "sample/sequences/steam" # Seq Path -st "sequence title" # Seq Title -sd "Desc of sequence" # Seq Description -sr "5" # Seq frame Rate -se # Trigger Seq Encode Command line example, but you can upload content simply via Web Browser
  • 19. Use Case: Create Dashboards Results from simulations, instruments, analysis Files Plots Sequences Videos Requirements Managed Sharing Universal access Automation seedme.cmd -t “Quick Start” # Collection title -privacy group # Privacy -email nobody@sdsc.edu # Share -notify # Notify (not automatic) -pp "sample/plots/node.png" # Plot Path -sp "sample/sequences/steam" # Seq Path -vp "sample/videos/air.mp4" # Video Path -fp "sample/files/doc.pdf” # File Path Command line example, but you can upload content simply via Web Browser
  • 20. Use Case: Monitor Computation state Progress % Progress parameters Last file created Requirements Sharing Universal access Automation seedme.cmd -t “Progress Tracking” # Create new Collection seedme.cmd -update 29643 # Update collection ID -tic "step 1" # Ticker Text -tic "step 2" # Ticker Text -fp "sample/files/doc.pdf” # File Path Command line example, but you can upload content simply via Web Browser
  • 21. Use Case: Share & Reuse Disseminate Share and reuse content IPython notebook State files from vis tools R scripts Matlab scripts Applications Exploring : ‘Save to SeedMe’ Kepler Workflow VisIt software YT software Integrate SeedMe Python Module or write your own REST client
  • 22. Demo: Web Browser Types of Collections: My Shared Public http://www.seedme.org/collections You may Add, Edit and Notify collaborators Add a new collection https://www.seedme.org/collections/add View a collection with monitoring info https://www.seedme.org/collection/14924 View a collection with variety of content https://www.seedme.org/collection/16567
  • 23. seedme.cmd -title "SeedMe Quick Start" seedme.cmd -update 29643 # Update -fp "sample/files/doc.pdf" # File Path -pp "sample/plots/node.png" # Plot Path -sp "sample/sequences/steam" # Seq Dir Path -vp "sample/videos/air.mp4" # Video Path seedme.cmd -update 29643 -privacy group -email abc@sdsc.edu -email xyz@sdsc.edu seedme.cmd -update 29643 -notify Demo: Command Line Interaction Create a new collection Add image seq. + create video from it Setup sharing Notify Group
  • 24. Getting Started Interaction • Web Browser • Standalone executable (command line) • Python module with API (demo.py) • Curl Information • Quick Start Guide • Use Cases • Documentation • Tips for C, Fortran codes • Blog
  • 25. Signup / Share http://www.seedme.org Contact Us amit sdsc.edu https://www.seedme.org/contact Twitter @SeedmeOrg

Hinweis der Redaktion

  1. As must our research knowledge and content
  2. Each iteration in Computation cycle requires creation of succinct and consumable derived products
  3. Derived products are created by a single user? But usually we have more than one person interested in assessing the derived products
  4. Problems
  5. Problems
  6. What are pitfalls in sharing derived products currently Download/Upload: Manual operation (baby sit), Slow Network, Large Content Movie Encoding: Complex & Cumbersome Web Setup: Laborious and requires management Replication: For each instance and each group Scalable: from content perspective and ubiquity (desktop to smart phones) All this requires too much plumbing
  7. Existing tools are not really suitable for HPC research oriented needs
  8. New content in SeedMe is called Collection Metadata: All text, key/value pairs, tags, credits, expiration Ticker: ephemeral text stream like stocks or tweets. Example: simulation progress, simulation state, convergence Plots: Images, charts, documents Image sequences: set of images Movies