Automating Google Workspace (GWS) & more with Apps Script
Containers for sensor web services, applications and research @ Sensor Web Conference, Münster
1. Containers for Sensor Web Services,
Applications and Research
Aug 30, 2016 @ Geospatial Sensor Webs Conference, Münster, Germany
Daniel Nüst, University of Münster, daniel.nuest@uni-muenster.de
7. Open access
Open access to data
Open access to data and procedures
Reproducibility platforms (identification/citation/credit, viewing, and downloading)
Meta-publications (Nature, Nature Geosciences, Science, …)
Motivation: Open Science
https://openaccessbutton.org/
Missing for reproducibility of computational research:
access to and archival of runtime environments
8. To cut to the chase...
Who of you can reproduce a scientific analysis
conducted 5 years ago today?
Who of you is sure she can start a multi-service
demonstrator of a research project that was
finished today in 5 years?
13. Executable Research Compendium
Docker logo courtesy of Docker Inc.; Trafic lights Bluemix via Wikimedia Commons; crowbar by Delapouite via game-icons.net; zipper by RRZEIcons,
cursor by Subhashish Panigrahi, via Wikimedia Commons;
16. 52°North Helgoland
$ docker run -p 80:8080
52north/helgoland
http://172.17.0.2:8080/#/
$ docker run -p 80:80
geocontainers/52n-helgoland
http://localhost/#/
Differences: BRANCH env var, nginx
vs. node, git clone during build (Hub)
17. 52°North SOS
Whole (!) Dockerfile based on Debian (unsimplified)
FROM tomcat:9
WORKDIR /tmp
RUN curl -L -o sos-bundle.zip http://../491-52n-sensorweb-sos-bundle-4-3-7
RUN unzip -d sos-bundle sos-bundle.zip
RUN cp sos-bundle/*.war $CATALINA_HOME/webapps/52n-sos-webapp.war
RUN rm -r *
Command to run image based on Alpine
$ docker run --rm -p 80:8080 geocontainers/52n-sos-alpine
# http://localhost/52n-sos-webapp/
docker-compose configuration (SOS + PostGIS DB)
18. 52°North SOS on Docker Cloud with AWS EC2
”1 Minute Deployment”
19. Docker for Geospatial Projects
https://wiki.osgeo.org/wiki/DockerImages
http://geocontainers.org
20. Docker for Geospatial Sensor Webs
We need to catch up with mainstream IT
Collaborate more effectively (prod/dev/research)
Spread software more easily and more DevOps friendly by
bringing down requirements to 1 software and installation to 1
command
Quickly (re) create dev, demo, test, production (customer!)
environments
Effective deployment of the latest software thin your own
infrastructure or in the cloud
http://simpleicon.com/money-7.html
21. Docker for Geospatial Sensor Webs - How?
1. Use it! You admins won’t mind. Your work will be easier.
2. Provide and share (!) images and docker-compose files
for popular services on Docker Hub (52°North is getting
started)
https://github.com/Geonovum/smartemission/tree/master/docker/sos52n
3. Keep in mind during implementation (e.g. configurability)
4. Add getting services cloud ready + scalable prominently
to all funding efforts
5. Experiment with desktop apps
https://wiki.52north.org/Documentation/Docker
https://hub.docker.com/u/52north/
22. Thanks for your attention!
What are your questions?
http://o2r.info/almost
http://o2r.info @o2r_project daniel.nuest@wwu.de
@nordholmen
Hinweis der Redaktion
The pets and cattle metaphor has come up in a few conversations lately and we mention it because it seems a useful way to think about IT operations. We'll even have a go at extending it by saying cattle get to live in a far-off bit barn.
The presentation is also worth a look as it details that CERN is a KVM and Hyper-V shop, with OpenStack employed to manage its pets and a herd of about 15,000 virtual machines. That it has chosen OpenStack for that server-wrangling job, on top of IBM's recent declaration of large-scale affection for the project, is surely not happy news for outfits like VMware that consider themselves ideal carers for large numbers of pets.
http://www.theregister.co.uk/2013/03/18/servers_pets_or_cattle_cern/
via http://www.tigertech.de/ein-docker-container-und-deine-anwendung-laeuft-ueberall/
Die Macher von Docker haben sich gedacht, daß es ja wohl nicht sein kann, daß die Menschheit mittlerweile Waren in jeglicher Form an jeglichen Ort der Welt verschiffen kann, aber die IT-Welt es immer noch nicht hinkriegt, problemlos eine Anwendung von einem Kontext in den nächsten zu portieren. In Anlehnung an diese Allegorie wurde 2013 der Docker-Container erfunden. Ebenso wie ein großer Schiffscontainer ein einheitliches (seit 1956 nach ISO-Norm standardisiertes) Format hat, das gleichermaßen von Schiffen und LKWs transportiert und gestapelt werden kann und mit beliebigem Inhalt zu befüllen ist, ist der Docker-Container dafür zuständig, eine Anwendung beliebiger Art so in sich zu kapseln, daß der Container alle Kontextinformationen übernimmt und sich problemlos in verschiedene Umgebungen verschieben lässt.
STATE OF THE ART
We think that the major technical building block exist
https://www.docker.com/what-docker
Where are we on the reproducibility spectrum?
Standards
Software
Research workflow & analysis software journal software, archival software, … Interactive execution of ERC
Infrastructure
DFG-funded
2.75 researcher positions for 24 months (with goal to extend +36 months)
http://o2r.info @o2r_project
Team (a-z): Jim Jones, Stephanie Klötgen, Markus Konkol, Christian Kray, Dirk Kussmann, Jörg Lorenz, Daniel Nüst, Edzer Pebesma, Holger Przibytzin, Marc Schutzeichel