Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring

inside-BigData.com
inside-BigData.comPresident of insideHPC Media um inside-BigData.com
Biohybrid robotic jellyfish for future
applications in ocean monitoring
Nicole W. Xu, James Townsend, Jack Costello,
Sean Colin, John O. Dabiri
Stanford University
HPC-AI Stanford Conference
April 21, 2020
2
Nicole W. Xu
Stanford University
April 21, 2020
How much do we know about the ocean?
More than 80% of our ocean is unmapped,
unobserved, and unexplored.
3
Importance of ocean monitoring
Track changes in temperature, acidity, concentrations of nutrients
Discovery of new species or behaviors
National GeographicMBARI
Toby Hudson Greg Torda
Nudibranch
Coral Bleaching
Algal Blooms
Nicole W. Xu
Stanford University
April 21, 2020
4
Current methods of ocean monitoring
Remotely operated vehicles (ROVs) Autonomous underwater vehicles (AUVs)
Slocum Glider, AUVACRJE International
Challenges:
Costly
Bulky
High power consumption
Vehicle wakes
Yoda Productions
Nicole W. Xu
Stanford University
April 21, 2020
5
How can we expand ocean monitoring tools?
Nicole W. Xu
Stanford University
April 21, 2020
Goal: Use technology to collect data about ocean environments
Needs
Able to explore new locations
Minimal power
Minimal cost
Minimal disturbance to aquatic life
How we can achieve this: Combine technological advances,
experimental work, and computational tools
National Geographic
6
How can we expand ocean monitoring tools?
Nicole W. Xu
Stanford University
April 21, 2020
Goal: Use technology to collect data about ocean environments
Needs
Able to explore new locations
Minimal power
Minimal cost
Minimal disturbance to aquatic life
How we can achieve this: Combine technological advances,
experimental work, and computational tools
National Geographic
7
Bioinspired robots offer advantages
Energy-efficient, bioinspired aquatic vehicles that leave natural
wakes to minimize environmental disturbances
Collect images, data, samples from new locations
Tadesse et al., Smart Materials and Structures, 2012Katzschmann et al., Science Robotics, 2018 MantaDroid
Fish Manta ray Jellyfish
Nicole W. Xu
Stanford University
April 21, 2020
Which animal model do we choose?
8
Jellyfish as a model organism
Nicole W. Xu
Stanford University
Despite 500 million years of evolutionary pressure, the body
structure of moon jellyfish has remained largely unchanged.
Aurelia aurita
• Simple body structure
• Swimming is tied
into feeding, escape
behaviors, etc.
• Ubiquitous
5 cm
April 21, 2020
Nicole W. Xu
Stanford University
9
COT is a metric of energy efficiency
Opposite of mpg
COT =
Energy
Mass x Distance
April 21, 2020
Tesla
Nicole W. Xu
Stanford University
10
What can we learn from jellyfish?
Jellyfish have a low
cost of transport
compared to other
animals.
Jellyfish are energy
efficient.
Gemmell et al., PNAS, 2013
Flying
Running
Swimming
COT =
Energy
Mass x Distance
April 21, 2020
Spectrum of bioinspired jellyfish constructs
Nicole W. Xu
Stanford University
11
Nawroth et al, Nature Biotech, 2012
Biological
Construct
Limitation:
Survival in a
few specific
environments
Villanueva et al, PLoS ONE, 2014
Robotic
Construct
Limitation:
High power
consumption
April 21, 2020
12
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
April 21, 2020
13
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
14
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
Nicole W. Xu
Stanford University
Pacemakers: sensory organs that innervate the swim muscle
exumbrellar surface
(top)
subumbrellar surface
(underside)
5 cm
5 cm
15
Swim anatomy
April 21, 2020
Swim motion
Power stroke (active
contraction and thrust)
Recovery stroke
(passive relaxation and
feeding current)
All-or-nothing muscle
activation
Nicole W. Xu
Stanford University
16
5 cm
April 21, 2020
17
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
External control of swimming
Electrodes act as “artificial pacemakers” to activate the muscles.
18
V
t
Input(s):
Signal voltage
Signal pulse width
Signal period (inverse of frequency)
Electrode location on the bell
Output:
Pulses (tag displacement)
Nicole W. Xu
Stanford University
April 21, 2020
In-dish experiments
Nicole W. Xu
Stanford University
19
2.5 cm
April 21, 2020
Natural pulses
20
Nicole W. Xu
Stanford University
2.5 cm
April 21, 2020
TagDisplacement(pixels)
Natural vs. stimulated pulses
21
Nicole W. Xu
Stanford University
April 21, 2020
Natural
TagDisplacement(pixels)
TagDisplacement(pixels)
0.25 Hz
TagDisplacement(pixels)
2 Hz
TagDisplacement(pixels)
1 Hz
Frequency spectrum of natural pulses
22
Unstimulated cases, N = 12 animals
Natural motion includes a bout frequency
and successive pulses per bout (a spread between 0.4-1 Hz).
0.16 Hz
0.4-1 Hz
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Amplitude
TagDisplacement(pixels)
Example displacement, N = 1
Frequency spectrum of stimulated pulses
23
Stimulated at 1 Hz, N = 10 animals
1.02 Hz
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Amplitude
TagDisplacement(pixels)
Example displacement, N = 1
N = 10 N = 10 N = 10 N = 10 N = 10 N = 10 N = 9
Stimulated frequency response (0.25 – 2 Hz)
24
N = 10 animals
PowerSpectralDensity
Frequency Output (Hz)
Nicole W. Xu
Stanford University
Successful one-to-one response
Max pulse frequency according to a proposed bio limit (Bullock, J Cell Comp Physio, 1943)
Peak frequency of unstimulated animals (natural behavior)
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Successful frequency responses between 0.25 to 1 Hz
Electrode placement (1 Hz)
Where is the optimal location
for electrode placement?
Stomach
Midway
Pacemaker
Margin
Sensor placement will also
be relevant when we place
temperature/salinity/pH probes
on jellyfish in the ocean
Nicole W. Xu
Stanford University
25April 21, 2020
Electrode placement (1 Hz, N = 10)
Nicole W. Xu
Stanford University
26
Stomach Midway
Margin Rhopalia
.
.
.
.
.
.
.
.
.
.
.
.
x x
x
x
Electrodes can be placed anywhere for consistent
muscle responses
April 21, 2020
Using CFD to determine optimal sensor placement
Nicole W. Xu
Stanford University
27
Stomach Midway
Margin Rhopalia
.
.
.
.
.
.
.
.
.
.
.
.
x x
x
x
Future work: computational fluid dynamics (CFD) to
determine optimal sensor placement for untethered
experiments
April 21, 2020
Hoover et al., JFM, 2017
Gemmell et al., J. Royal Soc. Interface, 2015
Using CFD to determine optimal sensor placement
Nicole W. Xu
Stanford University
28
Stomach Midway
Margin Rhopalia
.
.
.
.
.
.
.
.
.
.
.
.
x x
x
x
Future work: computational fluid dynamics (CFD) to
determine optimal sensor placement for untethered
experiments
April 21, 2020
Hoover et al., JFM, 2017
29
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
Swim controller design
1 cm 1 cm
1 cm
30
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
Design choices:
Small
Neutrally buoyant
Low power
Inexpensive
Housing
Cap
Microcontroller
Battery
Electrodes
April 21, 2020
Swim controller design
31
Nicole W. Xu
Stanford University
April 21, 2020
32
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
Frequency vs. swimming speed
0.9 m
1.8 m
swim controller
jellyfish
camera
Two electrodes
(straight swimming)
Frequency (Hz)
0.25-1.00 Hz
33
Nicole W. Xu
Stanford University
April 21, 2020
Frequency vs. swimming speed
34
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Frequency vs. swimming speed
35
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Robotic control can increase speeds up to 3x
Swim controller frequency (Hz)
Speed(bodydiameterss-1)
36
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
AR (aspect ratio) = height
diameter
AR = 0.3
Enhancementfactor
=stimulatedspeed/unstimulatedspeed
April 21, 2020
Robotic control can increase speeds up to 3x
Swim controller frequency (Hz)
Enhancementfactor
37
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
AR = 0.2
AR = 0.3
Speed(bodydiameterss-1)
AR (aspect ratio) = height
diameter
Enhancementfactor
=stimulatedspeed/unstimulatedspeed
April 21, 2020
Robotic control can increase speeds up to 3x
Swim controller frequency (Hz)
38
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
AR = 0.2
AR = 0.3
Speed(bodydiameterss-1)
AR (aspect ratio) = height
diameter
Enhancementfactor
=stimulatedspeed/unstimulatedspeed
April 21, 2020
We can increase jellyfish swimming up to 2.8 times.
Enhancement depends on body morphology/shape.
Mechanistic model
39
Nicole W. Xu
Stanford University
November 26, 2019
åF = mj
du
dt
Daniel, Canadian Journal of Zoology, 1983
Xu and Dabiri, Science Advances, 2020
Theoretical model that incorporates body
kinematics in thrust, drag, and acceleration
reaction forces
T - D - AR = mj
du
dt
T =
rw
Asub
æ
è
çç
ö
ø
÷÷
dVsub
dt
æ
è
ç
ö
ø
÷
2
D =
1
2
Cd
rw
Aj
u2
AR =arj
Vj
du
dt
a =
2ht
dt
æ
è
çç
ö
ø
÷÷
1.4
Thrust Drag Acceleration Reaction
mj mass of the jellyfish
u speed
⍴w density of saltwater
Asub area of the jellyfish subumbrella
Vsub volume of the jellyfish subumbrella
Cd drag coefficient
Aj area of the jellyfish
ht height of the jellyfish
dt diameter of the jellyfish
⍴w density of the jellyfish
Vj volume of the jellyfish
Mechanistic model
40
Nicole W. Xu
Stanford University
November 26, 2019
åF = mj
du
dt
Frequency (Hz)Frequency (Hz)
Speed(bodydiameterss-1)
Daniel, Canadian Journal of Zoology, 1983
Xu and Dabiri, Science Advances, 2020
Theoretical model that incorporates body
kinematics in thrust, drag, and acceleration
reaction forces
Speed(bodydiameterss-1)
41
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
We can increase speeds, but at what cost to the animal?
Measuring frequency vs. respiratory rate
25 cm
10 cm
oxygen
probe
jellyfish
2 electrodes
power
supply
sealed top
O2Concentration(μmolO2L-1)
Time (min)
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
42April 21, 2020
Measuring frequency vs. respiratory rate
O2Consumption(μmolO2L-1hr-1g-1)
0 Hz 0.25 Hz 0.50 Hz 0.88 Hz
43
Nicole W. Xu
Stanford University
April 21, 2020
25 cm
10 cm
oxygen
probe
jellyfish
2 electrodes
power
supply
sealed top
Metabolic costs
44
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Metabolic costs
45
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Metabolic costs
46
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
P ~ v3
April 21, 2020
Metabolic costs
47
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
åF = mj
du
dt
Metabolic costs: efficient swimming
48
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
Robotic control can enhance swimming speed up to 3x, with only
a 2x increase in cost of transport.
April 21, 2020
49
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
April 21, 2020
But the electronic part ALSO consumes power.
Low power compared to other swimming robots
Biohybrid
(this work)
50
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Low power compared to other swimming robots
Biohybrid
(this work)
51
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Frame et al, Bioinsp Biomim, 2019
Low power compared to other swimming robots
Biohybrid
(this work)
52
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Park et al, Science, 2016
Low power compared to other swimming robots
Biohybrid
(this work)
53
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Hydroid
Low power compared to other swimming robots
Biohybrid
(this work)
This biohybrid robotic jellyfish uses 10-1000x less external power
per mass compared to existing swimming robots.
54
Nicole W. Xu
Stanford University
Xu and Dabiri, Science Advances, 2020
April 21, 2020
Spectrum of bioinspired jellyfish constructs
Nicole W. Xu
Stanford University
55
Biological
Construct
Limitation:
Survival in a
few specific
environments
Robotic
Construct
Limitation:
High power
consumption
Biohybrid
Robot
Advantages:
Low power & cost
Adaptable to many
environments
April 21, 2020
Nawroth et al, Nature Biotech, 2012Villanueva et al, PLoS ONE, 2014
56
Building a biohybrid robotic jellyfish
Nicole W. Xu
Stanford University
1. Understand how jellyfish naturally swim.
2. Characterize how to control jellyfish muscle contraction
(tethered in-dish experiments).
3. Build a portable swim controller.
4. Characterize the artificial control of jellyfish swimming
(free-swimming experiments).
5. Improve robotic controllability toward ocean monitoring
(ongoing work).
Robustness and maneuverability in real environments
April 21, 2020
Robustness: robot survivability in the ocean
Marine Biological Laboratory in Woods Hole, MA
Scuba divers: Jack Costello, Sean Colin, James Townsend
57
Nicole W. Xu
Stanford University
April 21, 2020
Lab work
0.9 m
1.8 m
swim controller
jellyfish
camera
58April 21, 2020
Field work
swim controller
jellyfish
5.5 mcamera
rope
markersN = 4 animals
f = 0, 0.50, 0.75 Hz
0.50 Hz, two electrodes
Nicole W. Xu
Dabiri Lab, Stanford University
60October 4, 2019
Field work
swim controller
jellyfish
rope
markers
Field work
swim controller
jellyfish
rope
markers
Field work
swim controller
jellyfish
rope
markersExternally driven jellyfish can swim faster than
normal jellyfish, similar to lab experiments
0 Hz: 1.8-3.5 cm/s
0.50 Hz: 3.1-4.4 cm/s
0.75 Hz: 2.8-4.9 cm/s
64
How can AI help biohybrid jellyfish research?
Nicole W. Xu
Stanford University
April 21, 2020
65
Using computer vision to track animals
Nicole W. Xu
Stanford University
April 21, 2020
Google AI
66
Using computer vision to track animals
Nicole W. Xu
Stanford University
April 21, 2020
67
How can we expand ocean monitoring tools?
Nicole W. Xu
Stanford University
April 21, 2020
Goal: Use technology to collect data about ocean environments
Needs
Able to explore new locations
Minimal power
Minimal cost
Minimal disturbance to aquatic life
How we can achieve this: Combine technological advances,
experimental work, and computational tools
National Geographic
Next steps toward using biohybrid jellyfish robots
for ocean monitoring
68
Nicole W. Xu
Stanford University
Technology
Sensors
Science
Lab experiments to
control more complex
maneuverability (turning)
Test various jellyfish
species
Field experiments and
ocean monitoring
April 21, 2020
Technology Science
Computation
Next steps toward using biohybrid jellyfish robots
for ocean monitoring
69
Nicole W. Xu
Stanford University
Computational tools
AI for image
segmentation and
object tracking in
various environments
CFD for optimal
sensor placement and
predicting animal
trajectories for closed
loop feedback
April 21, 2020
Technology Science
Computation
Acknowledgements
• Members of the Dabiri lab
• Cabrillo Marine Aquarium
• Marine Biological Laboratory
- Jack Costello
- Sean Colin
- James Townsend
- Brad Gemmell
• NSF Graduate Research Fellowship
Weiland Family Fellowship
Timothy G. Shi Graduate Fellowship
Contact info: nicolexu@stanford.edu web.stanford.edu/~nicolexu
70
Nicole W. Xu
Stanford University
April 21, 2020
1 von 70

Recomendados

Lake ecosystem : Physical factors affecting lake ecology von
Lake ecosystem : Physical factors affecting lake ecologyLake ecosystem : Physical factors affecting lake ecology
Lake ecosystem : Physical factors affecting lake ecologySurjya Kumar Saikia
710 views19 Folien
Nanotechnology - Biomimetics von
Nanotechnology - BiomimeticsNanotechnology - Biomimetics
Nanotechnology - BiomimeticsRohit J
1.4K views19 Folien
Pen-Culture.pptx von
Pen-Culture.pptxPen-Culture.pptx
Pen-Culture.pptxUshaHembrom1
408 views21 Folien
Nanorobotics von
NanoroboticsNanorobotics
NanoroboticsAshraful Hoda
11K views29 Folien
Automatic flood detection and warning device a prototype von
Automatic flood detection and warning device a prototypeAutomatic flood detection and warning device a prototype
Automatic flood detection and warning device a prototypeShaina Mavreen Villaroza
8.5K views22 Folien
Prediction water quality index of groundwater using artificial neural network... von
Prediction water quality index of groundwater using artificial neural network...Prediction water quality index of groundwater using artificial neural network...
Prediction water quality index of groundwater using artificial neural network...Aboul Ella Hassanien
1.1K views24 Folien

Más contenido relacionado

Was ist angesagt?

Nanorobotics von
NanoroboticsNanorobotics
Nanoroboticsnisargsmart
43.9K views13 Folien
Hs nanotechnology and electronics presentation updated_september_2011 von
Hs nanotechnology and electronics presentation updated_september_2011Hs nanotechnology and electronics presentation updated_september_2011
Hs nanotechnology and electronics presentation updated_september_2011ananthababuanu
859 views25 Folien
Nano technology in ervironmental engineering von
Nano technology in ervironmental engineeringNano technology in ervironmental engineering
Nano technology in ervironmental engineeringVishnu Raj
6.6K views25 Folien
Sewage fed fisheries von
Sewage fed fisheriesSewage fed fisheries
Sewage fed fisheriesShreyosree Ganguly
21.6K views25 Folien
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon) von
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)Ratul Chakraborty
19.9K views91 Folien
Final lake ppt von
Final lake pptFinal lake ppt
Final lake pptJanak Shah
1.7K views30 Folien

Was ist angesagt?(20)

Nanorobotics von nisargsmart
NanoroboticsNanorobotics
Nanorobotics
nisargsmart43.9K views
Hs nanotechnology and electronics presentation updated_september_2011 von ananthababuanu
Hs nanotechnology and electronics presentation updated_september_2011Hs nanotechnology and electronics presentation updated_september_2011
Hs nanotechnology and electronics presentation updated_september_2011
ananthababuanu859 views
Nano technology in ervironmental engineering von Vishnu Raj
Nano technology in ervironmental engineeringNano technology in ervironmental engineering
Nano technology in ervironmental engineering
Vishnu Raj6.6K views
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon) von Ratul Chakraborty
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)
Shrimp Culture: Culture of Tiger Shrimp (Penaeus monodon)
Ratul Chakraborty19.9K views
Final lake ppt von Janak Shah
Final lake pptFinal lake ppt
Final lake ppt
Janak Shah1.7K views
Lecture 3. farming methods von Mandeep Kaur
Lecture 3. farming methodsLecture 3. farming methods
Lecture 3. farming methods
Mandeep Kaur19.9K views
Technical seminar presentation on Bio-inspired materials for Directional flui... von Manikandan R
Technical seminar presentation on Bio-inspired materials for Directional flui...Technical seminar presentation on Bio-inspired materials for Directional flui...
Technical seminar presentation on Bio-inspired materials for Directional flui...
Manikandan R849 views
The Impacts of Urbanization on Wetland Degradation von Dr. Pranabjyoti Das
The Impacts of Urbanization on Wetland DegradationThe Impacts of Urbanization on Wetland Degradation
The Impacts of Urbanization on Wetland Degradation
Indian Deep Sea Fishing Vessels in Indian EEZ__RAJESH CHUDASAMA.pptx von Rajesh Chudasama
Indian Deep Sea Fishing Vessels in Indian EEZ__RAJESH CHUDASAMA.pptxIndian Deep Sea Fishing Vessels in Indian EEZ__RAJESH CHUDASAMA.pptx
Indian Deep Sea Fishing Vessels in Indian EEZ__RAJESH CHUDASAMA.pptx
Rajesh Chudasama234 views
Assignment on fisheries management of baor von Rajan Saha
Assignment on fisheries management of baorAssignment on fisheries management of baor
Assignment on fisheries management of baor
Rajan Saha1.5K views
Bionanotechnology from nature von tabirsir
Bionanotechnology from natureBionanotechnology from nature
Bionanotechnology from nature
tabirsir2.9K views
Garbage monitoring system IOT von amandeep singh
Garbage monitoring system IOTGarbage monitoring system IOT
Garbage monitoring system IOT
amandeep singh5.8K views

Similar a Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring

Cyberinfrastructure for Ocean Observing von
Cyberinfrastructure for Ocean ObservingCyberinfrastructure for Ocean Observing
Cyberinfrastructure for Ocean ObservingLarry Smarr
560 views52 Folien
The Future of the Internet Enabling New Science von
The Future of the Internet Enabling New ScienceThe Future of the Internet Enabling New Science
The Future of the Internet Enabling New ScienceLarry Smarr
918 views32 Folien
Genomics at the Speed of Light: Understanding the Living Ocean von
Genomics at the Speed of Light: Understanding the Living OceanGenomics at the Speed of Light: Understanding the Living Ocean
Genomics at the Speed of Light: Understanding the Living OceanLarry Smarr
632 views35 Folien
Calit2--Helping the University of California Drive Innovation in California von
Calit2--Helping the University of California Drive Innovation in CaliforniaCalit2--Helping the University of California Drive Innovation in California
Calit2--Helping the University of California Drive Innovation in CaliforniaLarry Smarr
350 views26 Folien
Living in the Future: The Calit2 Experience von
Living in the Future: The Calit2 ExperienceLiving in the Future: The Calit2 Experience
Living in the Future: The Calit2 ExperienceLarry Smarr
451 views20 Folien
The Singularity: Toward a Post-Human Reality von
The Singularity: Toward a Post-Human RealityThe Singularity: Toward a Post-Human Reality
The Singularity: Toward a Post-Human RealityLarry Smarr
859 views37 Folien

Similar a Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring(20)

Cyberinfrastructure for Ocean Observing von Larry Smarr
Cyberinfrastructure for Ocean ObservingCyberinfrastructure for Ocean Observing
Cyberinfrastructure for Ocean Observing
Larry Smarr560 views
The Future of the Internet Enabling New Science von Larry Smarr
The Future of the Internet Enabling New ScienceThe Future of the Internet Enabling New Science
The Future of the Internet Enabling New Science
Larry Smarr918 views
Genomics at the Speed of Light: Understanding the Living Ocean von Larry Smarr
Genomics at the Speed of Light: Understanding the Living OceanGenomics at the Speed of Light: Understanding the Living Ocean
Genomics at the Speed of Light: Understanding the Living Ocean
Larry Smarr632 views
Calit2--Helping the University of California Drive Innovation in California von Larry Smarr
Calit2--Helping the University of California Drive Innovation in CaliforniaCalit2--Helping the University of California Drive Innovation in California
Calit2--Helping the University of California Drive Innovation in California
Larry Smarr350 views
Living in the Future: The Calit2 Experience von Larry Smarr
Living in the Future: The Calit2 ExperienceLiving in the Future: The Calit2 Experience
Living in the Future: The Calit2 Experience
Larry Smarr451 views
The Singularity: Toward a Post-Human Reality von Larry Smarr
The Singularity: Toward a Post-Human RealityThe Singularity: Toward a Post-Human Reality
The Singularity: Toward a Post-Human Reality
Larry Smarr859 views
2010 DTRA Update von Steve Koch
2010 DTRA Update2010 DTRA Update
2010 DTRA Update
Steve Koch567 views
OFFICIAL Pre-Masters Anderson Amaral von Anderson Amaral
OFFICIAL Pre-Masters Anderson AmaralOFFICIAL Pre-Masters Anderson Amaral
OFFICIAL Pre-Masters Anderson Amaral
Anderson Amaral492 views
Osmotic stress and water isotope effects in kinesin-1 gliding motility assays von Steve Koch
Osmotic stress and water isotope effects in kinesin-1 gliding motility assaysOsmotic stress and water isotope effects in kinesin-1 gliding motility assays
Osmotic stress and water isotope effects in kinesin-1 gliding motility assays
Steve Koch862 views
Technology-Driven Disruptions in the Near Future von Larry Smarr
Technology-Driven Disruptions in the Near FutureTechnology-Driven Disruptions in the Near Future
Technology-Driven Disruptions in the Near Future
Larry Smarr674 views
Citclops: the role of participatory science in mpa management 2013 10-22 von Luigi Ceccaroni
Citclops:  the role of participatory science in mpa management 2013 10-22Citclops:  the role of participatory science in mpa management 2013 10-22
Citclops: the role of participatory science in mpa management 2013 10-22
Luigi Ceccaroni724 views
An Ecosystems Approach to Water and Food Security von AFRIKASOURCES
An Ecosystems Approach to Water and Food SecurityAn Ecosystems Approach to Water and Food Security
An Ecosystems Approach to Water and Food Security
AFRIKASOURCES21.5K views
2016 03-02 EyesOnALZ All-hands meeting - Stardust@home von EyesOnALZ
2016 03-02 EyesOnALZ All-hands meeting - Stardust@home2016 03-02 EyesOnALZ All-hands meeting - Stardust@home
2016 03-02 EyesOnALZ All-hands meeting - Stardust@home
EyesOnALZ67 views
Toward a Global Coral Reef Observatory von Larry Smarr
Toward a Global Coral Reef ObservatoryToward a Global Coral Reef Observatory
Toward a Global Coral Reef Observatory
Larry Smarr644 views
changes Open Science in High-Energy Physics - Salvatore Mele at OpenCon von Right to Research
changes Open Science in High-Energy Physics - Salvatore Mele at OpenConchanges Open Science in High-Energy Physics - Salvatore Mele at OpenCon
changes Open Science in High-Energy Physics - Salvatore Mele at OpenCon
Right to Research1.1K views

Más de inside-BigData.com

Major Market Shifts in IT von
Major Market Shifts in ITMajor Market Shifts in IT
Major Market Shifts in ITinside-BigData.com
5K views27 Folien
Preparing to program Aurora at Exascale - Early experiences and future direct... von
Preparing to program Aurora at Exascale - Early experiences and future direct...Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...inside-BigData.com
1.4K views45 Folien
Transforming Private 5G Networks von
Transforming Private 5G NetworksTransforming Private 5G Networks
Transforming Private 5G Networksinside-BigData.com
1.3K views14 Folien
The Incorporation of Machine Learning into Scientific Simulations at Lawrence... von
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...inside-BigData.com
1.4K views33 Folien
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod... von
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...inside-BigData.com
1K views47 Folien
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ... von
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...inside-BigData.com
709 views53 Folien

Más de inside-BigData.com(20)

Preparing to program Aurora at Exascale - Early experiences and future direct... von inside-BigData.com
Preparing to program Aurora at Exascale - Early experiences and future direct...Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...
inside-BigData.com1.4K views
The Incorporation of Machine Learning into Scientific Simulations at Lawrence... von inside-BigData.com
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
inside-BigData.com1.4K views
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod... von inside-BigData.com
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ... von inside-BigData.com
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
inside-BigData.com709 views
Fugaku Supercomputer joins fight against COVID-19 von inside-BigData.com
Fugaku Supercomputer joins fight against COVID-19Fugaku Supercomputer joins fight against COVID-19
Fugaku Supercomputer joins fight against COVID-19
inside-BigData.com2.1K views
Energy Efficient Computing using Dynamic Tuning von inside-BigData.com
Energy Efficient Computing using Dynamic TuningEnergy Efficient Computing using Dynamic Tuning
Energy Efficient Computing using Dynamic Tuning
inside-BigData.com454 views
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD von inside-BigData.com
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPODHPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
inside-BigData.com838 views
Versal Premium ACAP for Network and Cloud Acceleration von inside-BigData.com
Versal Premium ACAP for Network and Cloud AccelerationVersal Premium ACAP for Network and Cloud Acceleration
Versal Premium ACAP for Network and Cloud Acceleration
inside-BigData.com586 views
Zettar: Moving Massive Amounts of Data across Any Distance Efficiently von inside-BigData.com
Zettar: Moving Massive Amounts of Data across Any Distance EfficientlyZettar: Moving Massive Amounts of Data across Any Distance Efficiently
Zettar: Moving Massive Amounts of Data across Any Distance Efficiently
inside-BigData.com496 views
CUDA-Python and RAPIDS for blazing fast scientific computing von inside-BigData.com
CUDA-Python and RAPIDS for blazing fast scientific computingCUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computing
Efficient Model Selection for Deep Neural Networks on Massively Parallel Proc... von inside-BigData.com
Efficient Model Selection for Deep Neural Networks on Massively Parallel Proc...Efficient Model Selection for Deep Neural Networks on Massively Parallel Proc...
Efficient Model Selection for Deep Neural Networks on Massively Parallel Proc...
inside-BigData.com249 views

Último

GDSC GLAU Info Session.pptx von
GDSC GLAU Info Session.pptxGDSC GLAU Info Session.pptx
GDSC GLAU Info Session.pptxgauriverrma4
15 views28 Folien
Initiating and Advancing Your Strategic GIS Governance Strategy von
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
198 views68 Folien
The Coming AI Tsunami.pptx von
The Coming AI Tsunami.pptxThe Coming AI Tsunami.pptx
The Coming AI Tsunami.pptxjohnhandby
14 views12 Folien
Business Analyst Series 2023 - Week 4 Session 8 von
Business Analyst Series 2023 -  Week 4 Session 8Business Analyst Series 2023 -  Week 4 Session 8
Business Analyst Series 2023 - Week 4 Session 8DianaGray10
180 views13 Folien
LLMs in Production: Tooling, Process, and Team Structure von
LLMs in Production: Tooling, Process, and Team StructureLLMs in Production: Tooling, Process, and Team Structure
LLMs in Production: Tooling, Process, and Team StructureAggregage
65 views77 Folien
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」 von
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」PC Cluster Consortium
29 views68 Folien

Último(20)

GDSC GLAU Info Session.pptx von gauriverrma4
GDSC GLAU Info Session.pptxGDSC GLAU Info Session.pptx
GDSC GLAU Info Session.pptx
gauriverrma415 views
Initiating and Advancing Your Strategic GIS Governance Strategy von Safe Software
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software198 views
The Coming AI Tsunami.pptx von johnhandby
The Coming AI Tsunami.pptxThe Coming AI Tsunami.pptx
The Coming AI Tsunami.pptx
johnhandby14 views
Business Analyst Series 2023 - Week 4 Session 8 von DianaGray10
Business Analyst Series 2023 -  Week 4 Session 8Business Analyst Series 2023 -  Week 4 Session 8
Business Analyst Series 2023 - Week 4 Session 8
DianaGray10180 views
LLMs in Production: Tooling, Process, and Team Structure von Aggregage
LLMs in Production: Tooling, Process, and Team StructureLLMs in Production: Tooling, Process, and Team Structure
LLMs in Production: Tooling, Process, and Team Structure
Aggregage65 views
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」 von PC Cluster Consortium
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」
PCCC23:日本AMD株式会社 テーマ1「AMD Instinct™ アクセラレーターの概要」
This talk was not generated with ChatGPT: how AI is changing science von Elena Simperl
This talk was not generated with ChatGPT: how AI is changing scienceThis talk was not generated with ChatGPT: how AI is changing science
This talk was not generated with ChatGPT: how AI is changing science
Elena Simperl34 views
Business Analyst Series 2023 - Week 4 Session 7 von DianaGray10
Business Analyst Series 2023 -  Week 4 Session 7Business Analyst Series 2023 -  Week 4 Session 7
Business Analyst Series 2023 - Week 4 Session 7
DianaGray10152 views
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De... von Moses Kemibaro
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...
Moses Kemibaro38 views
The Role of Patterns in the Era of Large Language Models von Yunyao Li
The Role of Patterns in the Era of Large Language ModelsThe Role of Patterns in the Era of Large Language Models
The Role of Patterns in the Era of Large Language Models
Yunyao Li104 views
AI + Memoori = AIM von Memoori
AI + Memoori = AIMAI + Memoori = AIM
AI + Memoori = AIM
Memoori15 views
NTGapps NTG LowCode Platform von Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu474 views
"Package management in monorepos", Zoltan Kochan von Fwdays
"Package management in monorepos", Zoltan Kochan"Package management in monorepos", Zoltan Kochan
"Package management in monorepos", Zoltan Kochan
Fwdays37 views
Cocktail of Environments. How to Mix Test and Development Environments and St... von Aleksandr Tarasov
Cocktail of Environments. How to Mix Test and Development Environments and St...Cocktail of Environments. How to Mix Test and Development Environments and St...
Cocktail of Environments. How to Mix Test and Development Environments and St...

Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring

  • 1. Biohybrid robotic jellyfish for future applications in ocean monitoring Nicole W. Xu, James Townsend, Jack Costello, Sean Colin, John O. Dabiri Stanford University HPC-AI Stanford Conference April 21, 2020
  • 2. 2 Nicole W. Xu Stanford University April 21, 2020 How much do we know about the ocean? More than 80% of our ocean is unmapped, unobserved, and unexplored.
  • 3. 3 Importance of ocean monitoring Track changes in temperature, acidity, concentrations of nutrients Discovery of new species or behaviors National GeographicMBARI Toby Hudson Greg Torda Nudibranch Coral Bleaching Algal Blooms Nicole W. Xu Stanford University April 21, 2020
  • 4. 4 Current methods of ocean monitoring Remotely operated vehicles (ROVs) Autonomous underwater vehicles (AUVs) Slocum Glider, AUVACRJE International Challenges: Costly Bulky High power consumption Vehicle wakes Yoda Productions Nicole W. Xu Stanford University April 21, 2020
  • 5. 5 How can we expand ocean monitoring tools? Nicole W. Xu Stanford University April 21, 2020 Goal: Use technology to collect data about ocean environments Needs Able to explore new locations Minimal power Minimal cost Minimal disturbance to aquatic life How we can achieve this: Combine technological advances, experimental work, and computational tools National Geographic
  • 6. 6 How can we expand ocean monitoring tools? Nicole W. Xu Stanford University April 21, 2020 Goal: Use technology to collect data about ocean environments Needs Able to explore new locations Minimal power Minimal cost Minimal disturbance to aquatic life How we can achieve this: Combine technological advances, experimental work, and computational tools National Geographic
  • 7. 7 Bioinspired robots offer advantages Energy-efficient, bioinspired aquatic vehicles that leave natural wakes to minimize environmental disturbances Collect images, data, samples from new locations Tadesse et al., Smart Materials and Structures, 2012Katzschmann et al., Science Robotics, 2018 MantaDroid Fish Manta ray Jellyfish Nicole W. Xu Stanford University April 21, 2020 Which animal model do we choose?
  • 8. 8 Jellyfish as a model organism Nicole W. Xu Stanford University Despite 500 million years of evolutionary pressure, the body structure of moon jellyfish has remained largely unchanged. Aurelia aurita • Simple body structure • Swimming is tied into feeding, escape behaviors, etc. • Ubiquitous 5 cm April 21, 2020
  • 9. Nicole W. Xu Stanford University 9 COT is a metric of energy efficiency Opposite of mpg COT = Energy Mass x Distance April 21, 2020 Tesla
  • 10. Nicole W. Xu Stanford University 10 What can we learn from jellyfish? Jellyfish have a low cost of transport compared to other animals. Jellyfish are energy efficient. Gemmell et al., PNAS, 2013 Flying Running Swimming COT = Energy Mass x Distance April 21, 2020
  • 11. Spectrum of bioinspired jellyfish constructs Nicole W. Xu Stanford University 11 Nawroth et al, Nature Biotech, 2012 Biological Construct Limitation: Survival in a few specific environments Villanueva et al, PLoS ONE, 2014 Robotic Construct Limitation: High power consumption April 21, 2020
  • 12. 12 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University April 21, 2020
  • 13. 13 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020
  • 14. 14 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020
  • 15. Nicole W. Xu Stanford University Pacemakers: sensory organs that innervate the swim muscle exumbrellar surface (top) subumbrellar surface (underside) 5 cm 5 cm 15 Swim anatomy April 21, 2020
  • 16. Swim motion Power stroke (active contraction and thrust) Recovery stroke (passive relaxation and feeding current) All-or-nothing muscle activation Nicole W. Xu Stanford University 16 5 cm April 21, 2020
  • 17. 17 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020
  • 18. External control of swimming Electrodes act as “artificial pacemakers” to activate the muscles. 18 V t Input(s): Signal voltage Signal pulse width Signal period (inverse of frequency) Electrode location on the bell Output: Pulses (tag displacement) Nicole W. Xu Stanford University April 21, 2020
  • 19. In-dish experiments Nicole W. Xu Stanford University 19 2.5 cm April 21, 2020
  • 20. Natural pulses 20 Nicole W. Xu Stanford University 2.5 cm April 21, 2020 TagDisplacement(pixels)
  • 21. Natural vs. stimulated pulses 21 Nicole W. Xu Stanford University April 21, 2020 Natural TagDisplacement(pixels) TagDisplacement(pixels) 0.25 Hz TagDisplacement(pixels) 2 Hz TagDisplacement(pixels) 1 Hz
  • 22. Frequency spectrum of natural pulses 22 Unstimulated cases, N = 12 animals Natural motion includes a bout frequency and successive pulses per bout (a spread between 0.4-1 Hz). 0.16 Hz 0.4-1 Hz Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 Amplitude TagDisplacement(pixels) Example displacement, N = 1
  • 23. Frequency spectrum of stimulated pulses 23 Stimulated at 1 Hz, N = 10 animals 1.02 Hz Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 Amplitude TagDisplacement(pixels) Example displacement, N = 1
  • 24. N = 10 N = 10 N = 10 N = 10 N = 10 N = 10 N = 9 Stimulated frequency response (0.25 – 2 Hz) 24 N = 10 animals PowerSpectralDensity Frequency Output (Hz) Nicole W. Xu Stanford University Successful one-to-one response Max pulse frequency according to a proposed bio limit (Bullock, J Cell Comp Physio, 1943) Peak frequency of unstimulated animals (natural behavior) Xu and Dabiri, Science Advances, 2020 April 21, 2020 Successful frequency responses between 0.25 to 1 Hz
  • 25. Electrode placement (1 Hz) Where is the optimal location for electrode placement? Stomach Midway Pacemaker Margin Sensor placement will also be relevant when we place temperature/salinity/pH probes on jellyfish in the ocean Nicole W. Xu Stanford University 25April 21, 2020
  • 26. Electrode placement (1 Hz, N = 10) Nicole W. Xu Stanford University 26 Stomach Midway Margin Rhopalia . . . . . . . . . . . . x x x x Electrodes can be placed anywhere for consistent muscle responses April 21, 2020
  • 27. Using CFD to determine optimal sensor placement Nicole W. Xu Stanford University 27 Stomach Midway Margin Rhopalia . . . . . . . . . . . . x x x x Future work: computational fluid dynamics (CFD) to determine optimal sensor placement for untethered experiments April 21, 2020 Hoover et al., JFM, 2017 Gemmell et al., J. Royal Soc. Interface, 2015
  • 28. Using CFD to determine optimal sensor placement Nicole W. Xu Stanford University 28 Stomach Midway Margin Rhopalia . . . . . . . . . . . . x x x x Future work: computational fluid dynamics (CFD) to determine optimal sensor placement for untethered experiments April 21, 2020 Hoover et al., JFM, 2017
  • 29. 29 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020
  • 30. Swim controller design 1 cm 1 cm 1 cm 30 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 Design choices: Small Neutrally buoyant Low power Inexpensive Housing Cap Microcontroller Battery Electrodes April 21, 2020
  • 31. Swim controller design 31 Nicole W. Xu Stanford University April 21, 2020
  • 32. 32 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020
  • 33. Frequency vs. swimming speed 0.9 m 1.8 m swim controller jellyfish camera Two electrodes (straight swimming) Frequency (Hz) 0.25-1.00 Hz 33 Nicole W. Xu Stanford University April 21, 2020
  • 34. Frequency vs. swimming speed 34 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 35. Frequency vs. swimming speed 35 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 36. Robotic control can increase speeds up to 3x Swim controller frequency (Hz) Speed(bodydiameterss-1) 36 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 AR (aspect ratio) = height diameter AR = 0.3 Enhancementfactor =stimulatedspeed/unstimulatedspeed April 21, 2020
  • 37. Robotic control can increase speeds up to 3x Swim controller frequency (Hz) Enhancementfactor 37 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 AR = 0.2 AR = 0.3 Speed(bodydiameterss-1) AR (aspect ratio) = height diameter Enhancementfactor =stimulatedspeed/unstimulatedspeed April 21, 2020
  • 38. Robotic control can increase speeds up to 3x Swim controller frequency (Hz) 38 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 AR = 0.2 AR = 0.3 Speed(bodydiameterss-1) AR (aspect ratio) = height diameter Enhancementfactor =stimulatedspeed/unstimulatedspeed April 21, 2020 We can increase jellyfish swimming up to 2.8 times. Enhancement depends on body morphology/shape.
  • 39. Mechanistic model 39 Nicole W. Xu Stanford University November 26, 2019 åF = mj du dt Daniel, Canadian Journal of Zoology, 1983 Xu and Dabiri, Science Advances, 2020 Theoretical model that incorporates body kinematics in thrust, drag, and acceleration reaction forces T - D - AR = mj du dt T = rw Asub æ è çç ö ø ÷÷ dVsub dt æ è ç ö ø ÷ 2 D = 1 2 Cd rw Aj u2 AR =arj Vj du dt a = 2ht dt æ è çç ö ø ÷÷ 1.4 Thrust Drag Acceleration Reaction mj mass of the jellyfish u speed ⍴w density of saltwater Asub area of the jellyfish subumbrella Vsub volume of the jellyfish subumbrella Cd drag coefficient Aj area of the jellyfish ht height of the jellyfish dt diameter of the jellyfish ⍴w density of the jellyfish Vj volume of the jellyfish
  • 40. Mechanistic model 40 Nicole W. Xu Stanford University November 26, 2019 åF = mj du dt Frequency (Hz)Frequency (Hz) Speed(bodydiameterss-1) Daniel, Canadian Journal of Zoology, 1983 Xu and Dabiri, Science Advances, 2020 Theoretical model that incorporates body kinematics in thrust, drag, and acceleration reaction forces Speed(bodydiameterss-1)
  • 41. 41 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020 We can increase speeds, but at what cost to the animal?
  • 42. Measuring frequency vs. respiratory rate 25 cm 10 cm oxygen probe jellyfish 2 electrodes power supply sealed top O2Concentration(μmolO2L-1) Time (min) Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 42April 21, 2020
  • 43. Measuring frequency vs. respiratory rate O2Consumption(μmolO2L-1hr-1g-1) 0 Hz 0.25 Hz 0.50 Hz 0.88 Hz 43 Nicole W. Xu Stanford University April 21, 2020 25 cm 10 cm oxygen probe jellyfish 2 electrodes power supply sealed top
  • 44. Metabolic costs 44 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 45. Metabolic costs 45 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 46. Metabolic costs 46 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 P ~ v3 April 21, 2020
  • 47. Metabolic costs 47 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 åF = mj du dt
  • 48. Metabolic costs: efficient swimming 48 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 Robotic control can enhance swimming speed up to 3x, with only a 2x increase in cost of transport. April 21, 2020
  • 49. 49 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). April 21, 2020 But the electronic part ALSO consumes power.
  • 50. Low power compared to other swimming robots Biohybrid (this work) 50 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 51. Low power compared to other swimming robots Biohybrid (this work) 51 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 Frame et al, Bioinsp Biomim, 2019
  • 52. Low power compared to other swimming robots Biohybrid (this work) 52 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 Park et al, Science, 2016
  • 53. Low power compared to other swimming robots Biohybrid (this work) 53 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020 Hydroid
  • 54. Low power compared to other swimming robots Biohybrid (this work) This biohybrid robotic jellyfish uses 10-1000x less external power per mass compared to existing swimming robots. 54 Nicole W. Xu Stanford University Xu and Dabiri, Science Advances, 2020 April 21, 2020
  • 55. Spectrum of bioinspired jellyfish constructs Nicole W. Xu Stanford University 55 Biological Construct Limitation: Survival in a few specific environments Robotic Construct Limitation: High power consumption Biohybrid Robot Advantages: Low power & cost Adaptable to many environments April 21, 2020 Nawroth et al, Nature Biotech, 2012Villanueva et al, PLoS ONE, 2014
  • 56. 56 Building a biohybrid robotic jellyfish Nicole W. Xu Stanford University 1. Understand how jellyfish naturally swim. 2. Characterize how to control jellyfish muscle contraction (tethered in-dish experiments). 3. Build a portable swim controller. 4. Characterize the artificial control of jellyfish swimming (free-swimming experiments). 5. Improve robotic controllability toward ocean monitoring (ongoing work). Robustness and maneuverability in real environments April 21, 2020
  • 57. Robustness: robot survivability in the ocean Marine Biological Laboratory in Woods Hole, MA Scuba divers: Jack Costello, Sean Colin, James Townsend 57 Nicole W. Xu Stanford University April 21, 2020
  • 58. Lab work 0.9 m 1.8 m swim controller jellyfish camera 58April 21, 2020
  • 59. Field work swim controller jellyfish 5.5 mcamera rope markersN = 4 animals f = 0, 0.50, 0.75 Hz
  • 60. 0.50 Hz, two electrodes Nicole W. Xu Dabiri Lab, Stanford University 60October 4, 2019
  • 63. Field work swim controller jellyfish rope markersExternally driven jellyfish can swim faster than normal jellyfish, similar to lab experiments 0 Hz: 1.8-3.5 cm/s 0.50 Hz: 3.1-4.4 cm/s 0.75 Hz: 2.8-4.9 cm/s
  • 64. 64 How can AI help biohybrid jellyfish research? Nicole W. Xu Stanford University April 21, 2020
  • 65. 65 Using computer vision to track animals Nicole W. Xu Stanford University April 21, 2020 Google AI
  • 66. 66 Using computer vision to track animals Nicole W. Xu Stanford University April 21, 2020
  • 67. 67 How can we expand ocean monitoring tools? Nicole W. Xu Stanford University April 21, 2020 Goal: Use technology to collect data about ocean environments Needs Able to explore new locations Minimal power Minimal cost Minimal disturbance to aquatic life How we can achieve this: Combine technological advances, experimental work, and computational tools National Geographic
  • 68. Next steps toward using biohybrid jellyfish robots for ocean monitoring 68 Nicole W. Xu Stanford University Technology Sensors Science Lab experiments to control more complex maneuverability (turning) Test various jellyfish species Field experiments and ocean monitoring April 21, 2020 Technology Science Computation
  • 69. Next steps toward using biohybrid jellyfish robots for ocean monitoring 69 Nicole W. Xu Stanford University Computational tools AI for image segmentation and object tracking in various environments CFD for optimal sensor placement and predicting animal trajectories for closed loop feedback April 21, 2020 Technology Science Computation
  • 70. Acknowledgements • Members of the Dabiri lab • Cabrillo Marine Aquarium • Marine Biological Laboratory - Jack Costello - Sean Colin - James Townsend - Brad Gemmell • NSF Graduate Research Fellowship Weiland Family Fellowship Timothy G. Shi Graduate Fellowship Contact info: nicolexu@stanford.edu web.stanford.edu/~nicolexu 70 Nicole W. Xu Stanford University April 21, 2020