The Best of CHI2018

3. THE BEST OF CHI
Moderator: Lenneke Kuijer | TU/e

4. INTRODUCING THE BEST OF CHI
Lenneke Kuijer | TU/e

5. BIOFIDGET: PLAYFUL BREATHING
EXERCISE FOR STRESS DETECTION
AND REDUCTION
Rong-Hao Liang | TU/e

6. RIPPLE THERMOSTAT
Anke van Oosterhout | TU/e

7. CO-PERFORMANCE:
CONCEPTUALIZING THE ROLE OF
ARTIFICIAL AGENCY IN THE DESIGN
OF EVERYDAY LIFE
Lenneke Kuijer | TU/e

8. THE MAKING OF PERFORMATIVITY
IN DESIGNING [WITH] SMART
MATERIAL COMPOSITES
Bahar Barati | Delft University of Technology

9. EXPLORING THE VALUE OF PARENT
TRACKED BABY DATA IN
INTERACTIONS WITH HEALTHCARE
PROFESSIONALS
Joep Frens | TU/e

10. Janne van Kollenburg
Sander Bogers
Heleen Rutjes
Eva Deckers
Joep Frens
Caroline Hummels
Exploring the value of
parent-tracked baby data
in interactions with
healthcare professionals

11. PHILIPS AVENT
uGrow

12. First
Medical
Grade
Baby app
PHILIPS AVENT
uGrow

13. How can parent-tracked baby
data be of value in
interactions with their
healthcare professionals?
CASE STUDY
Objective

14. data as creative material
Situated Explorative and ContinuousData as Creative Material
METHOD
Data-enabled Design

15. DATA-ENABLED DESIGN
Explorative tools

16. Parent Toolkit Researcher DashboardHealthcare Professional Dashboard
EXPLORATIVE TOOLS
Data-enabled Design Canvas

17. CANVAS
Parent Toolkit

18. PARENTS TOOLKIT
Push Button
Feeding
Full diaper

19. PARENTS TOOLKIT
Rotation Knob
Cry intensity
Falling asleep
Satisfaction level

20. PARENTS TOOLKIT
Toggle Switch
Sleep
Crying
Breast pumping

21. PARENTS TOOLKIT
Text Module
Additional information
Reports from other HCP

22. PARENTS TOOLKIT
Video Module
Capturing skin rash
Baby playing and laughing

23. PARENTS TOOLKIT
Parents Dashboard

24. CANVAS
Healthcare Professional
Dashboard

25. CANVAS
Researcher
Dashboard

26. Consultation
Office Nurse Pediatrician
General
Practitioner
Family 1 Family 2 Family 3 Family 4 Family 5
• 5 weeks old • 3 weeks old • 5 months old • 3 months old • 6 weeks old
• No issues • Born light weight • multiple hospitalizations • Crying • Reflux
CASE STUDY
Participants

27. CASE STUDY
Situated Explorations
weeks participation per family
weeks participation per professional
data entries
unique data trackers’ labels
message treats
interview hours
reflection sessions
6
6-9
1373
25
20
36

28. CASE STUDY
Design Narratives

29. CASE STUDY
Design Narratives
My Care
Question
(Consultation
Office Nurse)
Care Paths
(GP and
Pediatrician)
Design intervention
Insight
t
t

30. DESIGN NARRATIVE
My Care Question

31. “Sometimes I click the button
twice as I forgot to log the
previous one. But that doesn’t
show the real situation”
– family 2, mother
DESIGN NARRATIVE
My Care Question

32. DESIGN NARRATIVE
My Care Question
“I am so pleased with the
adaption possibilities. When I
forget it in the middle of the
night and enter the data in the
morning it automatically ‘jumps’
to the right position on the
timeline.”
– family 3, mother

33. DESIGN NARRATIVE
My Care Question

34. DESIGN NARRATIVE
My Care Question

35. “I am doubting. I see a lot of data that I
could respond to, but I’m hesitant to do so
as I do not want to create issues that are
not there.”
– consultation office nurse
DESIGN NARRATIVE
My Care Question

36. DESIGN NARRATIVE
My Care Question

37. DESIGN NARRATIVE
My Care Question

38. DESIGN NARRATIVE
My Care Question

39. data as creative material
Situated Explorative and ContinuousData as Creative Material
CASE STUDY
Data-enabled Design

40. How can parent-tracked baby
data be of value in
interactions with their
healthcare professionals?
CASE STUDY
Conclusion
–
Explorative approach to what data
can be relevant and how

41. Janne van Kollenburg
Sander Bogers
Heleen Rutjes
Eva Deckers
Joep Frens
Caroline Hummels
Exploring the value of
parent-tracked baby data
in interactions with
healthcare professionals

42. REFLECTIONS ON THE BEST OF CHI

45. THE MAKING OF PERFORMATIVITY
IN DESIGNING [WITH] SMART
MATERIAL COMPOSITES
Bahareh Barati | Delft University of Technology

46. The Making of Performativity
in Designing [with]
Smart Material Composites
Bahareh Barati, Elisa Giaccardi, Elvin Karana
Presented at CHI 2018 | 21-26 APR | Montréal - Canada

47. contributions
 a conceptual articulation of smart material
composites as underdeveloped
 disruption of affordance as a design strategy
in the making of material’s performative qualities
[Giaccardi & Karana CHI’15]

49. [Karana et al. 2015
International Journal of
Design]
material driven design

51. #1 matter
matter | structure | form | computation

52. replacing the solid electrodes
with liquid conductors
[Franinovic ́ and Franzke, DesForM 2015]

53. matter | structure | form | computation
#2 structure

54. separating the printed layers

55. matter | structure | form | computation
#3 form

56. changing the pattern of the
printed conductor
multiplying the bulgy
connection points

57. matter | structure | form | computation
#4 computation

58. incorporating a light sensor
(LDR) and hacking the invertor

59. Thank you :)
b.barati@tudelft.nl

60. CO-PERFORMANCE:
CONCEPTUALIZING THE ROLE OF
ARTIFICIAL AGENCY IN THE DESIGN
OF EVERYDAY LIFE
Lenneke Kuijer | TU/e

61. Co-performance
Conceptualizing the Role of Artificial
Agency in the Design of Everyday Life
Lenneke Kuijer, Eindhoven University of Technology, The Netherlands
Elisa Giaccardi, Delft University of Technology, The Netherlands
CHI 2018, 24 April 2018, Montreal, Canada

62. t
Shaping
future
everyday life

63. Social
practice
Present
behaviour
Future
behaviour
Social practice
theory
materials
meanings
competencies

66. Co-performance

67. Co-performance and
shaping everyday life
Social practice Present Future

68. What people are ‘better’ at:
• Handle things
• Move around in the home
• Judge levels of comfort
• Have awareness of context
• Experience a wide diversity
of practices
• Respond creatively to
variations and change
• Empathize
• …
• …
What artefacts are ‘better’ at
• Work 24/7
• Don’t complain
• Measure very precisely
• Calculate very quickly
• Receive wireless data
• Stand idle
• Consume electricity
• Store lots of data
• …
• …
Different
capabilities

69. Time
Demand
for heat
in homes
New capabilities,
new demands

70. Shaping everyday life
to suit artificial
capabilities?

71. Human-thermostat
collaboration
S.G.A. Bernabela, R.C. Brouwer, M.J.
Hoekstra, K.R. Seck, Y. Shen & A.R. v.d. Stappen

72. Human-thermostat
collaboration
Olivier van Duuren, Sam
Kragtwijk, Laura Maron,
Ayesha Nabila, Wouter v d
Wouden, Tjalke Zijlstra

73. Human-thermostat
collaboration
Bram Rolvink, Adam van Heerde, San San Nguyen, Nesrin
Günes, Siebren de Vos, Jordy Alblas & Bern

75. Human-system
collaboration
TU Delft I Interactive Technology Design & Explore Lab prototypes

76. t
Shaping
future
everyday life

77. Shaping
future
everyday life

78. Thank you
Lenneke Kuijer, s.c.kuijer@tue.nl

79. References/further reading
• Kuijer, L. and Giaccardi, E., Co-performance: Conceptualizing the
Role of Artificial Agency in the Design of Everyday Life in Human-
Computer Interaction, (Montréal, QC, Canada., 2018), ACM.
• Kuijer, L. Automated artefacts as co-performers of social practices:
washing machines, laundering and design. in Maller, C. and
Strengers, Y. eds. Social Practices and Nonhumans: Nature, materials
and technologies, Palgrave Macmillan, 2019.
• Gatherer, Derek, Lenneke Kuijer and Ida Nilstad Pettersen. " By their
[data] you will know them"–Historical reflections on capturing
patterns in everyday life." Everyday Futures (2016): 59.
• Strengers, Y. and Nicholls, L. Convenience and energy consumption
in the smart home of the future: Industry visions from Australia and
beyond. Energy Research & Social Science, 32. 86-93.

81. BioFidget: Biofeedback for Respiration Training
Using an Augmented Fidget Spinner
Rong-Hao Liang
Bin Yu
Mengru Xue
Jun Hu
Loe M. G. Feijs
Department of Industrial Design
Eindhoven University of Technology, the Netherlands

83. What were your stressful moments?

84. Slow and Steady Deep Breathing, 6 cycles / min
Lehrer, P. M., Vaschillo, E., and Vaschillo,
B. Resonant frequency biofeedback training to increase cardiac variability: Rationale and manual for training.
Applied psychophysiology and biofeedback 25, 3 (2000), 177–191.
RespirationTraining
is Clinical-Proven in Stress Reduction,

86. Slow and Steady Deep Breathing, 6 cycles / min
Lehrer, P. M., Vaschillo, E., and Vaschillo,
B. Resonant frequency biofeedback training to increase cardiac variability: Rationale and manual for training.
Applied psychophysiology and biofeedback 25, 3 (2000), 177–191.
RespirationTraining
is Clinical-Proven in Stress Reduction,
but People Usually Drops Out.

87. Stretch Sensor for Breath Sensing
ImprovingEngagement
Respiration Training with Biofeedback

88. Stretch Sensor for Breath Sensing
Respiration
Heart Rate Variability (HRV)
(The variation in the Inter-beat Interval)

89. Stretch Sensor for Breath Sensing
ImprovingEngagement
Respiration Training with Biofeedback
of Respiration and Heart Rate Variability (HRV) Information

90. ImprovingEngagement
Photoplethysmograph (PPG)
for Heart RateVariability Sensing
Stretch Sensor for
Respiration Sensing
Stretch Sensor for Breath Sensing
Providing User-Friendly Biofeedback,
but Requires Bio-sensors to be Worn.

91. ImprovingEngagement
Photoplethysmograph (PPG)
for Heart RateVariability Sensing
Stretch Sensor for
Respiration Sensing
Stretch Sensor for Breath Sensing
Providing User-Friendly Biofeedback,
but Requires Bio-sensors to be Worn.
Would you put these sensors on, when you are stressed?

92. FidgetSpinner

93. FidgetSpinner
… “fidget spinners and other self-regulatory
occupational therapy toys have yet to be subjected to
rigorous scientific research. Thus, their alleged
benefits remain scientifically unfounded.”
Schecter, Rachel A., et al.
"Fidget spinners: Purported benefits, adverse effects and accepted alternatives."
Current opinion in pediatrics 29.5 (2017): 616-618.

94. BioFidget:AugmentedFidgetSpinner
without Requiring Additional Sensors to be Worn
That Senses HRV and Respiration and Provides Biofeedback

95. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
Playfulness
Technical
Validity&

96. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
Pad
Pad
Wing

97. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
Pad
Pad
Wing
PPG Sensor
Micro-controller

98. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
PPG Sensor
Micro-controller
Hall Sensor
Magnets

99. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
PPG Sensor
Micro-controller
Hall Sensor
Magnets
N

100. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
Hall Sensor
Magnets
N
NeoPixel Ring

101. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness
NeoPixel Ring
Accelerometer

102. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness

103. RedesigningFidgetSpinner
To Meet Both Technical Validity and Playfulness

104. SignalProcessing
Signal Pipeline
PPG Sensor
Hall Sensor
DisplayMicro-controller
(500Hz Sampling)
Heart RateVariability
Respiration
Action
PPG Sensor Signals
Hall Sensor Signals
PC

105. For respiration training
BioFeedback
Signals
Guidance and Feedback

106. Breathing
Guidance

107. HRV Status
BioFeedback
Display
Heart RateVariability
Inter-Beat Interval
Heartbeat

108. TwowaysofRespirationTraining
3-min Respiration Trainings in a static context
Flicks the spinner while exhaling Blows on the spinner by exhaling

109. Flicks the spinner while exhaling Blows on the spinner by exhaling
3-min Respiration Trainings in a static context
TwowaysofRespirationTraining

110. Flicks the spinner while exhaling Blows on the spinner by exhaling
3-min Respiration Trainings in a static context
TwowaysofRespirationTraining

111. Exhalation quality
BioFeedback
Respiration
Display

112. 0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
Accelerometer
0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
(s)
Flicks the spinner while exhaling Blows on the spinner by exhaling
TechnicalValidity
Results

113. Accelerometer
0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
(s)
2X 2X
Flicks the spinner while exhaling Blows on the spinner by exhaling
TechnicalValidity
Results

114. Accelerometer
0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
0 60 120 0 60 120 (s)
revolution speed
revolution acceleration
acceleration
interbeat interval
blood volume pulse
interbeat interval
blood volume pulse
sensorsonfidgetspinnerbaseline
HallAPPGPPG
(s)
2X 2X
Corrupted
Flicks the spinner while exhaling Blows on the spinner by exhaling
TechnicalValidity
Results

115. FunctionalExtension
Adding a clip to stabilize HRV sensing
Without a clip With a clip

116. UserStudy
PPG sensor #2
(baseline)
respiration training in a personally comfortable way
Without a clip
With a clip

117. Without a clip
With a clip
PPG sensor #2
(baseline)
UserStudy
respiration training in a personally comfortable way

118. RMSSDLF/HF
1. Respiration Training was Effective in
Both Flick and Blow Sessions.
Stress Reduced Heart-rate regulation improved
QuantitativeResults
Before After

119. 17181920212223242526272829303132
with a clip (BioFidget)
17181920212223242526272829303132
with a clip (BioFidget)
0%
25%
50%
75%
100%
1 2 3 4 5 6 7 8 9 10 111213141516
baseline (PPG #2)
without a clip (BioFidget)
0%
25%
50%
75%
100%
1 2 3 4 5 6 7 8 9 10 111213141516
baseline (PPG #2)
without a clip (BioFidget)
Participant ID
QuantitativeResults
2. The Clip Stabilized the HRV Sensing
and Enabled Blowing Input
PPG sensor #2
(baseline)

120. Flicking
Detected
Blowing
Detected
QuantitativeResults
Strategy of HRV data collection

121. 0%
25%
50%
75%
100%
500 400 300 200
0%
25%
50%
75%
100%
500 400 300 200
window size (ms)
accuracy
detectionrate
0%
25%
50%
75%
100%
500 400 300 200
300
270
240
210
180
150
120
90
60
window size (ms)
0%
25%
50%
75%
100%
500 400 300 200
recall
window size (ms) window size (ms)
Recall: FlickingRecall: BlowingAction Detection RateAccuracy: Overall
recall
minimal
velocity
(rpm)
QuantitativeResults
3. Actions were Reliably Recognized
(with High Recall of Blowing Recognition)
W
d
Vmax
Vmax
Resultsofactivityrecognitionusingdasfeature
W = 500ms;Vmax ≥ 60rpm: 87.9% accuracy; 96.2% detection rate.
W W W W

122. 31(outof32)participants:
ThebreathingguidancethroughthelightonBioFidgetwasclearandeasytoperceive.
20participants:
Spinningthefidgetmadethemfeelrelaxedandmoreabletofocusonthebreathingguidance.
26participants:
Thefeedbackengagedandmotivatedthemtoperformbetterinbreathingtraining.
UserFeedback
General responses

123. “IfeelimmersedintheexperiencewhenIwasstaringatthedevice”(P19)
“itmademefeelengagedandthusencouragedmetospinitfaster,”(P14,P23,P25)
“Ipreferredtoseeacolorfullightinsteadoftheredone,whichmotivatedmetoblowonit
harder.”(P30,P31)
“itwasanamusingvisualizationandalsoarewardformyperformance.”(P1).
”toreleasemystress”(P8),“clearmymind”(P4),and“makememoreconsciousaboutmy
breathing”(P9).
“Ibreathedsloweranddeeperwithitsfeedback.Ibelieveitishelpfultoadjustmy
breathing,”(P9)and“ithelpsintrainingmylungcapacity”(P1).
“Ireallylikethistangiblewaytomanipulatingthisdevice”(P1).
“Thisinnovationisbasedontherightobjectandmakeitmoreuseful”(P15).
UserFeedback
Individual responses

124. BioFidget: Biofeedback for Respiration Training
Using an Augmented Fidget Spinner
Rong-Hao Liang
Bin Yu
Mengru Xue
Jun Hu
Loe M. G. Feijs
Department of Industrial Design
Eindhoven University of Technology, the Netherlands
ProjectPage:http://tinyurl.com/CHI18BioFidget
BioFidget: a smart fidget spinner that detects stress directly and
provides a biofeedback intervention for respiration training

125. RIPPLE THERMOSTAT
AFFECTING THE EMOTIONAL EXPERIENCE
THROUGH FORCE FEEDBACK & SHAPE CHANGE
Anke van Oosterhout | Miguel Bruns | Satu Jumisko-Pyykkö

127. HOW CAN WE DESIGN FOR
INTERACTION WITH SYSTEMS
THAT BECOME MORE
INTELLIGENT AND ADAPTIVE?
WHY?

128. TANGIBLE INTERACTION
Haptic Force Feedback
& Shape Change

132. How will interaction mediated by the display, force feedback and
shape change affect the emotional experience?
STUDY 1: MODALITY EXPERIMENT

136. STUDY
3x3 within subject | 32 participants
TASK
Increase the temperature from 10 to 22 degrees

137. MEASURES
Emotional experience (SAM)
Valence (pleasure) | Arousal (excitement) | Dominance (feeling of control)
AttrakDiff questionnaire
Interview

138. RESULTS
FORCE FEEDBACK
Affects the experienced dominance (feeling of control)
SHAPE CHANGE
Affects the experienced arousal (excitement)

139. CO-DESIGN STUDY
How can force feedback and
shape change convey affective
meaning in a human-computer
dialogue?

141. SCENARIOS
Participants designed the behavior of the thermostat for
3 scenarios supporting energy savings

142. SCENARIO 1
Results | Shape Change

143. SCENARIO 2
Results | Shape Change

144. SCENARIO 3
Results | Shape Change

145. SUMMARY
Force feedback has the potential to mediate control in a
human-computer dialogue
Shape change can be used to convey basic emotional expressions
in a human-computer dialogue
Force feedback and shape change could extend the interaction
vocabulary of everyday intelligent systems and make interaction more
intuitive and intelligible.