1. WP 5 Presentation
Christoph Hintermüller (g.tec)

2. Proposed Structure for the Talk
• goals
• achievements
• problems
• outlook/ future work
• lessons learned
• list of publications
11.06.2013 WP 5 Presentation 2

3. Goals
• Develop an EEG based brain-computer interface for
robot control
• Usage of the BCI system for goal oriented and
continuous control
• Test the BCI system for different applications
11.06.2013 WP 5 Presentation 3

4. Goals
11.06.2013 WP 5 Presentation 4
• Milestones
M3: First release of BCI (Month 12)
M4: First ALIAS pilot (Month 12)
M7: Second ALIAS pilot (Month 24)
M9: Final ALIAS pilot (Month 35)
• Deliverables
D5.1: Rapid Prototyping Environment (Month 6)
D5.2: BCI System (Month 12)
D5.3: Tests of the BCI System with the Robot (Month 36)
• Gantt
Y1 Y2 Y3
Task 1 2 1 2 1 2
3
05. Jan Setup Rapid Prototyping D5.1
05. Feb Development of P100, SSVEP and oscillatroy BCI D5.2
05. Mrz Interfacing BCI system to robot D5.3
05. Apr BCI system tests with robot D5.3
Milestones M3,4 M7 M9
Activity
WP5 Brain Computer Interface

5. Achievements
11.06.2013 WP 5 Presentation 5
• 2 x g.MOBIlab 8 channel devices including EEG cap,
active electrodes, Matlab Simulink BCI Models
(SSVEP, P300), g.BSanalyze, EEG processing
toolboxes
• Installed at Fraunhofer FhG, g.tec, Jade

6. Achievements
11.06.2013 WP 5 Presentation 6
• First dry electrode system that works for motor imagery, SSVEP and
P300 (same accuracies reached for all)
• Whole frequency range available: 0.1-40 Hz
• First dry electrode system that covers extended 10/20 system on
frontal, central, parietal and occipital sites
• More low frequency components in the EEG spectrum below 3 Hz
• Careful montage required and more sensitive to surrounding noise
• Group studies submitted in March 2011 to Journal of Neural
Engineering and BCI conference in Graz 2011.

7. Achievements: SSVEP P-Statistics
11.06.2013 WP 5 Presentation 7
• Rectification of SNR signals to
zero sample median.
• Soft-Max transformation used to estimate probabilities p
• Sample assigned to Virtual Zero Class if 1 – p < Confidence interval

8. Achievements: P300 decisions using p-statistic
• Online selection of # of flashes: p-statistics based
• Residual error limits: 0.15% decision, 25% P300 validation
• Minimum 2, maximum 15, average 7 flashes
11.06.2013 WP 5 Presentation 8
min mean max min mean max min mean max
off 2,33 6,94 14,11 6,00 7,33 9,33 3,17 6,58 9,67
30,00 2,44 7,11 14,78 7,67 7,67 7,67 3,56 6,51 10,22
25,00 2,44 7,11 14,78 5,00 6,33 9,00 3,78 7,13 10,56
20,00 2,44 7,22 14,44 5,00 6,93 9,00 3,44 7,02 10,78
15,00 2,44 7,16 14,44 3,33 8,06 12,00 3,44 7,06 10,56
10,00 2,44 6,80 14,00 4,33 6,13 8,33 3,33 7,56 12,44
5,00 3,56 7,33 14,00 5,57 6,43 7,29 4,22 8,64 12,22
2,50 3,67 7,14 13,67 5,17 8,39 11,67 4,33 9,00 13,56
1,00 4,11 7,06 12,11 6,71 8,79 10,86 4,22 8,57 13,56
0,50 3,25 5,71 10,13 5,86 7,93 10,00 4,56 8,22 12,89
0,10 5,43 6,52 8,57 2,80 5,40 8,00 4,56 8,03 12,56
TTP
FTP
FP
True positive selection
Positiv selection, false assignment
False Positiv selection
Total spelled 28 char
Total ignored 28 char
Residal Error
Probability [%]
Parameters
considered
Average Values: count(p>1-r) = 1
# Repetitions
P3selectionerrorprobability[%]
0,15
TTP FTP FP

9. Achievements: BCI ACTOR
11.06.2013 WP 5 Presentation 9
Network (UDP)
Communication
Interface
Structure
• General structure
– UI is controlled with the BCI system
( MI BCI, SSVEP BCI, P300 BCI)
– AIM: Adaptive Interface Module
• Grouping of applications
• Receives real time updates
• Prepares information for UI
– Application group: applications controlled by
one network node (e.g. Home Automation)
• XML string from UDP message or local file
– Mask layout and structure
– ICONs
– Command Types and Instructions
• Initialized via UDP socket

10. Achievements: BCI ACTOR
11.06.2013 WP 5 Presentation 10
Mask
Description
Chat Mask
Contact Mask

11. Achievements: Integration
• with Dialog Manager
• with Gui
11.06.2013 WP 5 Presentation 11
Component/Service Status Paradigm
Entertainment Yes
P300
Games Yes
Audio Books Yes
TV Yes
WII Switching to WII
Communication Yes
Skype outgoing call Yes
Skype incoming call Yes/Schiedlberg
Initiate emergency
call
Yes
Web-browser Loading browser
Call/Dismiss No/2013
SSVEPDirect emergency call No/2013
Cancel emergency call No/2013
Paradigm SOCI BCI
processing
Integrated
P300 single
character
Yes
Yes YES
P300 row
column
No
Yes -
SSVEP
onscreen
Yes
Yes -
SSVEP
LED
-
Yes No

12. Achievements: Fieldtrials 2012
11.06.2013 WP 5 Presentation 12

13. Problems
11.06.2013 WP 5 Presentation 13

14. Outlook / Future Work
• Ongoing developments
• Integration signal check module
• Combination: accuracy based selection of optimal # of flashes
and p-statistics
• SOCI multi line text
• SOCI icon size independent of mask size and window size
• SOCI support for greyscale, color Icons
• SOCI elimination shared network drive
• ACTOR protocol improvements and speedup
• User tests
• Munich in coordination with TUM
• Only tested with ALIAS members
11.06.2013 WP 5 Presentation 14

15. Lessons Learned
11.06.2013 WP 5 Presentation 15

16. List of Publications
• Papers, Book Chapters
• C. Guger, G. Krausz, B. Allison, G. Edlinger (2012): Comparison of dry and gel based
electrodes for P300 brain–computer interfaces. Front. Neurosci. 6 :60. doi:
10.3389/fnins.2012.00060.
• Fazel-Rezai R, Allison BZ, Guger C, Sellers EW, Kleih SC and Kübler A (2012): P300 brain
computer interface: current challenges and emerging trends. Front. Neuroeng. 5:14. doi:
10.3389/fneng.2012.00014
• J.A. Wilson; C. Guger, G. Schalk: BCI Hardware and Software. In Jonathan R. Wolpaw,
Elizabeth Winter Wolpaw (2012): Brain-Computer Interfaces: Principles and Practice. Edited by:
Jonathan R. Wolpaw, Elizabeth Winter Wolpaw. Publisher: Oxford Univ Pr. Publication Date: 1.
Edition, January 24, 2012. ISBN: 978-0-195-38885-5.
• Lechner, R. Ortner, F. Aloise, R. Prueckl, F. Schettini, V. Putz, J. Scharinger, E. Opisso, U.
Costa, J. Medina, C. Guger (2012): Comparing the accuracy of a P300 speller for people with
major physical disability. In Proceedings of ICCHP. July 11 – 13,2012. Linz, AT.
• C. Hintermüller, C. Kapeller, G. Edlinger, C. Guger, BCI Integration: Application Interfaces, In
Brain Computer Interface, Edited by: Fazel-Razi, Intech, 2013, ISBN 980-953-307-960-3
• Fares/Conferences
• IEEE Biorob 2012, Rom, IT. June 24 – 28, 2012.
• Measuring Behaviour 2012. Aug 28 – 31, 2012. Utrecht, NL
• Joint Annual Meeting ECNS - ISNIP - ISBET – EPIC. Sep 12 – 16, 2012. Bristol, TN, US.
11.06.2013 WP 5 Presentation 16