Linking brain systems and mental functions requires accurate descriptions of behavioral tasks and fine demarcations of brain regions. To date, no data collection has systematically addressed the functional mapping of cognitive mechanisms at a fine spatial scale. The Individual Brain Charting (IBC) dataset stands for a high-resolution multi-task fMRI dataset that intends to provide a framework toward a comprehensive functional atlas of the human brain. The data refer to a permanent cohort (12 participants) performing many different tasks, free from both inter-subject and inter-site variability. The first release of the IBC dataset is already out and publicly available in the OpenNeuro (ds000244) and NeuroVault (id=4438). These maps reveal a successful cognitive encoding of many psychological domains in large areas of the human brain, as the main findings of the original studies were reproduced at a high resolution. They thus provide a comprehensive revision of the neural correlates underlying behavior, highlighting nonetheless the spatial variability of functional signatures between participants. Additionally, this dataset supports the investigation of mega-analytic encoding models to be implemented in a brain-atlasing infrastructure, by systematically mapping functional signatures associated with the cognitive components of the tasks.
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Individual Brain Charting, a high-resolution fMRI dataset for cognitive mapping of the human brain
1. Individual Brain Charting,
a high-resolution fMRI dataset
for cognitive mapping of the human brain
Ana Lu´ısa Pinho
Juan Jes´us Torre
Parietal Team, Inria-Saclay
NeuroSpin, CEA-Saclay
France
@ALuisaPinho
@JuanTresols
Open Science Room
From statistical to biological validity
OHBM Rome, Italy
11th
of June 2019
3. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain
4. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain
be specific enough to accurately isolate brain
processes
5. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain
be specific enough to accurately isolate brain
processes
⇓
Very hard to achieve!
Lack of generality.
6. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
Task-fMRI experiments allow to:
link brain systems to behavior
7. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
8. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
9. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
10. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
11. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil
12. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
Inclusion of other MRI modalities
NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil
13. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
Inclusion of other MRI modalities
Not a longitudinal study!
NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil
18. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
19. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
20. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
21. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
22. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
23. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
24. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
25. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
26. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
27. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Relational
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
visual pattern
recognition
relational comparison
28. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Relational
Social
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
visual pattern
recognition
relational comparison
response execution
29. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Relational
Social
WM
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
visual pattern
recognition
relational comparison
response execution
visual face/place
recognition
tool/body/place/face
maintenance
updating
30. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Relational
Social
WM
RSVP Language
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
visual pattern
recognition
relational comparison
response execution
visual face/place
recognition
tool/body/place/face
maintenance
updating
visual
pseudo-word/string
recognition
syntactic parsing
string/word maintenance
31. First release
Tasks
ARCHI tasks
Pinel, P. et al. (2007)
Standard
Spatial
Social
Emotional
HCP tasks
Barch, D. M. et al. (2013)
Emotion
Gambling
Motor
Language
Relational
Social
WM
RSVP Language
Cognitive concepts:
visual/auditory
arithmetic processing
visual word recognition
vertical/horizontal
checkerboard
auditory sentence
recognition
sentence processing
response selection
left/right finger response
execution
visual tool/body
recognition
visual tracking
grasping
hand chirality/side
recognition
sounds/voice perception
animacy
perception/decision
motion detection
theory-of-mind
emotion expression
identification
facial trustworthiness
recognition
gender discrimination
visual form recognition
feature comparison
emotional face
recognition
reward processing
punishment processing
left/right hand response
execution
left/right toe response
execution
working memory
story comprehension
visual pattern
recognition
relational comparison
response execution
visual face/place
recognition
tool/body/place/face
maintenance
updating
visual
pseudo-word/string
recognition
syntactic parsing
string/word maintenance
59 independent conditions
226 contrasts
32. Future releases
Next release is coming up soon!
Mental-Time Travel Gauthier, B., & van Wassenhove, V. (2016a,b)
Positive-Incentive Value Lebreton, M. et al. (2015)
Theory-of-Mind + Pain Matrices Dodell-Feder, D. et al. (2010) / Jacoby, N. et al. (2015)
Visual Short-Term Memory + Enumeration Knops, A. et al. (2014)
Self-Reference Effect Genon, S. et al. (2014)
33. Future releases
Next release is coming up soon!
Mental-Time Travel Gauthier, B., & van Wassenhove, V. (2016a,b)
Positive-Incentive Value Lebreton, M. et al. (2015)
Theory-of-Mind + Pain Matrices Dodell-Feder, D. et al. (2010) / Jacoby, N. et al. (2015)
Visual Short-Term Memory + Enumeration Knops, A. et al. (2014)
Self-Reference Effect Genon, S. et al. (2014)
First + Second release:
127 independent conditions
279 contrasts
34. Future releases
Next release is coming up soon!
Mental-Time Travel Gauthier, B., & van Wassenhove, V. (2016a,b)
Positive-Incentive Value Lebreton, M. et al. (2015)
Theory-of-Mind + Pain Matrices Dodell-Feder, D. et al. (2010) / Jacoby, N. et al. (2015)
Visual Short-Term Memory + Enumeration Knops, A. et al. (2014)
Self-Reference Effect Genon, S. et al. (2014)
First + Second release:
127 independent conditions
279 contrasts
Other releases:
Visual system: Passive-Watching of Naturalistic Scenes + Movie
Watching + Retinotopy
Anatomical data + Resting-State
Tonotopy, Biological Motion and more...
40. Data access
Raw MRI data
Link
ds000244 Link
Data organization: BIDS Specification
41. Data access
Raw MRI data
Link
ds000244 Link
Data organization: BIDS Specification
Behavioral Protocols
hbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocols
42. Data access
Raw MRI data
Link
ds000244 Link
Data organization: BIDS Specification
Behavioral Protocols
hbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocols
• More public repositories of behavioral protocols to reproduce
experiments!
• Normatives to describe the experimental paradigms!
47. IBC reproduces ARCHI and HCP
storyvs.math
social-interactionmotionvs.random
motion
punishementvs.reward
tonguevs.anymotion
rightfootvs.anymotion
leftfootvs.anymotion
righthandvs.anymotion
lefthandvs.anymotion
faceimagevs.shapeoutline
relationalprocessingvs.visualmatching
toolimagevs.anyimage
placeimagevs.anyimage
faceimagevs.anyimage
bodyimagevs.anyimage
2-backvs.0-back
sentencereadingvs.sentencelistening
sentencereadingvs.checkerboard
lefthandvs.righthand
horizontalcheckerboardvs.verticalcheckerboard
mentalsubtractionvs.sentencereading
saccadesvs.fixation
leftorrighthandvs.handpalm
orback
objectgraspingvs.orientationjudgment
social-interactionmotionvs.random
motion
false-beliefstoryvs.mechanisticstory
false-belieftalevs.mechanistictale
expressionintentionvs.genderassessment
facetrustyvs.genderassessment
story vs. math
social-interaction motion vs. random motion
punishement vs. reward
tongue vs. any motion
right foot vs. any motion
left foot vs. any motion
right hand vs. any motion
left hand vs. any motion
face image vs. shape outline
relational processing vs. visual matching
tool image vs. any image
place image vs. any image
face image vs. any image
body image vs. any image
2-back vs. 0-back
sentence reading vs. sentence listening
sentence reading vs. checkerboard
left hand vs. right hand
horizontal checkerboard vs. vertical checkerboard
mental subtraction vs. sentence reading
saccades vs. fixation
left or right hand vs. hand palm or back
object grasping vs. orientation judgment
social-interaction motion vs. random motion
false-belief story vs. mechanistic story
false-belief tale vs. mechanistic tale
expression intention vs. gender assessment
face trusty vs. gender assessment
HCP contrasts ARCHI contrasts
IBCcontrasts
0.6
0.4
0.2
0.0
0.2
0.4
0.6
0.8
ARCHI batteries:
Pinel, P. et al. (2007)
HCP batteries:
Barch, D. M. et al.
(2013)
48. IBC reproduces ARCHI and HCP
ARCHI batteries:
Pinel, P. et al. (2007)
HCP batteries:
Barch, D. M. et al.
(2013)
49. Brain coverage
Group-level F-map pFWE < 0.05
x=27x=12x=-13x=-28x=-43 -80
-40
0
40
80
Comprehensive brain coverage of functional activity
already in the first release!
50. Activation similarity fits task similarity
archiemotional
archisocial
archispatial
archistandard
hcpemotion
hcpgambling
hcplanguagehcpmotor
hcprelational
hcpsocial
hcpwmrsvplanguagearchi emotional
archi social
archi spatial
archi standard
hcp emotion
hcp gambling
hcp language
hcp motor
hcp relational
hcp social
hcp wm
rsvp language 0
1
archiemotional
archisocial
archispatial
archistandard
hcpemotion
hcpgambling
hcplanguagehcpmotor
hcprelational
hcpsocial
hcpwmrsvplanguage
archi emotional
archi social
archi spatial
archi standard
hcp emotion
hcp gambling
hcp language
hcp motor
hcp relational
hcp social
hcp wm
rsvp language 0
1
52. Variability of Functional Signatures
0.0 0.1 0.2 0.3 0.4
sentence reading vs. sentence listening
sentence reading vs. checkerboard
left hand vs. right hand
horizontal checkerboard vs. vertical checkerboard
mental subtraction vs. sentence reading
saccades vs. fixation
left or right hand vs. hand palm or back
object grasping vs. orientation judgment
social-interaction motion vs. random motion
false-belief story vs. mechanistic story
false-belief tale vs. mechanistic tale
expression intention vs. gender assessment
face trusty vs. gender assessment
face image vs. shape outline
punishement vs. reward
0.0 0.1 0.2 0.3 0.4
tongue vs. any motion
right foot vs. any motion
left foot vs. any motion
right hand vs. any motion
left hand vs. any motion
story vs. math
relational processing vs. visual matching
social-interaction motion vs. random motion
tool image vs. any image
place image vs. any image
face image vs. any image
body image vs. any image
2-back vs. 0-back
read pseudowords vs. consonant strings
read words vs. consonant strings
read words vs. read pseudowords
read sentence vs. read jabberwocky
read sentence vs. read words
Average and standard deviation of map correlation across subjects
53. Effect of subject and task on brain activity
Per-voxel one-way ANOVA qFDR < 0.05
x=10
L R
z=10 -28
-14
0
14
28
L R
y=-50
Subject effect
x=10
L R
z=10 -37
-19
0
19
37
L R
y=-50
Condition effect
x=-6
L R
z=3 -12
-5.9
0
5.9
12
L R
y=45
Phase encoding effect
54. Effect of subject and task on brain activity
Per-voxel one-way ANOVA qFDR < 0.05
x=10
L R
z=10 -28
-14
0
14
28
L R
y=-50
Subject effect
x=10
L R
z=10 -37
-19
0
19
37
L R
y=-50
Condition effect
x=-6
L R
z=3 -12
-5.9
0
5.9
12
L R
y=45
Phase encoding effect
IBC data is suitable for cognitive mapping
and individual-brain modeling!
60. Concluding remarks
Data acquisition till 2022
Final dataset:
50 acquisitions per participant
Share your protocols
with us!
Encoding models for cognitive mapping
61. Concluding remarks
Data acquisition till 2022
Final dataset:
50 acquisitions per participant
Share your protocols
with us!
Encoding models for cognitive mapping
62. Thanks!
Bertrand Thirion
...and to
the IBC volunteers!!!
For more information, consult: project.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBC
Visit us tomorrow at the poster session: #W585