Presented at https://www.meetup.com/Natural-Language-Processing-Zagreb

1. • Text Analysis and Knowledge Engineering Lab
Faculty of Electrical Engineering and Computing
University of Zagreb
takelab.fer.hr

2. Personality Prediction and NLP

3. Author profiling
Gender
Age
Personality
Occupation

4. Personality
• The combination of characteristics or qualities that form an individual's
distinctive character.
• A set of habitual behaviors, cognitions and emotional patterns that
evolve from biological and environmental factors

5. Personality
– Big Five

6. Personality
– MBTI

8. MBTI vs Big Five
• Big 5
• valid and reliable
• MBTI
• used for self-discovery, Human Resources, dating
• „the fad that won’t die”
• very popular in US

11. Michal Kosinski

12. Michal Kosinski

13. C
a
m
b
r
i
d
g
e
A
n
a
l
y
t
i
c
a

14. Facebook Twitter Essays Forums EAR
Anonymus n y/n n y n
Diverse
Topics
y/n y/n n n n
A lot of
users
y y n n n
Expressivity y/n n y y y
Biased y
Ease of
labelling
n y n y n

15. Facebook Twitter Essays Forums EAR Reddit
Anonymus n y/n n y n y
Diverse
Topics
y/n y/n n n n y
A lot of
users
y y n n n y
Expressivity y/n n y y y y
Biased y
Ease of
labelling
n y n y n y

16. Reddit
• Over 1.2
million
subreddits
• 330 million
users
• 4th web-site
in US, 6th in
the world

19. Data
acquisition
• 122 MBTI-related
subreddits
• 13,631 users with MBTI
flairs

20. Data
acquisition
• 122 MBTI-related
subreddits
• 13,631 users
• 36,676 subreddits
• 354,996 posts
• 22.9 million
comments
• 583 million words

21. Reddit and personality

22. Topical affinity
LDA, entropy,
semantic
categories
User activity
features
Psycholinguistic
features
26
Linguistic features
Linguistic Inquiry
and Word Count
(LIWC)
93
Character and
word n-grams
11400
Comments
and posts
metrics
Commening
behavior
Temporal
features

23. Extrovert -
introvert
Friend
Social
„friday”
„at
least”
„i’m an
extrovert”
Exclam
Inuitive - Sensing
Is_self_median
Avg_img
„my ”
„cliché”
„exist”
Sixltr
Thinking-Feeling
„happy”
„love”
pronoun
Affect
Emotion
„i love”
Judging-
Perceiving
„husband”
„plan”
Work
Home
„help”

24. Feature analysis
Top 30 relevant features
distribution
Relevant features per group
and dimension

25. Feature analysis
Relevant features per group

26. Experimental setup and models
• SVM, Logistic Regression, MLP (3-layered)
• Nested stratified cross-validation for each dimension
• 5 outer loops
• 5 or 10 inner loops (C, gamma)
• F1 macro evaluation criterion
• class-weighting
• Per feature group and using all features (selection)

27. Results

28. Results

30. What’s next?
• More data
• Dataset augmentation (age, gender, ..)
• Deep learning
• multi-task (age, gender, religion, sexuality, political stance)
• domain adaptation (Twitter)
• Challenges
• How to model large number of comments?
• How to behavioral patterns and temporal change?

31. Questions?

32. • Personality prediction on Reddit
• https://peopleswksh.github.io/pdf/PEOPLES12.pdf
• https://www.gsb.stanford.edu/insights/science-behind-cambridge-
analytica-does-psychological-profiling-work
• The End of privacy – Kosinski:
• https://www.youtube.com/watch?v=X9jVjCVOUIM
• https://scholar.google.hr/scholar?hl=en&as_sdt=0,5&q=stillwell+kosi
nski
• http://www.wired.co.uk/article/chinese-government-social-credit-
score-privacy-invasion
• http://www.wwbp.org/publications.html