2. AGENDA
What we will cover
Why we need Feature Engineering
What is Feature Engineering Art?
Machine Learning Process
Feature Engineering Process
Manual Construction
Automatic Construction
Feature Selection
Workshop
6. OVERVIEW
What is Feature
Engineering Art?
Feature
Feature is an individual measurable property or characteristic of a
phenomenon being observed.
Raw Data Feature Model Insight
Feature Engineering Art
7. OVERVIEW
What is Feature
Engineering Art?
Feature engineering is manually designing what the
input xâs should be.
(Tomasz Malisiewicz)
You have to turn your inputs into things the algorithm
can understand.
(Shayne Miel)
Feature Engineering Art
14. OVERVIEW
What is Feature
Engineering Art? Merging
Crafting
Transformation
Splitting
You have to turn your inputs into things the algorithm
can understand.
Shayne Miel
Feature Engineering Art
20. HOW TO
ENGINEER
Manual
Construction
+ + +
Base Data Frame
Wednesday, March 12,2018, 12:20:59 am
Features built one at a time by hand from
given data set (S) using domain knowledge
123L - 12.5kg - 15$Simple Text
21. HOW TO
ENGINEER
Deep Feature
Synthesis
Features are derived from relationships between the data points in a
dataset.
Across datasets, many features are derived by using similar
mathematical operations.
New features are often composed from utilizing previously derived
features.
Problem specific.
Error-prone.
Limited both by human creativity and patience.
25. FEATURE
SELECTION
Feature Selection
Methods
Embedded MethodsFilter Methods Wrapper Methods
Feature Selection
Methods
Filter Methods considers the relationship between features and the target variable to compute the
importance of features.
In wrapper methods, we try to use a subset of features and train a model using them. Based on
the inferences that we draw from the previous model, we decide to add or remove features from
your subset.Forward Selection Backward Selection Recursive Feature
Elimination
Feature selection can also be acheived by the insights provided by some Machine Learning
models.
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
transformation:
a: invoice date ï season, Occasions. Weekend
b. Age ï categorical (young, teenage, adult, senior)
2. Merging
A: weight, height ï BMI
b. Startup date, yearly profilt or loose -ï growth rate
3. Splitting
a.Call records ï day active or night active
4. Crafting feature
Scrapping social media for customer ï offers (card ahlawy)
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs
Which technique to be applied and when
You should have vision to extract features
Know the right question to get the right answer
3awz azwd arba7,
ytl3 mno el seasons w el holidays
A3ml sales ll setat aw fe2a mo3yna
A customize bona2n 3la customer needs