PA2 Session 5

1. Python with AI – 2
Session 5

2. Session recap
Session Number What is covered
1 Python basics – recap
2 pandas dataframes and histograms
3 Bar charts – REST API
4 REST API and Precision Recall
5 Scatter plots and ROC curve
6 ROC curve and line plots
7 Model boundary visualization
8 Final Projects

3. Appointment Planning dataset - kaggle
• Plot a histogram of the label column `No-show`
• What do you observe?

4. How do you overcome the skew problem?
• Resample the data to have equal frequency for the categories
• https://repl.it/@AIClubAcademy/appointmentData#main.py

5. Scatter plots (Classification)
• We will analyze the titanic dataset:
https://www.kaggle.com/c/titanic/data

6. Scatter Plots
• Libraries: matplotlib, seaborn

7. Scatter Plots – continuous variables
• Libraries: matplotlib

8. Scatter Plots – continuous variables
• Libraries: matplotlib

9. Scatter Plots – continuous variables
• Libraries: matplotlib

10. Scatter Plots – categorical variables
Both variables are categories. Create a matrix that shows
the number of occurrences in each combination

11. Scatter Plots – categorical variables
Both variables are categories. Create a matrix that shows
the number of occurrences in each combination
Sex/Pclass Male Female
1
2
3

12. Scatter Plots – categorical and continuous

13. Scatter plots - Regression
• Car prices dataset:
https://www.kaggle.com/CooperUnion/cardataset

14. Project Data Analysis
• Distribution of the prediction variable
• Scatter plots of the data

15. Github
• Please create an account at github: https://github.com/

16. Model - analysis
• Confusion Matrix
• Precision
• Recall
𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒𝑠
𝑅𝑒𝑐𝑎𝑙𝑙 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒𝑠

17. Model - analysis
• Confusion Matrix
• Precision
• Recall
• False Positive Rate
𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒𝑠
𝑅𝑒𝑐𝑎𝑙𝑙 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒𝑠
𝐹𝑎𝑙𝑠𝑒 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑟𝑎𝑡𝑒 =
𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒
𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝑇𝑟𝑢𝑒 𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒

18. Model - analysis
• Confusion Matrix
• Precision
• Recall
• False Positive Rate
• True positive rate =
Recall = Sensitivity
𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒𝑠
𝑅𝑒𝑐𝑎𝑙𝑙 =
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠
𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑣𝑒𝑠 + 𝐹𝑎𝑙𝑠𝑒 𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒𝑠
𝐹𝑎𝑙𝑠𝑒 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑟𝑎𝑡𝑒 =
𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒
𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝑇𝑟𝑢𝑒 𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒

19. ROC curve

20. http://aiclub.world