Youtube: https://www.youtube.com/watch?v=__5H-MopPts Adversarial attack/defense against machine learning models in digital world. NorthWestSec, a team of independent security researchers concentrating on AI and security topic. They have demonstrated the Hacking Google reCaptcha using Deep learning technology at GeekPwn 2017 in Silicon Valley.

3. •

4. •
•
•
•
•
•
•
•
•

5. CleverHans

6. Adversarially trained ImageNet models

7. • •

8. Inception V3 Adv_Inception V3 Ens_adv_Ires V2
BIM_inception 88.5% 0 0
BIM_adv_inception 0 75.7% 0
BIM_ens_adv_IRes 0 0 85.3%
BIM_ens3 93.7% 76.8% 81.5%
Hit-target rate

9. Inc: Inception V3
Ires: Inc_resnet_v2
GD: Guided Denoise
RP: Random Padding

10. Defense Attack
Ensemble adversarial training Ensemble adversarial attacking
Gradient masking White-box attack + transferability
Random perturbation
Gradient smoothing
Image processing and randomization Expectation over transformation (EOT)
Detection ??

13. • Robust against neural-network-based adversarial attack

14. • Kmean filter

16. •
•