Rsqrd AI: Incorporating Priors with Feature Attribution on Text Classification

1. Proprietary + Conﬁdential Frederick Liu 7/17/19 @ Robust AI Incorporating priors with feature attribution on text classification

2. Proprietary + ConﬁdentialProprietary + Conﬁdential Machine learning .6 .2 .1 .3 .7 .1 .8 .7 .5.3 .1 .4 .9 .2 .0 .6.8 .2.1.6Toxic … … … … … … … Neutral … … … … … … Toxic … … … … … … … Toxic … … … … … … Neutral … … … … … … Training Inference Gay pride is in June. .6 .2 .1 .3 .7 .1 .8 .7 .5.3 .1 .4 .9 .2 .0 .6.8 .2.1.6 95% Toxic

3. Proprietary + ConﬁdentialProprietary + Conﬁdential Machine learning + Explainability .6 .2 .1 .3 .7 .1 .8 .7 .5.3 .1 .4 .9 .2 .0 .6.8 .2.1.6Toxic … … … … … … … Neutral … … … … … … Toxic … … … … … … … Toxic … … … … … … Neutral … … … … … … Training Inference Gay pride is in June. .6 .2 .1 .3 .7 .1 .8 .7 .5.3 .1 .4 .9 .2 .0 .6.8 .2.1.6 95% Toxic Gay Pride is in June 90% 1% 1% 1% 2%

4. Proprietary + ConﬁdentialProprietary + Conﬁdential Machine learning + Regularization Toxic … … … … … … … Neutral … … … … … … Toxic … … … … … … … Toxic … … … … … … Neutral … … … … … … Training Inference Gay pride is in June. .5 .2 .1 .3 .5 .1 .5 .5 .5.3 .1 .4 .5 .2 .0 .5.5 .2.1.5 85% Toxic .5 .2 .1 .3 .5 .1 .5 .5 .5.3 .1 .4 .5 .2 .0 .5.5 .2.1.5

5. Proprietary + ConﬁdentialProprietary + Conﬁdential Machine learning + Regularization + Explainability Toxic … … … … … … … Neutral … … … … … … Toxic … … … … … … … Toxic … … … … … … Neutral … … … … … … Training Inference Gay pride is in June. 15% Toxic Gay Pride is in June He is an impolite gay 0% .7 .2 .1 .3 .7 .1 .7 .5.3.4 .9 .2 .1 .6.8 .20. 1 .1 .2 .5 .7 .2 .1 .3 .7 .1 .7 .5.3.4 .9 .2 .1 .6.8 .20. 1 .1 .2 .5 + person

6. Proprietary + ConﬁdentialProprietary + Conﬁdential Regularizing + Explainability → Controllability .6 .2 .1 .3 .7 .1 .8 .7 .5.3 .1 .4 .9 .2 .0 .6.8 .2 .1.6 Explanation

7. Proprietary + ConﬁdentialProprietary + Conﬁdential Regularizing + Explainability → Controllability .6 .2 .1 .3 .7 .1 .3 .7 .5.3 .9 .4 .9 .2 .0 .6.8 .4 .1.7 Explanation More Red! Less Green!

8. Proprietary + ConﬁdentialProprietary + Conﬁdential Explainability - Integrated Gradients Link to paper - https://arxiv.org/pdf/1703.01365.pdf

9. Proprietary + ConﬁdentialProprietary + Conﬁdential Explainability + Regularization

10. Proprietary + ConﬁdentialProprietary + Conﬁdential Results - Classification Metric

11. Proprietary + ConﬁdentialProprietary + Conﬁdential Results - Fairness Metric

12. Proprietary + ConﬁdentialProprietary + Conﬁdential Results - Shift in embedding

13. Proprietary + Conﬁdential Thank You Link to paper - https://arxiv.org/pdf/1906.08286.pdf Sign up if you want to know more: bit.ly/model-interpret-interest

Rsqrd AI: Incorporating Priors with Feature Attribution on Text Classification

Du liest eine Vorschau.

Hier ansehen

Rsqrd AI: Incorporating Priors with Feature Attribution on Text Classification

Weitere Verwandte Inhalte

Weitere von Sanjana Chowdhury (8)

Aktuellste (20)