Quality Assurance of Machine Learning-based AI Systems

•

2 gefällt mir•710 views

Fuyuki Ishikawa

At JaSST'21 Tokyo, Mar 16 2021

Software

0 20 40 60 80 100
Architecture Design
Training Data
Operation
Project Management
Updates
Debugging
Testing & Quality Evaluation / Assurance
Decision Making with Customers

Empfohlen

Machine learning testing survey, landscapes and horizons, the Cliff NotesHeemeng Foo

How AI is Transforming Project Management - PMI Silver Spring Chapter - Octob...Hector Del Castillo, CPM, CPMM

PAKDD2023_Tutorial_T2 (Overview, Part 1, and Part 2)JunSuzuki21

Emeli Dral (Evidently AI) – Analyze it: production monitoring for machine lea...Codiax

LLMs_talk_March23.pdfChaoYang81

Explainability for Natural Language ProcessingYunyao Li

Explainable AI: Building trustworthy AI models? Raheel Ahmad

AI Use Cases OAObject Automation

Empfohlen

Machine learning testing survey, landscapes and horizons, the Cliff NotesHeemeng Foo

How AI is Transforming Project Management - PMI Silver Spring Chapter - Octob...Hector Del Castillo, CPM, CPMM

PAKDD2023_Tutorial_T2 (Overview, Part 1, and Part 2)JunSuzuki21

Emeli Dral (Evidently AI) – Analyze it: production monitoring for machine lea...Codiax

LLMs_talk_March23.pdfChaoYang81

Explainability for Natural Language ProcessingYunyao Li

Explainable AI: Building trustworthy AI models? Raheel Ahmad

AI Use Cases OAObject Automation

Explainability for Natural Language ProcessingYunyao Li

Artificial Intelligence in Project Management by Dr. Khaled A. HamdyAgile ME

Explainability for Natural Language ProcessingYunyao Li

Explainable AI in Industry (AAAI 2020 Tutorial)Krishnaram Kenthapadi

AI Solutions in ManufacturingSri Ambati

AI and ML 101Rustem Zakiev

Generative-AI-Exploring-beyond-the-horizons-possibilities-of-AI-WP.pdfshashanksalunkhe12

Artificial Intelligence in ManufacturingArtificial Intelligence Institute at UofSC

AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)byteLAKE

【個股產業分析】被動元件產業分析Collaborator

【個股產業分析】動力電池產業分析Collaborator

Leveraging Generative AI & Best practicesDianaGray10

Nasscom AI top 50 use casesADDI AI 2050

Revolutionizing your Business with AI (AUC VLabs).pdfOmar Maher

The Role of Artificial Intelligence in Manufacturing : 15 High Impacted AI Us...CANOPY ONE SOLUTIONS

GENERATIVE AI, THE FUTURE OF PRODUCTIVITYAndre Muscat

intro chatGPT workshop.pdfpeterpur

【個股產業分析】被動元件產業分析Collaborator

2023年投資展望會-電子產業.pdfJTLai1

10 Key Considerations for AI/ML Model GovernanceQuantUniversity

機械学習工学の進展と課題 2021Fuyuki Ishikawa

機械学習システムの品質に関するソフトウェア工学の動向（と安全性）Fuyuki Ishikawa

Weitere ähnliche Inhalte

Was ist angesagt?

Explainability for Natural Language ProcessingYunyao Li

Artificial Intelligence in Project Management by Dr. Khaled A. HamdyAgile ME

Explainability for Natural Language ProcessingYunyao Li

Explainable AI in Industry (AAAI 2020 Tutorial)Krishnaram Kenthapadi

AI Solutions in ManufacturingSri Ambati

AI and ML 101Rustem Zakiev

Generative-AI-Exploring-beyond-the-horizons-possibilities-of-AI-WP.pdfshashanksalunkhe12

Artificial Intelligence in ManufacturingArtificial Intelligence Institute at UofSC

AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)byteLAKE

【個股產業分析】被動元件產業分析Collaborator

【個股產業分析】動力電池產業分析Collaborator

Leveraging Generative AI & Best practicesDianaGray10

Nasscom AI top 50 use casesADDI AI 2050

Revolutionizing your Business with AI (AUC VLabs).pdfOmar Maher

The Role of Artificial Intelligence in Manufacturing : 15 High Impacted AI Us...CANOPY ONE SOLUTIONS

GENERATIVE AI, THE FUTURE OF PRODUCTIVITYAndre Muscat

intro chatGPT workshop.pdfpeterpur

【個股產業分析】被動元件產業分析Collaborator

2023年投資展望會-電子產業.pdfJTLai1

10 Key Considerations for AI/ML Model GovernanceQuantUniversity

Was ist angesagt? (20)

Explainability for Natural Language Processing

Artificial Intelligence in Project Management by Dr. Khaled A. Hamdy

Explainability for Natural Language Processing

Explainable AI in Industry (AAAI 2020 Tutorial)

AI Solutions in Manufacturing

AI and ML 101

Generative-AI-Exploring-beyond-the-horizons-possibilities-of-AI-WP.pdf

Artificial Intelligence in Manufacturing

AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)

【個股產業分析】被動元件產業分析

【個股產業分析】動力電池產業分析

Leveraging Generative AI & Best practices

Nasscom AI top 50 use cases

Revolutionizing your Business with AI (AUC VLabs).pdf

The Role of Artificial Intelligence in Manufacturing : 15 High Impacted AI Us...

GENERATIVE AI, THE FUTURE OF PRODUCTIVITY

intro chatGPT workshop.pdf

【個股產業分析】被動元件產業分析

2023年投資展望會-電子產業.pdf

10 Key Considerations for AI/ML Model Governance

Mehr von Fuyuki Ishikawa

機械学習工学の進展と課題 2021Fuyuki Ishikawa

機械学習システムの品質に関するソフトウェア工学の動向（と安全性）Fuyuki Ishikawa

ロバスト機械学習へのソフトウェア工学からのアプローチFuyuki Ishikawa

機械学習工学への誘い：SES'20チュートリアルFuyuki Ishikawa

Introduction at MLSE Int'l Symposiuim 2019Fuyuki Ishikawa

高信頼自動運転システム実現にむけて：ソフトウェア工学・機械学習の視点からの技術俯瞰Fuyuki Ishikawa

IoT/AI時代のテスティング・検証技術の最前線Fuyuki Ishikawa

（今ちゃんと振り返る）ゴール指向要求分析入門Fuyuki Ishikawa

品質保証における発見的・経験的アプローチの活用：ソフトウェアテスティング分野からの知見Fuyuki Ishikawa

スマートなシステム、スマートなディペンダビリティ保証－次世代システムを頼れるものへFuyuki Ishikawa

機械学習応用システムの品質保証に向けてFuyuki Ishikawa

自動（運転）車システムのためのAI的自動テスト生成Fuyuki Ishikawa

AIによるテスト・デバッグ技術イントロ＆チュートリアルFuyuki Ishikawa

Mehr von Fuyuki Ishikawa (13)

機械学習工学の進展と課題 2021

機械学習システムの品質に関するソフトウェア工学の動向（と安全性）

ロバスト機械学習へのソフトウェア工学からのアプローチ

機械学習工学への誘い：SES'20チュートリアル

Introduction at MLSE Int'l Symposiuim 2019

高信頼自動運転システム実現にむけて：ソフトウェア工学・機械学習の視点からの技術俯瞰

IoT/AI時代のテスティング・検証技術の最前線

（今ちゃんと振り返る）ゴール指向要求分析入門

品質保証における発見的・経験的アプローチの活用：ソフトウェアテスティング分野からの知見

スマートなシステム、スマートなディペンダビリティ保証－次世代システムを頼れるものへ

機械学習応用システムの品質保証に向けて

自動（運転）車システムのためのAI的自動テスト生成

AIによるテスト・デバッグ技術イントロ＆チュートリアル

Kürzlich hochgeladen

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave

Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.

Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH

HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai

Optimizing AI for immediate response in Smart CCTVshikhaohhpro

5 Signs You Need a Fashion PLM Software.pdfWave PLM

Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110

Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3

What is Binary Language? Computer Number SystemsJheuzeDellosa

Exploring iOS App Development: Simplifying the ProcessEvangelist Apps https://twitter.com/EvangelistSW/

SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AIABDERRAOUF MEHENNI

why an Opensea Clone Script might be your perfect match.pdfjoe51371421

Project Based Learning (A.I).pptx detail explanationkaushalgiri8080

The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171

CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823

Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy

Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531

Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure

Kürzlich hochgeladen (20)

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Der Spagat zwischen BIAS und FAIRNESS (2024)

HR Software Buyers Guide in 2024 - HRSoftware.com

Optimizing AI for immediate response in Smart CCTV

5 Signs You Need a Fashion PLM Software.pdf

Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...

Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data

What is Binary Language? Computer Number Systems

Exploring iOS App Development: Simplifying the Process

SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI

why an Opensea Clone Script might be your perfect match.pdf

Project Based Learning (A.I).pptx detail explanation

The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf

CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

Hand gesture recognition PROJECT PPT.pptx

Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...

Quality Assurance of Machine Learning-based AI Systems

2. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

3. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

4. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

5. ◼ ◼ ◼

6. ◼

7. ◼ ◼ ◼ ◼

8. ◼ ◼ ◼ ◼ ◼ ◼ ◼

9. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

12.

14. ◼ ◼

16. ◼

17. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

18. ◼ ◼ ◼ ◼ ◼ ◼

19. 0 20 40 60 80 100 Architecture Design Training Data Operation Project Management Updates Debugging Testing & Quality Evaluation / Assurance Decision Making with Customers

20. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

21. ◼ ◼ ◼ ◼ ◼

22. ◼

23. ◼ ◼ ◼ ◼ ◼ ◼

24. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

25. ◼ ◼ ◼

26. ◼ ◼ ◼ 𝑇𝑃 𝑇𝑃 + 𝐹𝑃 = 15 45 = 0.3333

27. ◼ ◼ ◼ ◼ ◼ ◼ ◼

28. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

29. ◼ ◼ ◼ ◼

30. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

31. • • • • • • • • • • •

32. ◼ • • • • • • • •

33. ◼

34. ◼ ◼

35. ◼

36. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

37. ◼ ◼ ◼ ◼

38.

39.

40. ◼ ◼ ◼ ◼ ◼ ◼ ◼

41. ◼ ◼

42. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

45. ◼ ◼

49. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

50. ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼

51. ◼ ◼ ◼ ◼ ◼