SlideShare ist ein Scribd-Unternehmen logo
1 von 30
Downloaden Sie, um offline zu lesen
Bridging the Gap Between
Development and Regulatory
Teams
Milton Yarberry
Director of Medical Programs, ICS
About ICS and Boston UX
Creating Transformative Products That Advance Patient Care
2
www.ics.com/medical
ICS’ design studio
specializes in intuitive
touchscreen and
multimodal interfaces for
high-impact embedded and
connected devices.
Established in 1987, ICS delivers innovative
medtech solutions with a full suite of
services to accelerate development, testing
and certification of successful next-gen
products.
ICS and Boston UX are headquartered in
Waltham, Mass. with offices in California,
Canada and Europe.
Delivering a Full Suite of Medtech Services
3
● Human Factors Engineering
● IEC 62366-UX/UI Design
● Custom Frontend and Backend Software Development
● Development with IEC 62304-Compliant Platform
● Low-code Tools that Convert UX Prototype to Product
● Medical Device Cybersecurity
● AWS and Azure Cloud Services and Analytics
● ISO 14971-Compliant Hazard Analysis
● Software Verification Testing
● Complimentary Software Technology Assessment
Development 🡪 Regulatory
My background
Development Regulatory
4
Software & Systems Engineering
Complex Systems
Machine Learning
Software Architecture
Engineering and Project Management
Agile/Scrum
Waterfall
PMP
Regulatory
Safety & Efficacy
Standards
Compliance
Agenda
1. Defining the problem – the Gap
2. Complicating Factors
3. Bridging – the Gap
4. Nuances
5. Summary
5
Defining the Problem
6
Defining the Problem
Native Characteristics Cloud
7
Development Regulatory
Defining the Problem
Native Workflow
8
Validation
Verification
Specifications
Requirements
User needs
Intended use product
clinician
Product Risk
patient
Cyber
Development Regulatory
hard
part
first
prioritize
Investigate
example test
debug
modify analysis
test
done
• Do a bit of everything
• Iterate towards a solution
• Discovery
• Result driven, dynamic process
• Start at the top and trace down
• Hierarchical
• Phases
• Defined, static process
failure or
success?
evolving
thinking
System SW UX Cyber
… … … … …
… … … … …
Defining the Problem
The GAP
9
Happy to comply -
but give me
unambiguous
direction
Tailored process
that ensures Safe
and Effective
I hate writing
documents
Documentation is
in the code.
It works so,.. I’m
done!
Letter of the law
The law is
ambiguous and
rigidly enforced
Development Regulatory
Bad-Cop
Good-Cop
The
Gap
Defining the Problem
Logistical Gaps
Common events that exacerbate gaps:
Requirements
● Waiting for detailed Product Requirement decisions to be made
● Conflicting input – stems from no single source of truth that’s widely used
● No timeline for answers – no commitment to conclusion stalls progress and isn’t visible
● Lack of certainty about what level to document requirements – what’s essential for your Intended Use
Discovery
● Lack of deep understanding of corner cases – error recovery is always a deep topic that is often misunderstood/underestimated
● Deferring discovery – pushing prototyping efforts into middle schedule
Single source of truth
● Not knowing what's approved vs. under discussion
10
Complicating Factors
11
Complicating Factors
Lagging process
Process-lag
● Often/usually/always? Engineering is active before the QMS is approved
● Starting development without a QMS in place creates ambiguity
● Creates a need to ‘catch-up’
● Process-debt 🡪 confusion
Example: when should design documentation begin?
2 rules of thumb:
1) When you’re developing ‘product’ (not prototyping)
2) After the product requirements are approved
But,
1) Is there a precise point when you stop prototyping?
2) Product requirements are often evolved
12
Complicating Factors
Ambiguous process
Process-autonomy
● FDA regulations contain no specifics.
🡪 WHY?
● FDA wrote the regulations to promote
flexibility for manufacturers
● Manufacturer’s obligation to understand
their own product, environment, application
and risks
● Autonomy = process tailoring = ambiguity
13
Complicating Factors
Complexity and late discovery
Software Stacking ● Unrestrained Complexity / Staggering amount of
content
● Late discovery of technology issues can impact
non-adjacent layers – hugely disruptive
i.e. technology replacement
● Late discovery is inevitable, but the quantity and
impact can be minimized
● This effect increases in the future
Number of layers
Depth of complexity
= Geometric complication
14
Operating System
Machine Learning
Sensors
Drivers
User Interface
Actuators
Database Cybersecurity
Remote servers
3rd
party libraries
Cloud services
Downstream data consumers
Safety System
Backoffice analytics Data Warehousing
Mobile platforms Remote monitoring IoT
3rd
party libraries
3rd
party libraries
3rd
party libraries
Service Interface
Complicating Factors
Managing change
Pre-V&V (Verification & Validation)
● Pre-V&V is less formal, but
● The change process is variable and very messy
● Modification, approval, tracing of Design Outputs
Post-V&V: Overlap of change considerations
15
Change Control
Risk
Management
Technical
Change
►►►Changes ripple through design collateral
The change process is non-trivial
Complicating Factors
Managing change – A real-world Use Error Example
16
Complicating Factors
Cognitive Saturation – software engineer
Layered knowledge and constraints saturates an individual’s cognitive capacity.
17
Linux RTOS
C++ Qt
GitLab
Continuous Integration
OpenCV
CFR 820
ISO 13485 IEC 14971
IEC 62304 CLIA
Part 11
SOPs
Verification testing Validation testing
Summative testing
Usability and HF
Functional requirements Integration testing Component APIs
Chain of evidence
Safe & Effective
DHF DMR DHR Design reviews Software specs Signature auth
Unit tests
Architectural compliance Tracing into the design
Clinical Application
Bridging
18
Bridging the Gap
Process lag & Ambiguous Process
Don’t create a gap
● Define (document, approve, distribute) design expectations when developments starts
● Interim Development Plan to avoid a gap
● For example, start with a ‘prototyping process’
● If no prototyping requirements, then define the boundary to prototyping
● Size the plan to the risk of the development activity
● Grow the plan with new activities
● Make the process explicit, simple (work instructions)
Implement a QMS progressively
● Use a risk based approach to prioritize QMS procedures
● Start with: Quality Manual, Design Control, Document and Records, Risk Management
● Add as they become relevant
KISS - Keep it simple/stupid
Use tools early – don’t invent and migrate
● Starting in a spreadsheet or simple document and migrating later tends to be vastly inefficient
19
Bridging the Gap
Complexity and late discovery
Assume an environment of change
● Don’t treat change as the exception
● Build technology changes into your process
● i.e. change image library
Write plans to minimize impact of change
● Aggregate design reviews for a sub-component
Tight cross-functional development
● Changes to HW can impact SW and vice-versa
● Incompatibilities drive late discovery
● Design reviews should have exhaustive input from adjacent development groups
● Mechanical, Usability, Systems, Electrical, Software
20
Bridging the Gap
Managing change
The obvious: up-front diligence and discovery is better than late-stage testing (or
discovery in the field)
Manage Change by minimizing Change
● Analyze the risky or complex components
● Prototype testing (if you haven’t tested it, assume the packaging doesn’t match the contents)
● Detailed review (cursory buy-in is the best place for late stage disaster to hide)
Explicit, simple, processes reduce the effort for changes
21
Bridging the Gap
Cognitive saturation
Make fewest demands feasible
● Have regulatory drive development formalization – don’t rely too heavy on engineers
Simplest possible process
● Think in terms of bare minimum process, but tailor them to the product need
● Avoid concessions to ‘no value, but satisfies compliance’
Consider Work Instructions for the most complex or common tasks
22
Nuances
23
Nuances: Single source of truth
The challenge: working-on and accessing approved project documents
File shares
• No Part 11 compliance
• No workflow management
• Weak versioning
• Weak version control
• Weak audit support
• No tracing
Document Control Systems
• Database like – not folder centric
• Access to approved documents license-limited
• Weak work-in-progress management
• Encumbered interface
• Results in lagging updates
• Offline caching
• Not the centralized source of truth
Leads to
• Uncertainty
• Mistakes
• Reworks
• And poor traceability
Solutions
• Design a document process optimized for
• Broad and easy access to approved documents
• Easy review/approval mechanism
• Account for work-in-progress
• Audit trail
• Use customized QMS tools
24
Nuance: Development Prerequisites
When does development start? When to turn on Design Controls?
Why do we need Design Controls?
● Meet the needs of end user and patients
● Ensures Intended Use is achieved
● Prevent unintended behavior in the delivered
product
● Ensures risks are managed
Very little needed to start Design Controls:
● Development Plan (responsibilities, activities:
definition/design/V&V, design outputs, etc.)
● Product Requirements (design inputs)
● QMS Procedures / SOPs?
But, when should we start Design Controls?
● When product development has started
Are we still prototyping?
● Is any part of the prototype going to be used in the
final product?
Yes 🡪 developing
No 🡪 prototyping
Risks without Design Controls
● Developed the wrong functionality
● Leaving unintended features in the product
● No design review of prototypes
25
Nuance: Leveraging prototyping
Acceleration Opportunity
Prototyping can de-risk late-stage
development
Use rapid-prototyping UI tools to:
● Define the User Interface
● Circulate & Collaborate
● Explore corner cases
● Approve a versioned instance
● Export to a prototype on the target
processing and display hardware
High-fidelity prototyping tools can:
● Enable pixel perfect exports
● Maintain fidelity from wireframes to
backend functions
26
In a nutshell
27
In summary – Bridging Development and Regulatory
Different native tendencies
Incompatible workflows
Diverse set of personalities
Huge range of complicating factors
GAP: Functional, Cultural (and notorious)
28
In summary – Bridging Development and Regulatory
1) Don’t start with a Gap: when developers start, create a micro-process to
cement expectations (benefits: early process patterning, reduced ambiguity, no conversion waste, less design refactoring)
2) KISS – keep process obligations simple, obvious
3) Regulatory-led process steps (Support developers Use Work Instructions where needed)
4) Leverage prototypes (Use development tools that leverage prototypes into production code)
5) Turn on Design Controls only when developing production code
6) Carefully optimize the document management process (easy access/review/approval and WIP)
7) Use customized QMS tools early – avoid conversions
29
Questions?
30

Weitere ähnliche Inhalte

Ähnlich wie Bridging the Gap Between Development and Regulatory Teams

How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycleDiUS
 
ISE_Lecture Week 2-SW Process Models.ppt
ISE_Lecture Week 2-SW Process Models.pptISE_Lecture Week 2-SW Process Models.ppt
ISE_Lecture Week 2-SW Process Models.pptHumzaWaris1
 
Software Development Methodologies
Software Development Methodologies Software Development Methodologies
Software Development Methodologies Frances Coronel
 
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...Roberto Pérez Alcolea
 
Lect-4: Software Development Life Cycle Model - SPM
Lect-4: Software Development Life Cycle Model - SPMLect-4: Software Development Life Cycle Model - SPM
Lect-4: Software Development Life Cycle Model - SPMMubashir Ali
 
Conventional software Management---.pptx
Conventional software Management---.pptxConventional software Management---.pptx
Conventional software Management---.pptxTONY562
 
Software Development Lifecycle: What works for you?
Software Development Lifecycle: What works for you?Software Development Lifecycle: What works for you?
Software Development Lifecycle: What works for you?Jauhari Ismail
 
Software engineering jwfiles 3
Software engineering jwfiles 3Software engineering jwfiles 3
Software engineering jwfiles 3Azhar Shaik
 
2010 SDLC Lifeline Mater Deck for knowledge sharing
2010 SDLC Lifeline Mater Deck for knowledge sharing2010 SDLC Lifeline Mater Deck for knowledge sharing
2010 SDLC Lifeline Mater Deck for knowledge sharinggangcheng19721
 
Bridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to ProductionBridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to ProductionFlorian Wilhelm
 
V Model.pptx
V Model.pptxV Model.pptx
V Model.pptxVarunMM2
 
Enhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdfEnhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdfICS
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Jean-Philippe Briend
 
Lesson 8...Question Part 2
Lesson 8...Question Part 2Lesson 8...Question Part 2
Lesson 8...Question Part 2bhushan Nehete
 
Software development life cycle (SDLC) Models
Software development life cycle (SDLC) ModelsSoftware development life cycle (SDLC) Models
Software development life cycle (SDLC) ModelsAOmaAli
 
Different approaches for different scopes: How to tackle a medium-sized Dr...
Different approaches for different scopes: How to tackle a medium-sized Dr...Different approaches for different scopes: How to tackle a medium-sized Dr...
Different approaches for different scopes: How to tackle a medium-sized Dr...Symetris
 

Ähnlich wie Bridging the Gap Between Development and Regulatory Teams (20)

How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
 
ISE_Lecture Week 2-SW Process Models.ppt
ISE_Lecture Week 2-SW Process Models.pptISE_Lecture Week 2-SW Process Models.ppt
ISE_Lecture Week 2-SW Process Models.ppt
 
Software Development Methodologies
Software Development Methodologies Software Development Methodologies
Software Development Methodologies
 
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...
[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...
 
Lect-4: Software Development Life Cycle Model - SPM
Lect-4: Software Development Life Cycle Model - SPMLect-4: Software Development Life Cycle Model - SPM
Lect-4: Software Development Life Cycle Model - SPM
 
Conventional software Management---.pptx
Conventional software Management---.pptxConventional software Management---.pptx
Conventional software Management---.pptx
 
Software engineering the process
Software engineering the processSoftware engineering the process
Software engineering the process
 
Software Development Lifecycle: What works for you?
Software Development Lifecycle: What works for you?Software Development Lifecycle: What works for you?
Software Development Lifecycle: What works for you?
 
Software engineering jwfiles 3
Software engineering jwfiles 3Software engineering jwfiles 3
Software engineering jwfiles 3
 
The process
The processThe process
The process
 
Agile process
Agile processAgile process
Agile process
 
2010 SDLC Lifeline Mater Deck for knowledge sharing
2010 SDLC Lifeline Mater Deck for knowledge sharing2010 SDLC Lifeline Mater Deck for knowledge sharing
2010 SDLC Lifeline Mater Deck for knowledge sharing
 
Bridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to ProductionBridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to Production
 
V Model.pptx
V Model.pptxV Model.pptx
V Model.pptx
 
Enhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdfEnhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdf
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?
 
Lesson 8...Question Part 2
Lesson 8...Question Part 2Lesson 8...Question Part 2
Lesson 8...Question Part 2
 
Software development life cycle (SDLC) Models
Software development life cycle (SDLC) ModelsSoftware development life cycle (SDLC) Models
Software development life cycle (SDLC) Models
 
Different approaches for different scopes: How to tackle a medium-sized Dr...
Different approaches for different scopes: How to tackle a medium-sized Dr...Different approaches for different scopes: How to tackle a medium-sized Dr...
Different approaches for different scopes: How to tackle a medium-sized Dr...
 
Chapter 2 software process models
Chapter 2   software process modelsChapter 2   software process models
Chapter 2 software process models
 

Mehr von ICS

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Practical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdfPractical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdfICS
 
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...ICS
 
Overcoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues WebinarOvercoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues WebinarICS
 
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdfDesigning and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdfICS
 
Quality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdfQuality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdfICS
 
Creating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdfCreating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdfICS
 
Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up ICS
 
Cybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdfCybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdfICS
 
MDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical DevicesMDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical DevicesICS
 
How to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management SolutionHow to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management SolutionICS
 
IoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with AzureIoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with AzureICS
 
Basic Cmake for Qt Users
Basic Cmake for Qt UsersBasic Cmake for Qt Users
Basic Cmake for Qt UsersICS
 
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...ICS
 
Qt Installer Framework
Qt Installer FrameworkQt Installer Framework
Qt Installer FrameworkICS
 
Bridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory TeamsBridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory TeamsICS
 
Overcome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case StudyOvercome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case StudyICS
 
User Experience Design for IoT
User Experience Design for IoTUser Experience Design for IoT
User Experience Design for IoTICS
 
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdf
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdfSoftware Bill of Materials - Accelerating Your Secure Embedded Development.pdf
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdfICS
 
5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD Development5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD DevelopmentICS
 

Mehr von ICS (20)

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Practical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdfPractical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdf
 
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
 
Overcoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues WebinarOvercoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues Webinar
 
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdfDesigning and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdf
 
Quality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdfQuality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdf
 
Creating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdfCreating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdf
 
Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up
 
Cybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdfCybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdf
 
MDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical DevicesMDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical Devices
 
How to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management SolutionHow to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management Solution
 
IoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with AzureIoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with Azure
 
Basic Cmake for Qt Users
Basic Cmake for Qt UsersBasic Cmake for Qt Users
Basic Cmake for Qt Users
 
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
 
Qt Installer Framework
Qt Installer FrameworkQt Installer Framework
Qt Installer Framework
 
Bridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory TeamsBridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory Teams
 
Overcome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case StudyOvercome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case Study
 
User Experience Design for IoT
User Experience Design for IoTUser Experience Design for IoT
User Experience Design for IoT
 
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdf
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdfSoftware Bill of Materials - Accelerating Your Secure Embedded Development.pdf
Software Bill of Materials - Accelerating Your Secure Embedded Development.pdf
 
5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD Development5 Key Considerations at the Start of SaMD Development
5 Key Considerations at the Start of SaMD Development
 

Kürzlich hochgeladen

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfayushiqss
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfonteinmasabamasaba
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfproinshot.com
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is insideshinachiaurasa2
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...Nitya salvi
 
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfonteinmasabamasaba
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesVictorSzoltysek
 
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdfAzure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdfryanfarris8
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionOnePlan Solutions
 
ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedDelhi Call girls
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park masabamasaba
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension AidPhilip Schwarz
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...kalichargn70th171
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech studentsHimanshiGarg82
 

Kürzlich hochgeladen (20)

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdfAzure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide Deck
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 

Bridging the Gap Between Development and Regulatory Teams

  • 1. Bridging the Gap Between Development and Regulatory Teams Milton Yarberry Director of Medical Programs, ICS
  • 2. About ICS and Boston UX Creating Transformative Products That Advance Patient Care 2 www.ics.com/medical ICS’ design studio specializes in intuitive touchscreen and multimodal interfaces for high-impact embedded and connected devices. Established in 1987, ICS delivers innovative medtech solutions with a full suite of services to accelerate development, testing and certification of successful next-gen products. ICS and Boston UX are headquartered in Waltham, Mass. with offices in California, Canada and Europe.
  • 3. Delivering a Full Suite of Medtech Services 3 ● Human Factors Engineering ● IEC 62366-UX/UI Design ● Custom Frontend and Backend Software Development ● Development with IEC 62304-Compliant Platform ● Low-code Tools that Convert UX Prototype to Product ● Medical Device Cybersecurity ● AWS and Azure Cloud Services and Analytics ● ISO 14971-Compliant Hazard Analysis ● Software Verification Testing ● Complimentary Software Technology Assessment
  • 4. Development 🡪 Regulatory My background Development Regulatory 4 Software & Systems Engineering Complex Systems Machine Learning Software Architecture Engineering and Project Management Agile/Scrum Waterfall PMP Regulatory Safety & Efficacy Standards Compliance
  • 5. Agenda 1. Defining the problem – the Gap 2. Complicating Factors 3. Bridging – the Gap 4. Nuances 5. Summary 5
  • 7. Defining the Problem Native Characteristics Cloud 7 Development Regulatory
  • 8. Defining the Problem Native Workflow 8 Validation Verification Specifications Requirements User needs Intended use product clinician Product Risk patient Cyber Development Regulatory hard part first prioritize Investigate example test debug modify analysis test done • Do a bit of everything • Iterate towards a solution • Discovery • Result driven, dynamic process • Start at the top and trace down • Hierarchical • Phases • Defined, static process failure or success? evolving thinking System SW UX Cyber … … … … … … … … … …
  • 9. Defining the Problem The GAP 9 Happy to comply - but give me unambiguous direction Tailored process that ensures Safe and Effective I hate writing documents Documentation is in the code. It works so,.. I’m done! Letter of the law The law is ambiguous and rigidly enforced Development Regulatory Bad-Cop Good-Cop The Gap
  • 10. Defining the Problem Logistical Gaps Common events that exacerbate gaps: Requirements ● Waiting for detailed Product Requirement decisions to be made ● Conflicting input – stems from no single source of truth that’s widely used ● No timeline for answers – no commitment to conclusion stalls progress and isn’t visible ● Lack of certainty about what level to document requirements – what’s essential for your Intended Use Discovery ● Lack of deep understanding of corner cases – error recovery is always a deep topic that is often misunderstood/underestimated ● Deferring discovery – pushing prototyping efforts into middle schedule Single source of truth ● Not knowing what's approved vs. under discussion 10
  • 12. Complicating Factors Lagging process Process-lag ● Often/usually/always? Engineering is active before the QMS is approved ● Starting development without a QMS in place creates ambiguity ● Creates a need to ‘catch-up’ ● Process-debt 🡪 confusion Example: when should design documentation begin? 2 rules of thumb: 1) When you’re developing ‘product’ (not prototyping) 2) After the product requirements are approved But, 1) Is there a precise point when you stop prototyping? 2) Product requirements are often evolved 12
  • 13. Complicating Factors Ambiguous process Process-autonomy ● FDA regulations contain no specifics. 🡪 WHY? ● FDA wrote the regulations to promote flexibility for manufacturers ● Manufacturer’s obligation to understand their own product, environment, application and risks ● Autonomy = process tailoring = ambiguity 13
  • 14. Complicating Factors Complexity and late discovery Software Stacking ● Unrestrained Complexity / Staggering amount of content ● Late discovery of technology issues can impact non-adjacent layers – hugely disruptive i.e. technology replacement ● Late discovery is inevitable, but the quantity and impact can be minimized ● This effect increases in the future Number of layers Depth of complexity = Geometric complication 14 Operating System Machine Learning Sensors Drivers User Interface Actuators Database Cybersecurity Remote servers 3rd party libraries Cloud services Downstream data consumers Safety System Backoffice analytics Data Warehousing Mobile platforms Remote monitoring IoT 3rd party libraries 3rd party libraries 3rd party libraries Service Interface
  • 15. Complicating Factors Managing change Pre-V&V (Verification & Validation) ● Pre-V&V is less formal, but ● The change process is variable and very messy ● Modification, approval, tracing of Design Outputs Post-V&V: Overlap of change considerations 15 Change Control Risk Management Technical Change ►►►Changes ripple through design collateral The change process is non-trivial
  • 16. Complicating Factors Managing change – A real-world Use Error Example 16
  • 17. Complicating Factors Cognitive Saturation – software engineer Layered knowledge and constraints saturates an individual’s cognitive capacity. 17 Linux RTOS C++ Qt GitLab Continuous Integration OpenCV CFR 820 ISO 13485 IEC 14971 IEC 62304 CLIA Part 11 SOPs Verification testing Validation testing Summative testing Usability and HF Functional requirements Integration testing Component APIs Chain of evidence Safe & Effective DHF DMR DHR Design reviews Software specs Signature auth Unit tests Architectural compliance Tracing into the design Clinical Application
  • 19. Bridging the Gap Process lag & Ambiguous Process Don’t create a gap ● Define (document, approve, distribute) design expectations when developments starts ● Interim Development Plan to avoid a gap ● For example, start with a ‘prototyping process’ ● If no prototyping requirements, then define the boundary to prototyping ● Size the plan to the risk of the development activity ● Grow the plan with new activities ● Make the process explicit, simple (work instructions) Implement a QMS progressively ● Use a risk based approach to prioritize QMS procedures ● Start with: Quality Manual, Design Control, Document and Records, Risk Management ● Add as they become relevant KISS - Keep it simple/stupid Use tools early – don’t invent and migrate ● Starting in a spreadsheet or simple document and migrating later tends to be vastly inefficient 19
  • 20. Bridging the Gap Complexity and late discovery Assume an environment of change ● Don’t treat change as the exception ● Build technology changes into your process ● i.e. change image library Write plans to minimize impact of change ● Aggregate design reviews for a sub-component Tight cross-functional development ● Changes to HW can impact SW and vice-versa ● Incompatibilities drive late discovery ● Design reviews should have exhaustive input from adjacent development groups ● Mechanical, Usability, Systems, Electrical, Software 20
  • 21. Bridging the Gap Managing change The obvious: up-front diligence and discovery is better than late-stage testing (or discovery in the field) Manage Change by minimizing Change ● Analyze the risky or complex components ● Prototype testing (if you haven’t tested it, assume the packaging doesn’t match the contents) ● Detailed review (cursory buy-in is the best place for late stage disaster to hide) Explicit, simple, processes reduce the effort for changes 21
  • 22. Bridging the Gap Cognitive saturation Make fewest demands feasible ● Have regulatory drive development formalization – don’t rely too heavy on engineers Simplest possible process ● Think in terms of bare minimum process, but tailor them to the product need ● Avoid concessions to ‘no value, but satisfies compliance’ Consider Work Instructions for the most complex or common tasks 22
  • 24. Nuances: Single source of truth The challenge: working-on and accessing approved project documents File shares • No Part 11 compliance • No workflow management • Weak versioning • Weak version control • Weak audit support • No tracing Document Control Systems • Database like – not folder centric • Access to approved documents license-limited • Weak work-in-progress management • Encumbered interface • Results in lagging updates • Offline caching • Not the centralized source of truth Leads to • Uncertainty • Mistakes • Reworks • And poor traceability Solutions • Design a document process optimized for • Broad and easy access to approved documents • Easy review/approval mechanism • Account for work-in-progress • Audit trail • Use customized QMS tools 24
  • 25. Nuance: Development Prerequisites When does development start? When to turn on Design Controls? Why do we need Design Controls? ● Meet the needs of end user and patients ● Ensures Intended Use is achieved ● Prevent unintended behavior in the delivered product ● Ensures risks are managed Very little needed to start Design Controls: ● Development Plan (responsibilities, activities: definition/design/V&V, design outputs, etc.) ● Product Requirements (design inputs) ● QMS Procedures / SOPs? But, when should we start Design Controls? ● When product development has started Are we still prototyping? ● Is any part of the prototype going to be used in the final product? Yes 🡪 developing No 🡪 prototyping Risks without Design Controls ● Developed the wrong functionality ● Leaving unintended features in the product ● No design review of prototypes 25
  • 26. Nuance: Leveraging prototyping Acceleration Opportunity Prototyping can de-risk late-stage development Use rapid-prototyping UI tools to: ● Define the User Interface ● Circulate & Collaborate ● Explore corner cases ● Approve a versioned instance ● Export to a prototype on the target processing and display hardware High-fidelity prototyping tools can: ● Enable pixel perfect exports ● Maintain fidelity from wireframes to backend functions 26
  • 28. In summary – Bridging Development and Regulatory Different native tendencies Incompatible workflows Diverse set of personalities Huge range of complicating factors GAP: Functional, Cultural (and notorious) 28
  • 29. In summary – Bridging Development and Regulatory 1) Don’t start with a Gap: when developers start, create a micro-process to cement expectations (benefits: early process patterning, reduced ambiguity, no conversion waste, less design refactoring) 2) KISS – keep process obligations simple, obvious 3) Regulatory-led process steps (Support developers Use Work Instructions where needed) 4) Leverage prototypes (Use development tools that leverage prototypes into production code) 5) Turn on Design Controls only when developing production code 6) Carefully optimize the document management process (easy access/review/approval and WIP) 7) Use customized QMS tools early – avoid conversions 29