Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Phillip.hall
1. National Aeronautics and Space Administration
Collaborative Multi-Center
Implementation of NPR 7123.1A
Phillip Hall
NASA MSFC
Nancy McNelis
NASA GRC
Used with Permission www.nasa.gov 1
2. National Aeronautics and Space Administration
Can Centers Develop “Common” Processes?
• Common Goal is Compliance with NPRs
– NASA Procedural Requirements Establish “What” NASA
HQ Expects of the Centers
– Center Level Procedural Requirements Establish “How” it is
Done at that Given Center
• Centers Do Not Have Common Organizational
Structure
• NPR 7120 Series is Project Focused, Not
Organizational Focused
The Question Then Becomes …
• Is the Project Structure from Center to Center Similar
Enough to Allow “Common” Processes?
www.nasa.gov 2
3. National Aeronautics and Space Administration
Can Centers Develop “Common” Processes?
Matrix from Space Flight Directorate
Matrix from Engineering Directorate
Matrix from S&MA
WBS01
GRC Typical Project Structure
Project Manager Matrix from Other Directorates
Deputy PM
Project Chief Engineer
WBS03 WBS01
Safety & Mission Assurance Business Support Office
Chief Safety Officer Project Support Staff
WBS02 WBS04 WBS05 WBS (n) WBS (n)
Systems Engineering Element 4 Element 5 Element (n) Element (n)
Lead Systems Eng Element Lead Element Lead Element Lead Element Lead
www.nasa.gov 3
4. National Aeronautics and Space Administration
Can Centers Develop “Common” Processes?
NASA Administrator
Deputy Administrator NASA Chief Engineer
Associate Administrator
MSFC Typical Project Structure
Mission Directorate AA MSFC Center Director
Program Manager MSFC Eng Director
MSFC Eng Deputy MSFC Chief Eng MSFC Eng
Center Discipline Leads
Directors - Senior Eng Manager Dept/Lab Managers
Independent Reviews
Program assigned Management Presence
MSFC Deputy
Program Manager MSFC Program
Chief Eng* MSFC Eng
Division Chiefs
Project Manager MSFC Project
Chief Eng MSFC Eng
Branch Chiefs
Program Authority MSFC Chief Eng
Technical Authority Manager’s Staff
Direct Report
MSFC
Senior Eng Presence Institutional Eng
Independent Reviews
www.nasa.gov 4
5. National Aeronautics and Space Administration
Common Goals
• Comply with NASA Procedural Requirements (“What”)
– Requirements traceability from NPRs to Center Level Procedures
• Provide Sufficient Detail (“How”)
– Outline a Step by Step Process of “How” for Project Execution
– Define Roles and Responsibilities of the Project Teams
– Incorporate Best Practices
– Provide Commonality on How Projects Conduct Business within the
Organization
• Prevent Shelf-ware Mentality
– Provide Forms/Templates for Project Use
• Templates which are Annotated Outlines of Project Documentation
• Forms which are Available Electronically
Develop “Common” Processes for the Organizations
Rather Than on a Program/Project Basis
www.nasa.gov 5
6. National Aeronautics and Space Administration
Achieving Common Goals
Where We’ve Been?
• Minimal Confidence in Project Planning and
Estimates because assumes LOE-based rather than
Task-based
• Lack of “Standard Toolbox”
– Inconsistencies in Deliverables and Products
– Results in a lot of re-work
• Project-by-Project Approach Rather than
Institutionalized
• Unclear Use of Best Practices and Lessons Learned
www.nasa.gov 6
7. National Aeronautics and Space Administration
Achieving Common Goals
Where Are We?
• GRC
– Organized Management Steering Group in 2007
– Defined and Documented Development Approach
– Obtained Executive Sponsorship and Organizational Buy-in
– Began Collaborative Development with MSFC
– Launched the Space Mission Excellence Program for Systems
Engineering in 2006
• MSFC
– Organized Engineering Directorate Management Steering Group in
2008
– Leveraging Work Defined at GRC
– Gaining Executive Sponsorship and Organizational Buy-in
– Working with Office of Strategic Analysis and Communications
(OSAC) to tie into Project Management
– Introduction to the MSFC Systems Engineering Leadership
Development program
www.nasa.gov 7
8. National Aeronautics and Space Administration
GRC Procedural Requirement Documents
GLPR7120.5.10
GRC Space Flight Projects
Center Mgmt (NPR 1400.1)
GRC Development & Implementation
Formulation & Implementation
Requirements SM&A (NPD 8700.1)
GLPD 1410.2 GLPR 1410.1 GLPR 8730.5
GRC Doc GRC Directives Quality System GLPR 8700.4 Safety - Text in Doc -
Management Management Manual Safety & Mission Operations &
Assessment Sustainment
GLPR7120.5.20 GLPR 1410.3 -Text in Doc- GLPR 7120.5.30
Deviations & Waiver Lower Level Center Doc Training Safety & Assurance Requirements (SAR)
Document Mgmt
Quality Assurance Reliability & GLPR 1270.1
Maintainability Corrective &
Preventative
Action
Program/Project Management (NPR 7120.5)
GLPD7120.1 GLHB-B-7120.1 GLPR7120.5.41 GLPR7120.5.43 Text in Doc
EVM EVM System Project Review Acquisition 10 Sections in
Handbook Board GLPR7120.5.10
GLPR7120.5.42 GLPR 7120.0.6 GLPR7120.5.40 GLPR 7123.34
Management Lessons Learned GRC Project and Project Config Item
Reporting Technical Planning & Data
Management
Engineering Management (NPR 7123.1)
GLPR 7123.11 GLPR 7123.12 GLPR 7123.32 GLPR 7120.5.40 GLPR 7123.34 GLPR 7123.34 -Text in Doc- GLPR 7150.1
Requirements Def Design Interface GRC Project and Project Config Item Project Config Item 6 Sections in Software
& Mgmt Solutions Mgmt Technical Planning & Data Management & Data GLPR7120.5.10 Engineering
Management Requirements
GLPR 7123.21 GLPR 7123.22 GLPR 7123.23 GLPR7120.0.4 GLPR 7123.35 GLPR 7123.36 GLPR 7123.37
Product Transition Verification & Implementation & Risk Management Project Technical Engineering Decision Analysis
Validation Integration Reviews Review Board
https://knowledgeshare-in.grc.nasa.gov/eRoom/NASAc1f1/GRCProjectandSERequirementsWebContent
www.nasa.gov 8
9. National Aeronautics and Space Administration
Standard GLPR Architecture
GRC Development & Implementation
Project
Objective
Project Project Project
Requirement Deliverables Results
N PR’s Define
“What”
Process
Processes
Deliverables
Techniques
Templates Work Products
Activities
GL PR’s Forms
Define “How” Concepts
at GRC Tasks Lessons Components
Learned
Best Practices
www.nasa.gov 9
10. National Aeronautics and Space Administration
Standard GLPR Formatting
GRC Development & Implementation
Activity (Sub-chapter level designee)
Grouping of tasks that create a logical
deliverable (or group of deliverables)
Flow chart WITH SWIMLANES
Graphical illustration relationships of the
tasks within an activity
Task (Sub-Sub-chapter level designee)
Title of specific work to be performed
necessary to build the deliverable.
Should follow the Verb-Noun format
Task Descriptor (Letter designee)
Specific description of work performed
necessary to build the deliverable.
• Should begin with the responsible role
Will contain Shall statements if applicable.
Additional Guidance (Not shown)
Addition information provided to help the
responsible person perform this task
www.nasa.gov 10
11. National Aeronautics and Space Administration
GLPR Development Procedure
GRC Development & Implementation
3.1 3.2 3.3 3.4 3.5 3.6
Identify and
Owner Review MSG Executive BMS
Document Peer Review
(CEO, M, Q, etc.) Inspection Presentation Submittal
Procedure
• Identify New • Owner • Peer Review • Formal • Present • Completed
Processes or Reviews is Initiated Inspection Completed GLPR
Revision High Level Process document to submitted to
Process Executives BMS
• Assign • Feedback
Resources • GLPR Provided to • Pilot
Finalized Inspectors Approved
• Use Std Processes
Templates
Success Criteria
• Leverage
SMEs • Owner • MSG Leads • MSG Will • Executive • Formally
Review and Will Determine Awareness Manage
• Draft Process Concur Determine Executive Document
Flow MSG Review
• Pre-MSG Inspection Readiness
• Draft GLPR
Inspection Readiness
Document
Readiness
www.nasa.gov 11
12. National Aeronautics and Space Administration
GLPR Development Status
Review Gates
Owner MSG Executive BMS
GRC Development & Implementation
GLPR # Document Name Peer Review
Review Inspection Review Status
Wave One
7123.36 Engineering Review Board (ERB) Complete Complete Complete Complete GLPR
7123.35 GRC Project Technical Reviews Complete Complete Complete Complete GLPR
GRC Requirement Development and
7123.11 Complete Complete Complete Complete GLID
Management Process
7120.14 Waivers/Deviations Process Complete Complete Complete Complete Not Submitted
7120.5.40 Project and Technical Planning Complete Complete Complete Complete GLPR
7123.22 Product Verification and/or Validation Complete Complete Complete Complete GLID
7123.34 Data and Configuration Management Complete Pending TBD 1/19/10 Not Submitted
7120.5.10 Space Flight Project Requirements Complete Complete Complete Complete GLID
7123.37 Decision Analysis Complete Complete 10/20/09 11/20/09 Not Submitted
7120.5.41 Project Review Board (PRB) Complete Complete Not Applicable Complete GLPR
7120.5.42 Management Reporting Complete 10/30/09 11/16/09 1/14/10 Not Submitted
7123.33 Risk Management Complete Complete KO 12/7 TBD Not Submitted
7120.5.30 Space Assurance Requirements (SAR) Complete Complete Complete Complete GLPR
8700.5 Problem Reporting and Resolution Complete NA NA NA Not Submitted
7123.32 Interface Management TBD TBD TBD TBD Not Submitted
7123.21 Product Transition Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
7123.23 Product Imp and Integration Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
7120.xx EVM Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
7120.5.43 Project Acquisition Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
7123.12 Design Solutions Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
7123.41 Design and As-Built Wave 3 Wave 3 Wave 3 Wave 3 Not Submitted
www.nasa.gov 12
13. National Aeronautics and Space Administration
MSFC Doc Tree – Before
NPR 7123.1
NASA Systems Engineering Processes and Requirements
(Requirements [68] / Processes [17] / Best Practices [105] / Reviews [16])
MSFC Development & Implementation
MPR 7123.1 MPR 7123.2
MSFC Systems Engineering Technical Reviews and Review Item Discrepancy (RID)
Processes and Requirements Processing, MSFC Programs and Projects
Requirements [68] / Processes [17] / Best Practices [105] (Reviews [16]) + MSFC RID Process
AS42/Jeff Moore ED10/Phillip Hall PS01/Felecia Wilson ED10/Phillip Hall QD40/William Powell ED11/Amy Hemken ED11/Amy Hemken
MWI 6410.1 MWI 8050.1 MPR 5000.1 MWI 7123.1 MWI 7120.6 MPR 8040.1 MWI 7120.2
Handling, Storage, Verification and Purchasing Reqts Development Prog/Proj Risk Configuration Data Reqt
Packaging, Preserv., Validation of EM03/Patricia Johnson and Management Mangement Management Ident. / Def
and Delivery (HSPPD) Hardware, Software, MPR 1280.2 (5 of 17 Processes) DA01/Mary Demurray ED11/Eugena Goggans
and Ground Support Process Control MPR 1280.1 MWI 7120.4
Equipment for MSFC PS01/Felecia Wilson Management Doc. Prep.
MWI 5100.1 Review Prog/Proj
Initiating Proc. Req.
EI41/Ronie Akins
MWI 1280.1
Mechanical Fab.
Request Instructions
System Design Processes
1 - Stakeholder Expectations Definition Process
2 - Technical Requirements Definition Process
3 - Logical Decomposition Process
*4 - Design Solution Definition Process
We developed 3 MSFC Product Realization Processes
5 - Product Integration Process
documents to fill in the gaps *6 - Product Implementation Process
shown by the initial 7 - Product Verification Process
8 - Product Validation Process
9 - Product Transition Process
compliance analysis Technical Management Processes
*10 - Technical Planning Process
11 - Technical Requirements Management Process
* = 4 additional MWI's needed [4, 6, 10 & 17] 12 - Interface Management Process
13 - Technical Risk Management Process
14 - Configuration Management Process
Existing MWI's replacement [in future]
15 - Technical Data Management Process
16 - Technical Assessment Process
*17 - Decision Analysis Process
www.nasa.gov 13
14. National Aeronautics and Space Administration
MSFC Doc Tree - Proposed
NPR 7123.1
NASA Systems Engineering Processes and Requirements
MSFC Development & Implementation
( Requirements [68] / Processes [17] / Best Practices [105] / Reviews [16] )
MPR 7123.2
MPR 7123.1
Technical Reviews and Review Item Discrepancy (RID)
MSFC Systems Engineering Processes and Requirements
Processing, MSFC Programs and Projects
( Requirements [68] / Processes [17] / Best Practices [105] )
( Reviews [16] ) + MSFC RID Process
MWI 7123.1
MSFC Systems
Engineering Processes
MSE 7123.1 MSE 7123.2 MSE 7123.3 MSE 7123.4 MSE 7123.5 MSE 7123.6 MSE 7123.7 MSE 7123.8 MSE 7123.9
Stakeholder Technical Logical Design Product Product Product Product Product
Expectation Requirement Decomposit’n Solution Implementat’n Integration Verification Validation Transition
Definition s Definition Definitions
System Design Processes Product Realization Processes
MSE 7123.10 MSE 7123.11 MSE 7123.12 MSE 7123.13 MSE 7123.14 MSE 7123.15 MSE 7123.16 MSE 7123.17
Technical Requirement Interface Technical Technical Technical Technical Decision
Planning Management Management Risk Config Data Assessment Analysis
Management Management Managemen
t
Technical Management Processes
Checklists
Specific Practice
Templates
Forms
Roles & Responsibilities
Process Metrics
www.nasa.gov 14
15. National Aeronautics and Space Administration
Content Structure
MWI 7123.1 MSE 7123.1
• MWI 7123.1 will contain information
MSFC Development & Implementation
MWI Groups the 17 NASA SE Engine
SE Processes
common to all MSEs
MSE Process
• MSEs set the standards for complying
1 MSE for each of the
17 SE Processes with NPR 7123.1 requirements
• Process metrics to allow for continuous
MSE 7123.2
improvement
MSE Primary Content Points to Toolboxes
MSE Process Process Overview Specific Practice (steps)
(including R&R)
Process Objectives
• Specific Practices will contain Templates
recommended implementation Process Metrics
guidance
• Augmented by toolbox
Checklists
containing templates &
checklists
• Format allows for seamless
import into SEG
www.nasa.gov 15
16. National Aeronautics and Space Administration
MSFC Procedure
MSFC Development & Implementation
(1) Perform (2) Develop (3) Review (4) Review with (5) Develop
Literature Search Process Flow Process Flow Stakeholders Document
Collect and outline Develop top-level Internal review of Coordinated effort to Develop detailed
industry and SE data flow for the proposed process obtain stakeholder content for the MSE
discipline best MSE and IDEF0 for flow. buy-in on how and Specific
practices. the Specific MSFC is going to Practices.
Practices. proceed in doing
business
(6) Develop (7) Conduct Mgmt (8) Finalize (9) Implement into (10) Submit Doc for
Toolbox Inspection of Doc Document SEG Formal Release
Develop the Conduct internal Incorporate Review Post and make Update SEG, as
associated review within ED10 Team comments content available to required
Templates and and applicable MSFC programs &
Checklists (artifacts) stakeholders (e.g., a projects
pre-established
review team of
SMEs to review and
provide comments
on each MSE before
finalizing
www.nasa.gov 16
17. National Aeronautics and Space Administration
MSFC Systems Engineering Framework
MSFC Development & Implementation
Process Tools Training People Time
National Vision
Human Capital
NPR’s NEN APPEL Mission Needs
Agency NID’s, etc. MBSE NPR Training
Strategy &
Agency Goals
Investments
MSFC DCB, DGA APPEL CMS Center Goals &
RID, ICE
Enterprise Processes UAH, etc. Center Staff Missions Objectives
Safety/Reliability St ARM/IRMA (Risk) Integrated Staff
SMA Specialty
SMA andards Reliability & Other
Courses
w/in Product Life-Cycle
Quality Standards Analytical Tools Programs/Projects
Marshall Inc
ARM/IRMA (Risk)
Programs/
7120 Processes Schedule APPEL Project Offices Product Lifecycle
Projects EVM
SE Leader
7123 SEG, Cradle, Development Engineering
Engineering 17 Processes DOORS Program Directorate
System Lifecycle
APPEL
Domain Processes CAD/Pro-E, EMC,
Line Engineers
Design (Bluebook) MAT Lab APPEL
Lab Personnel
Major Milestones
CDMS, Thermal
Across Centers
www.nasa.gov 17
18. National Aeronautics and Space Administration
Achieving Common Goals
Where Are We? (Continued)
• Establish MOU Between GRC and MSFC Focused at
Developing “Common” Center Level Procedures
• Benefits of the Collaborative Effort Between GRC
and MSFC
– Establishing common terminology and definitions
– Consistency in process steps leading to product and design
solutions with tighter integration
– Consistency in templates and checklists leading to less time
to translate between common products
– Better understanding of process interrelationships, leading to
more efficient analysis of inputs and outputs that support
other teams
– Consistency in the quality of work products or artifacts
– Better understanding of each centers’ governance processes
and associated roles & responsibilities
www.nasa.gov 18
19. National Aeronautics and Space Administration
Achieving Common Goals
Where Are We? (Continued)
• Specific Goals and Objectives of the Collaboration:
– Review of current development processes
– Share development processes and tools
– Provide access to or make center procedural requirement
documents available
– Create a common Project Asset Repository
– Participate in each other’s peer reviews
– Participate in each other’s procedural formal inspections
– Co-develop (and delivery) training, communication,
continuous improvement and plans
www.nasa.gov 19
20. National Aeronautics and Space Administration
Achieving Common Goals
Where Do We Want To Be?
• Institute a Holistic, Systems Approach to Develop
Procedures and Processes within NASA
– Gain Consensus Between Multiple Centers to Accomplish
Common Goals
– Build Sponsorship from the Respective Engineering
Directorates
– Leverage the Collective Intellect Across NASA
– Common workforce development strategies for Systems
Engineering
• Define, Develop and Maintain Consistent Capabilities
and Competencies Across NASA
• Provide Process to NASA Enterprise Architecture
Key to Fostering Future Collaborative
Programs/Projects between NASA Centers
www.nasa.gov 20