This presentation: 1. presents the history of last 20 years about standards on measurement, especially in Software Engineering; 2. Proposes the coverage level by measurable entities and its level (de facto; de jure); 3. Puts in evidence which could be the next ‘de facto’ standards in Software Measurement to move towards the ‘de jure’ status in the short-medium term

1. FISMA SPIN 2011
Software Process Improvement Network
Helsinki (Finland), Sept 29, 2011
Long way from ideas and needs Failures, success stories and
to software measurement future perspectives
standards
Luigi Buglione
Risto Nevalainen
www.eng.it

2. Engineering At a glance
_ The first Italian ICT player
_ more than 730 M/€ revenues Research and PA & HC Finance Industry TELCO Utilities
Development
_ 1000 clients
_ 6,300 IT specialists System Int. &
Consultancy
% 46 70 54 80 80
Outsourcing % 35 10 27 10
Software
% 19 20 19 10 20
ERP IT Security ECM
Plant Management
Managed Operations Broadband & Media
System
www.eng.it
www.eng.it

3. FiSMA stakeholders
and forums 2011
www.eng.it

4. Long way from... Goals of the presentation
 G1. Present the history of last 20 years about standards
on measurement, especially in Software Engineering
 G2. Propose the coverage level by measurable entities
and its level (de facto; de jure)
 G3. Put in evidence which could be the next ‘de facto’
standards in Software Measurement to move towards the
‘de jure’ status in the short-medium term
4 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

5. Long way from... Agenda
• Introduction
– What is a standard?
– Standards and ICT people
• Standards: a path from ‘de facto’ to ‘de jure’
– From ‘de facto’ to ‘de jure’ standards
– Associations
 Associations on Std: ISO, IEC, ITU, IEEE, …
 Technical Associations working on/with Stds: FISMA, GUFPI-ISMA, …
• Standards & Measurement
– Measurable Entities
– Standards on Measurement by Entity/Status (de jure/de facto)
– Software Measurement Ontologies
– Proposals for new standards on measurement
• Conclusions & Prospects
• Q&A
5 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

6. Introduction What is a ‘standard’?
URL: http://en.wikipedia.org/wiki/Domestic_AC_power_plugs_and_sockets
6 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

7. Introduction How ‘standards’ are often perceived...
URL: www.dilbert.com
7 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

8. Long way from... Agenda
• Introduction
– What is a standard?
– Standards and ICT people
• Standards: a path from ‘de facto’ to ‘de jure’
– From ‘de facto’ to ‘de jure’ standards
– Associations
 Associations on Std: ISO, IEEE, …
 Technical Associations working on/with Stds: FISMA, GUFPI-ISMA, …
• Standards & Measurement
– Measurable Entities
– Standards on Measurement by Entity/Status (de jure/de facto)
– Software Measurement Ontologies
– Proposals for new standards on measurement
• Conclusions & Prospects
• Q&A
8 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

9. A path from... From ‘de facto’ to ‘de jure’ standards
9 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

10. Associations on Stds ISO & IEEE
10 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

11. Associations working.. FISMA
•Methods
FiSMA 1.1 Functional Size Measurement Method, published as
ISO/IEC 29881.
•See also Introduction to FiSMA 1.1 Functional Size Method with examples
FiSMA Situational Analysis methods
•ND21 for new development projects
•MT22 for maintenance and modification projects
•FiSMA Reuse Analysis 1.0
Standards and methods available to members
•FiSMA information service, including drafts of SC7 standards.
•FiSMA software and systems process assessment methodology, including
ISO/IEC15504 (SPICE) and CMMI.
•FiSMA ISO/IEC20000 IT Service Management Process Assessment Model.
•Testing SPICE under development now, available late 2012.
11 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

12. Associations working.. GUFPI-ISMA
www.gufpi-isma.org/stdc
12 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

13. Long way from... Agenda
• Introduction
– What is a standard?
– Standards and ICT people
• Standards: a path from ‘de facto’ to ‘de jure’
– From ‘de facto’ to ‘de jure’ standards
– Associations
 Associations on Std: ISO, IEEE, …
 Technical Associations working on/with Stds: FISMA, GUFPI-ISMA, …
• Standards & Measurement
– Measurable Entities
– Standards on Measurement by Entity/Status (de jure/de facto)
– Software Measurement Ontologies
– Proposals for new standards on measurement
• Conclusions & Prospects
• Q&A
13 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

14. Stds & Measurement Measurable Entities: the STAR approach
Organization/ BU
Project
Resources Process Product
Measurement
14 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

15. Stds & Measurement Standards on Measurement by Entity
15 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

16. Stds & Measurement Standards on Measurement by Entity
16 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

17. Stds & Measurement Standards on Measurement by Entity
Entity Issue/Topic Standard Id. Notes
Organization • (Balanced Scorecard - BSC) --- • Existing an Italian std on
BSC for Quality Mgmt (
• IT Governance • ISO/IEC 38500-x UNI 11097:2003)
Project • Sw project management • ISO/IEC 16326
• Sw risk management • ISO/IEC 16085
• Benchmarking, performance • ISO/IEC 29155-x
Resource(s) • Skill definitions • ISO/IEC 19759 (SWEBOK)
• Common rules for certification • ISO/IEC 29154
Process(es) • Measurement process • ISO/IEC 15939:2007;
• Capability and maturity • ISO/IEC 15504-x; ISO/IEC 330xx
family
• ... • ...
Product(s) • Software Product Quality Measures • ISO/IEC 250xx family; IEEE
1061:
• Functional Size Measurement
(FSM) – Criteria and Principles • ISO/IEC 14143-x
• FSM methods (single techniques) • ISO/IEC 20926:2009 (IFPUG),
19761:2011 (COSMIC), ...
• SIL/ASIL Levels
•IEC 61508 / ISO 26262 etc
• Inf.Security Mgmt Measures
• ISO/IEC 27004:2009
• ...
• ...
17 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

18. Stds & Measurement Standards on Measurement by Entity
• ISO/IEC 38500-x
• ...
• ISO/IEC 19759 (SWEBOK)
• ISO/IEC 29154
• ...
• ISO/IEC 16326
• ISO/IEC 16085
• ISO/IEC 29155-x
• ...
• ISO/IEC 250xx family; IEEE 1061:
• ISO/IEC 14143-x
• ISO/IEC 20926:2009 (IFPUG), 19761:2011
(COSMIC), ...
• ISO/IEC 15939:2007; •IEC 61508 / ISO 26262 etc
• ISO/IEC 15504-x; ISO/IEC 330xx family • ISO/IEC 27004:2009
• ... • ...
18 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

19. Stds & Measurement Software Measurement Ontologies (1)
19 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

20. Stds & Measurement Software Measurement Ontologies (2)
20 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

21. Stds & Measurement Proposals for new standards? Brainstorming!
Brainstorming
• ...
•...
• ...
• ... •...
21 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

22. Long way from... Agenda
• Introduction
– What is a standard?
– Standards and ICT people
• Standards: a path from ‘de facto’ to ‘de jure’
– From ‘de facto’ to ‘de jure’ standards
– Associations
 Associations on Std: ISO, IEEE, …
 Technical Associations working on/with Stds: FISMA, GUFPI-ISMA, …
• Standards & Measurement
– Measurable Entities
– Standards on Measurement by Entity/Status (de jure/de facto)
– Software Measurement Ontologies
– Proposals for new standards on measurement
• Conclusions & Prospects
• Q&A
22 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

23. Long way from... Conclusions & Prospects
• Standards & Measurement
 Standards represent the way to reduce uncertainty when defining and working on a concept
among more people
 Standards on measurement are really valuable since can reduce estimation errors because
dealing with the gathering of data by experience and the way to reuse them for next estimates
• State-of-the-art
 Several measurable entities, attributes and concepts under standardadization
 ISO and IEEE are the two most propositive standards association

What could be ‘standardized’ tomorrow
 Even if many standards have been created, there is enough room for new ones and refining
existing ones during time (typically each 5 years)
 Ontologies could represent a good source of information for choosing core concepts

Some lessons learned
 Reduce the number of concurrent standards on the same concept (e.g. Lenght: meters,
inches,...)  in Sw Engineering it could happen for process notations, FSM methods, etc...
If you think of standardization as the best that you know
today, but which is to be improved tomorrow;
you get somewhere. (Henry Ford)
23 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

24. Long way from... Q&A
Kiitos huomiosta!
Thanks for your attention!
24 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen

25. Long way from... Our Contact Data
Luigi Risto
Buglione Nevalainen
Engineering.IT/ETS FiSMA ry
luigi.buglione@eng.it risto.nevalainen@fisma.fi
25 FISMA 2011 – Helsinki (Finland), Sept 29, 2011– © 2011 L.Buglione, R.Nevalainen