ICT can provide a definitive contribution in reducing CO2 emissions and, in general, in the environment preservation. Because its pervasiveness in today’s life, software in particular plays an important role in achieving such a goal. Software process is the combination of those practices, directly or indirectly involved in software development, operation, and maintenance. In previous papers the authors addressed the topic of evaluating the sustainability of software products. In this paper the focus is on the evaluation of the sustainability of the software process, i.e. the measurement of the extent the process is performed by having care of the environment and by minimizing its impact on the environment. To do that, a sustainability measurement framework for software process is defined. Such a framework is composed by Sustainability Levels, Sustainability Process Attributes and being compliant with the requirements stated in the new ISO/IEC 33000 series standard for software process assessment.

1. www.eng.it
An ISO/IEC 33000-compliant Measurement Framework for Software Process Sustainability Assessment
24°International Workshop on Software Measurement (IWSM) and 9th International Conference on Software Process and Product Measurement (MENSURA)
Rotterdam (Netherlands) - October 6-8, 2014
Giuseppe LamiLami
Fabrizio FabbriniFabbrini
Luigi BuglioneBuglione

2. www.eng.it
2
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Sustainability Assess
Goals of the presentation
1. Discuss the Sustainability issue in general, more focus on the ‘product’ entity
2. Introduce the Sustainability from a process-based viewpoint, for its evaluation
3. Propose a Sustainability Measurement Framework (SMF) compliant with the ISO/IEC 33000 series

3. 3 IWSM-MENSURA 2014 – October 6-8, 2014 www.eng.it
© 2014 Lami, Fabbrini & Buglione
ISTI-CNR At a glance
www.isti.cnr.it

4. 4 IWSM-MENSURA 2014 – October 6-8, 2014 www.eng.it
© 2014 Lami, Fabbrini & Buglione
Engineering At a glance
www.eng.it

5. www.eng.it
5
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Agenda
•Introduction
–Sustainability: definition & concept
–Some basic questions
•Green & Sustainable Software Process
—Definitions
•ISO/IEC 33000: A Standard for Software Process Assessment
–MF: Measurement Framework
–PRM: Process Reference Model
–PAM: Process Assessment Model
•A Measurement Framework for Process Sustainability
–SL: Sustainability Levels
–PA: Process Attributes
–PRM Changes
•Conclusions & Future Works
•Q&&A
Sustainability Assess

6. www.eng.it
6
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Introduction
Sustainability – Definition & Concept
Sustainability (originating from the Latin word sustenere that means: ‘to hold up’) shows the capability of enduring over time.
In the last years sustainability is more and more intended as the responsible use of the heart resources in order to “meet the needs of the present without compromising the ability of future generations to meet their own needs”
Rome, Teatro di Marcello (I century BC)

7. 7 IWSM-MENSURA 2014 – October 6-8, 2014 www.eng.it
© 2014 Lami, Fabbrini & Buglione
Introduction Previous works on Sustainability
• Proposed a set of 3 sustainable processes in the
SPICE (ISO/IEC 15504) format
• Show proposals for measuring sustainability from a
Balanced Scorecard viewpoint, improving current
existing ISO standards (e.g. ISO/IEC 25010:2011)
• Proposed a set of Metrics to represent a starting
point for ‘measuring green projects’
• Analysis of the main CSFs for an EAM (Entity-
Attribute-Measure) analysis applied
• Ecological  Rework, Renew
• How to evalute the capability to ‘renew’ processes
• Capability to be ‘resilient’ across time
• Proposal for introducing a new criterion in PAMs

8. www.eng.it
8
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Introduction
ISO/IEC 25010:2011 – Revised view
• Potential new ISO/IEC 25010:2011 1°-level attribute to be added
• In the middle between Quality In Use and the Internal-External Quality viewpoints
• Sustainability: “the capability of the software product to meet concurrent needs of required functionalities without compromising the ability to meet future needs”

9. www.eng.it
9
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Introduction
Some basic questions...
Which is the definition of ‘sustainable’ concretely applied in organizations?
How much are our projects ‘sustainable’?
Which best practices are yet in place? Which standards?
Which impact on ICT products and processes (if any)?

10. www.eng.it
10
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Agenda
•Introduction
–Sustainability: definition & concept
–Some basic questions
•Green & Sustainable Software Process
—Definitions
•ISO/IEC 33000: A Standard for Software Process Assessment
–MF: Measurement Framework
–PRM: Process Reference Model
–PAM: Process Assessment Model
•A Measurement Framework for Process Sustainability
–SL: Sustainability Levels
–PA: Process Attributes
–PRM Changes
•Conclusions & Future Works
•Q&&A
Measur. Framework

11. www.eng.it
11
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Green & Sustainable..
Definitions (1)
• Sustainability Goals: measurable objectives expressed in terms of direct and indirect impacts on economy, society, human beings, and environment.
• Process Sustainability: the characterization of the ability of a process to meet current or projected sustainability goals.
• Software Process: set of interrelated or interacting activities, related to the development, maintenance, and disposal of a software product, which transforms input in output.
• Sustainable software process: a software process able to meet its defined sustainability goals,
• Process Sustainability Level: the characterization of a process on an ordinal measurement scale of process sustainability.
• Process Sustainability Assessment: a disciplined evaluation of an organizational unit’s process against a Process Assessment Model
• Sustainable software product: a software product able to meet its defined sustainability goals. From such a definition a sustainable software product can be seen as software, whose direct and indirect impacts on economy, society, human beings, and environment that results from its development, deployment, and usage are aligned with defined goals.

12. www.eng.it
12
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Green & Sustainable..
Definitions (2)
• Sustainable Software Engineering: the art of developing sustainable software adopting a sustainable software engineering process.
• Negative and positive impacts on sustainable development that result and/or are expected to result from the software product over its whole lifecycle are continuously assessed, documented, and used for a further optimization of the software product.
(i.e. a pattern of growth in which resource use aims to meet human needs while preserving the environment so that these needs can be met not only in the present, but also for generations to come)

13. www.eng.it
13
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Agenda
•Introduction
–Sustainability: definition & concept
–Some basic questions
•Green & Sustainable Software Process
—Definitions
•ISO/IEC 33000: A Standard for Software Process Assessment
–MF: Measurement Framework
–PRM: Process Reference Model
–PAM: Process Assessment Model
•A Measurement Framework for Process Sustainability
–SL: Sustainability Levels
–PA: Process Attributes
–PRM Changes
•Conclusions & Future Works
•Q&&A
Sustainability Assess

14. 14 IWSM-MENSURA 2014 – October 6-8, 2014 www.eng.it
© 2014 Lami, Fabbrini & Buglione
ISO/IEC 33000 MF: Measurement Framework
• Measurement Framework: a scheme to use for assigning a
quantitative rating to a quality characteristics of a process
• ISO/IEC 33003  Requirements for the definition of a MF
Components of a MF
• Levels: points on an ordinal scale (e.g. from 0 to 5)
• Process Attributes: measurable characteristics of a process
• Rating Scales: set of values/categories to which an attribute is
mapped (e.g. Not/Partially/Largely/Fully achieved)

15. www.eng.it
15
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
ISO/IEC 33000
PRM: Process Reference model
• Process Reference Model (PRM): model comprising definitions of processes in a life cycle described in terms of process purpose and outcomes, together with an architecture describing the relationships between the processes. [ISO/IEC 33001]
• ISO/IEC 33004  Requirements for the definition of a PRM
Requirements of a PRM
A Process Reference Model shall contain:
• a declaration of the domain of the process reference model;
• a description of the relationship between the process reference model and its intended context of use;
• descriptions of the processes within the scope of the process reference model containing purpose, process outcomes necessary and sufficient to achieve the purpose of the process;
• description of the relationship between the processes defined within the process reference model.

16. www.eng.it
16
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
ISO/IEC 33000
PRM: Process Reference Model
• This a compliant PRM from ISO/IEC 12207:2008
• The ‘sustainability’ proposal aims to strengthen PRMs with processes and a MF compliant with the ISO/IEC 33000 design

17. www.eng.it
17
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
ISO/IEC 33000
PAM: Process Assessment Model
• The PAM is a model for assessing the quality characteristic of processes
• So far, only process quality characteristics of capability has been addressed
• Once a MF specific for sustainability and a compatible PRM will be defined  the SPICE PAM can be used with no change

18. www.eng.it
18
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Agenda
•Introduction
–Sustainability: definition & concept
–Some basic questions
•Green & Sustainable Software Process
—Definitions
•ISO/IEC 33000: A Standard for Software Process Assessment
–MF: Measurement Framework
–PRM: Process Reference Model
–PAM: Process Assessment Model
•A Measurement Framework for Process Sustainability
–SL: Sustainability Levels
–PA: Process Attributes
–PRM Changes
•Conclusions & Future Works
•Q&&A
Sustainability Assess

19. www.eng.it
19
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
MF-Sustainability
SL (Sust. Levels) + PA (Product Attributes)
• Added a Process Attribute (PA) at SL1
• Performance & Sustainability need to be both present at such level

20. www.eng.it
20
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
MF-Sustainability
PRM Changes
• Exemplar Process Definition
Process Name
Measurement
Process Purpose
The purpose of the Measurement Process is to collect, analyze, and report data relating to the products developed and processes implemented within the organizational unit, to support effective and sustainable management of the processes, and to objectively demonstrate the quality and sustainability of the products.
Process Performance Outcomes
As a result of the performance of the Measurement Process:
a) the information needs of technical and management processes are identified;
b) an appropriate set of measures, driven by the information needs are identified and/or developed;
c) measurement activities are identified and planned;
d) the required data are collected, stored, analyzed, and the results interpreted;
e) information products are used to support decisions and provide an objective basis for communication;
f) the Measurement Process and measures are evaluated; and
g) improvements are communicated to the Measurement Process owner.
Process Sustainability Outcomes
As a result of the sustainable implementation of the Measurement Process:
a) the information needs for controlling the achievement of sustainability objectives of technical and management processes are identified;
b) the information needs for controlling the achievement of sustainability objectives of work products are identified;
c) an appropriate set of sustainability measures for processes and work products, driven by the information needs, are identified and/or developed;
d) sustainability measurement activities are identified and planned;
e) the data required for sustainability measurement are collected, stored, analyzed, and the results interpreted and communicated to affected parties;
g) the Sustainability Measurement Process and sustainability measures are evaluated;
h) sustainability improvements are communicated to the sustainability Measurement Process owner.

21. www.eng.it
21
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
MF-Sustainability
MCM Capability Evaluation

22. www.eng.it
22
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Agenda
•Introduction
–Sustainability: definition & concept
–Some basic questions
•Green & Sustainable Software Process
—Definitions
•ISO/IEC 33000: A Standard for Software Process Assessment
–MF: Measurement Framework
–PRM: Process Reference Model
–PAM: Process Assessment Model
•A Measurement Framework for Process Sustainability
–SL: Sustainability Levels
–PA: Process Attributes
–PRM Changes
•Conclusions & Future Works
•Q&&A
Sustainability Assess

23. www.eng.it
23
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Conclusions && Future Works
•Measuring Process Sustainability (not only Capability)
Measurement is fundamental for approximating the size of entities of interest
Measurement should be desirable also for processes, not only products/services
Sustainability can be a further attribute to consider for evaluating a process
•Measurement Framework (MF)
ISO/IEC 33000 serie allows the definition of a MF for process sustainability
A MF for process sustainability has been presented
The presented MF for process sustainability can be applied in ISO/IEC 33000-compliant process assessments
Next Steps
...try & see!
All models are wrong. Some models are useful.
(George Box, Mathematician, 1919-2013)
Sustainability Assess

24. www.eng.it
24
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Lessons Learned...
URL: www.dilbert.com
Sustainability Assess

25. www.eng.it
25
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Q && A
Bedankt aandachtBedankt voor uw aandacht!!
Thanks attentionThanks for your attention!!
Sustainability Assess

26. www.eng.it
26
IWSM-MENSURA 2014 – October 6-8, 2014
© 2014 Lami, Fabbrini & Buglione
Our Contact Data
Luigi
Buglione
Engineering Ingegneria Informatica/ETSluigi.buglione@eng.it
Fabrizio
Fabbrini
ISTI/CNRfabrizio.fabbrinii@isti.cnr.it
Giuseppe
Lami
ISTI/CNRgiuseppe.lami@isti.cnr.it
Measur. Framework