Philippe Krief, Eclipse Foundation Research Relations Director explains how the Crossminer H2020 project outcomes can help software developers to select the right open source components for their own project This presentation was recorded during the OSS Projects Assesment Session at OW2con'19, June 12, 2019 in Paris.

1. Eclipse SCAVA
Helping software developers
select the right open source components
Philippe Krief, PhD
Eclipse Foundation
Research Relations Director

2. How do you look for a component in GitHub?

3. July 2018
May 2019

4. ?

5. Which REPO
should I clone?
• Which one is well written?
• Which one is maintained?
• Which one is using maintained libraries?
• Which one has an active community?
• Which one has a friendly community?
• Which one my competitors are using?
• Which one is well written?
• Which one is maintained?
• Which one is using maintained libraries?
• Which one has an active community?
• Which one has a friendly community?
• Which one my competitors are using?

6. CROSSMINER is an open-source platform for automatically analysing the source code,
bug tracking systems, and communication channels of open source software projects.

7. Eclipse by numbers
360
+ 1120
162
M
1550
+
projects repositorie
s
lines of
code
committers

8. Who are Eclipse users
■ Consumers of Eclipse projects
⧫ Individuals
⧫ Other open source teams
⧫ Companies
■ Developers of Eclipse projects
⧫ Core contributors/committers
⧫ Individuals
8

9. ■ Code quality: is the code base maintainable, reliable, portable?
■ Sustainability: will the project be still actively maintained in the
upcoming years?
■ Process maturity: does the project follow a well-defined
process?
■ Fit for purpose: how well and how easily will the solution fit its
intended purpose?
■ Popularity of the community: is the community a positive one
or are actors dissatisfied by the project?
9
(Eclipse) Consumers needs

10. ■ Code quality: is the code base maintainable, reliable, portable?
■ Recommendations to perform better and find alternative
solutions to current problems.
■ Process: release schedule conformance, time to fix bugs,
reactivity of support, conformance to Eclipse Way, dependency
analysis.
■ Community: activity, diversity, niceness of people.
10
(Eclipse) Developers needs

11. Eclipse has started two initiatives in recent years to make
some data available and useful: the Eclipse dashboard
(Bitergia) and the PolarSys Maturity Assessment
(Castalia Solutions).
These initiatives have successfully completed their initial
objectives, and the Foundation is going forward.
Now is the right time to build upon these early steps:
■ Address more projects
■ Provide an easy way to access data
■ Provide more than just raw data
■ Provide practical and contextual recommendations
11
Business Needs
Eclipse dashboard
PolarSys Maturity
Assessment

12. CROSSMINER project will enable the Foundation to increase quality,
reliability and usability of Eclipse projects.
■ Using a documented assessment of project quality will
enable people to better understand what quality is and how it
evolves in the context of the Eclipse Foundation.
■ Providing numbers and figures for quality attributes will enable
community-wide discussions and interactions on these topics
based on facts.
12
Desired business improvements

13. CROSSMINER
Server
SCAVA Data Pre-processing
git
Hudson /
Jenkins
Bugzilla Mailing Lists Forums
Project Mgmt
Infra (PMI)
GIT clone
Proxy
Bugzilla
Anonymised
DataSet
Anonymised
DataSet
Open Source
Project
NLP
Miner
Configuration
Miner
Source Code
Miner
SCAVA
Knowledge
Database
Data
Preprocessing
Eclipse API
Cross Project
Analysis
13

14. SCAVA type of metrics & features
■ Source code mining
⧫ Quality Measurements: metrics, smells..
⧫ Patterns analysis and recommendations
■ Text mining
⧫ Community Emotions
■ Cross-project relationships
⧫ Recommendations, Project similarities
■ System configuration mining
⧫ Linter & Recommendations (Puppet, Docker, etc.)
■ Knowledge extraction
⧫ Snippet code
⧫ Stack Overflow

15. 15
Knowledge Database Exploitation
CROSSMINER
Knowledge
Database
Kibana / Kibiter
Tools for assessing the
quality of analysed
components
Recommendations:
- Alternative libraries
- Additional Libraries
- API code assist
- Patterns
Eclipse IDE
REST API - Raw Data

16. SCAVA main features
■ SCAVA Admin UI
⧫ Projects import and management
⧫ Analysis tasks creation & Metrics availability
■ PROSOUL
⧫ Quality Attributes and Quality Model
management and visualisation
⧫ Computes the Quality Model by aggregating
values of metrics
■ KIBITER / KIBANA Dashboard
⧫ Metrics and Quality Model visualisation
■ Eclipse Plugin
⧫ Projects search (for similarities)
⧫ Code recommendations
Forge
Scava Admin
SCAVA
KB DB
DM Analysis
Prosoul
Elastic
Search
Kibiter
Dashboard
Eclipse
Plugin

17. Demo

18. Copyright © 2018 The Eclipse Foundation. All Rights Reserved

19. Some pointers
■ Eclipse SCAVA project website
⧫ https://www.eclipse.org/scava
■ CROSSMINER Project website
⧫ https://www.crossminer.org/
■ Eclipse Mailing List
⧫ https://accounts.eclipse.org/mailing-list/scava-dev
■ Metrics Reference Guide
⧫ https://scava-docs.readthedocs.io/en/latest/user-guide/metrics
■ Scava/Crossminer Dashboard instance
⧫ http://scava-dev.ow2.org:8601
■ Eclipse Scava demo instances:
⧫ http://ci4.castalia.camp

20. Thank you
Philippe Krief
philippe.krief@eclipse-foundation.org
Special thanks to
Boris Baldassari (Castalia Solutions)
eclipse.org/scavacrossminer.org @crossminer