SlideShare ist ein Scribd-Unternehmen logo
1 von 30
Downloaden Sie, um offline zu lesen
The Data Platform for your
Software Development Life Cycle
2
Agenda
Why source{d} ?
How source{d} works
Top use cases
What’s new in the latest releases ?
Demos!
Q&A
Why source{d}?
3
4
All enterprises have Digital
Transformation projects.
7 out of 10 fail.
Entering a new Observability era
1990s
Linux
Apps are monolithics and the work
split across silos: Development,
Testing and Operations
Git
Version Control allowed
developers to collaborate
effectively
2000s
DevOps
CI / CD and container systems
allowed Developers and Ops
to collaborate effectively
Observability
Shared data, common
processes and end to end
visibility allowing business and
IT leaders to collaborate
effectively
2020s2010s
6
Large investment success!
$200M+
average investment per year
over five years for large companies to
transform their business to digital
COSTLY
Sources: McKinsey: A CEO guide for avoiding the ten traps that derail digital transformation (2017); McKinsey: Digital Reinvention (2017).
RISKY
>70%
failure rate
In all IT platform
renewal projects
Veterans Affairs Wasted Closer to $2
Billion On Failed IT Projects
Michigan Sues HP Over $49
Million IT Modernization Project
7
IT Modernization = opportunities
$1.4 billion
annual incremental revenues
potential impact of the right
transformation team over 9 months
VERY REWARDING
✔ Reduces infrastructure and/or development costs
✔ Faster time to market & issue resolution
✔ Higher developer productivity & morale
✔ Shifting IT budget from maintenance to innovation, from CapEx to OpEx
✔ Tech stack is more appealing to engineering talents
8
What is the common thread
between successful IT
modernization projects?
Clear visibility over technology
portfolio, people and processes
With no data, IT leaders are in the dark
Lack of visibility comes from:
✖ Volume, variety, intricacy and versioning of source code
✖ No easy way to retrieve, parse and query source code history at scale
✖ Lack of proper documentation and/or expertise with legacy systems
✖ Source code, software development and business data are spread
across many silos
✖ Shadow IT due to developer frustration with legacy systems & slow
processes
Higher risk of failure
or future rework
Where are we now and
what should change?
- How are my people, processes
and technology today?
- Which and how they need
change to achieve our targets?
What do we want and
what do we get out of it?
- What generates value or cuts
costs aligned with our vision?
- Which parts of the product
and processes are suitable?
10
Modernization is a journey
Who to involve and
How do we measure progress?
- What stakeholders & team are
fit and what they care about?
- What KPIs give stakeholders
visibility on actual progress?
SET TARGETS ASSESS & PLAN EXECUTE & MONITOR
Adapted from: McKinsey & Co., Modernizing IT for a digital era (2016).
11
Modernization is not just about code
Understand the technology in
your organization.
- Measure your technology
transformation
- Languages, frameworks, libs
- Map architecture & issues
- Map dependency & impact
Analyze and drive behavior in
your organization.
- Codify your guidelines
& best practices
- Measure impact of actions
- Adopt new practices
(InnerSource)
- Map/avoid compliance issues
PEOPLE PROCESSES TECHNOLOGY
Understand your existing talent
& where you need to upskill.
- Talent analysis
- Skill gap analysis
- Collaboration assessment
- Project/Talent fit
- Identifying knowledge leaders
Adapted from: McKinsey & Co., Digital Reinvention – From disrupted to disruptor: Reinventing your business by transforming the core (2017).
How source{d} works?
12
Make better decisions
based on actionable
insights from graphs,
charts and tables
13
source{d} data platform
TIMELY
Get up-to-date insights
into your Software
Development Life
Cycle
SCALABLE AI-POWERED
Leverage Machine
Learning on Code to
provide advanced and
predictive analysis
VISUAL
Process billions of lines
of source code from
tens of thousands of
developers
14
Insights from your entire SDLC
Powerful analyses on demand
Universal ASTs* enable deep & wide analyses across
programming languages through semantic concepts
15
Answer your own hard unique questions at any time
Empower your teams through SQL queries
ACCESSIBLE FLEXIBLE & POWERFUL
source code UASTs
← write questions
get answers →
* Universal ASTs were developed by source{d} as a language agnostic layer on top of source code, analyze source code independent of the diversity of programming languages
16
Built on top of our open-source
+2.5k
forks on GitHub
hundreds of community members
contribute back to source{d} projects
go-git
the core project of source{d} tech
3.8k stars & 390 forks
1.3k unique cloners
in the last 30 days
POPULAR IN OSS PROJECT HIGHLIGHT ENGAGED COMMUNITY
+15.5k
stars on Github
source{d} is one of the most popular
open-source software organizations
source{d} use cases
17
Top use cases
18
Technical Debt Assessment
& IT Modernization
Cloud Native &
Devops Adoption
Engineering Effectiveness
& Inner Source
Talent Assessment
& Management
Engineering Observability is the key to successful IT initiatives
19
Technical Debt Assessment & Modernization
Questions:
● How many COBOL or Fortran lines of code /
files do you still have in your codebase?
● What % of your code/ apps is meant for
mainframes?
● Do we have any unmaintained code?
Queries:
● LoC & File counts per language / OS /
framework
● # repositories per language
● New repos created per languages
● Arguments and methods count
● File and method lengths
20
Cloud Native & DevOps adoption
Questions:
● What apps haven't been adapted to the cloud?
● % of apps that have been dockerized?
● Have all our teams upgraded to the latest
version of Kubernetes?
Queries:
● % of projects with Dockerfiles, Helm charts, etc
● Release tags
● Upcoming: Build data (# of builds / day,
average build duration, etc)
21
Engineering Effectiveness and Inner Source
Questions:
● Where is our development process slowing
down?
● Who are the top performing developers on this
project?
● How effective are we at cross-team / company
collaboration?
● Is code being re-used?
Queries:
● Code churn
● Per-project code ownership plots
● Top developers given project ownership,
language and C# import criteria.
● Measure the effectiveness of onboarding
processes (hire date to first commit merged?)
22
Talent Assessment and Management
Questions:
● How effective are individual developers on my
team and do they have the right skill set?
● Are any of my developers falling behind on
work? How do they compare to the rest of the
team?
● What are the mentorship opportunities I can
give to my developers?
Queries:
● "Impact" of each commit for each project
● # of additions, deletions, file changed by day,
week, month, year
● # of new lines of code, comments or blank
lines by day, week, month, year
● Detect clusters of developers with similar skills
source{d} releases
23
v0.11 recap
24
● C# language support.
● Windows 10 support with Docker for Windows (experimental).
● Engine CLI can switch between different datasets.
● Performance improvements: traversing commits is up to 3x faster.
● Lots of bug fixes and stability improvements.
v0.12 recap
25
● Up to 2x performance improvement on language parsing.
● Default command line client for querying switched to official MySQL client.
● Lots of usability improvements.
● Lots of bug fixes.
v0.13 highlights
26
● Engine configuration can be edited with the srcd config command.
● CPU usage cap to avoid freezing the host on intensive workloads.
● Logging improved and more flexible.
● Command autocompletion.
Next releases
27
● Improvements to usability in the web interface
● Integrated customizable dashboard user interface
● Unified interface for dashboarding, querying, UAST inspection
● Built-in more advanced analyses: Git diff for trees, blobs; blame
● Enterprise Edition
WHAT TO EXPECT
Demos!
28
Q&As
29
Machine Learning for Large Scale Code Analysis
sourced.tech blog.sourced.tech github.com/src-d

Weitere ähnliche Inhalte

Was ist angesagt?

Low code - empower the capability to accelerate | Swatantra Kumar
Low code - empower the capability to accelerate | Swatantra KumarLow code - empower the capability to accelerate | Swatantra Kumar
Low code - empower the capability to accelerate | Swatantra KumarSwatantra Kumar
 
Strategic Benefits of Contributing to Open Source: For businesses and individ...
Strategic Benefits of Contributing to Open Source: For businesses and individ...Strategic Benefits of Contributing to Open Source: For businesses and individ...
Strategic Benefits of Contributing to Open Source: For businesses and individ...All Things Open
 
Engaging Open Source Developers to Develop Tech for Good through Code and Res...
Engaging Open Source Developers to Develop Tech for Good through Code and Res...Engaging Open Source Developers to Develop Tech for Good through Code and Res...
Engaging Open Source Developers to Develop Tech for Good through Code and Res...Daniel Krook
 
Research software identification - Catherine Jones
Research software identification - Catherine JonesResearch software identification - Catherine Jones
Research software identification - Catherine JonesJisc RDM
 
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...Daniel Krook
 
Serverless: The next major shift in cloud computing
Serverless: The next major shift in cloud computingServerless: The next major shift in cloud computing
Serverless: The next major shift in cloud computingDoug Vanderweide
 
An introduction to Open Source for Cities
An introduction to Open Source for CitiesAn introduction to Open Source for Cities
An introduction to Open Source for CitiesBoris van Hoytema
 
All Researchers Should Become Entrepreneurs
All Researchers Should Become EntrepreneursAll Researchers Should Become Entrepreneurs
All Researchers Should Become EntrepreneursJordi Cabot
 
Quality, Cost, and Governance of Open Source Software
Quality, Cost, and Governance of Open Source SoftwareQuality, Cost, and Governance of Open Source Software
Quality, Cost, and Governance of Open Source SoftwareGirl Geek Dinners Milano
 
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power PlatformTracy Van der Schyff
 
The Why of Go
The Why of GoThe Why of Go
The Why of GoC4Media
 
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical Study
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical StudyCharacteristics of Sustainable OSS Projects:
 A Theoretical and Empirical Study
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical StudyHideaki Hata
 

Was ist angesagt? (12)

Low code - empower the capability to accelerate | Swatantra Kumar
Low code - empower the capability to accelerate | Swatantra KumarLow code - empower the capability to accelerate | Swatantra Kumar
Low code - empower the capability to accelerate | Swatantra Kumar
 
Strategic Benefits of Contributing to Open Source: For businesses and individ...
Strategic Benefits of Contributing to Open Source: For businesses and individ...Strategic Benefits of Contributing to Open Source: For businesses and individ...
Strategic Benefits of Contributing to Open Source: For businesses and individ...
 
Engaging Open Source Developers to Develop Tech for Good through Code and Res...
Engaging Open Source Developers to Develop Tech for Good through Code and Res...Engaging Open Source Developers to Develop Tech for Good through Code and Res...
Engaging Open Source Developers to Develop Tech for Good through Code and Res...
 
Research software identification - Catherine Jones
Research software identification - Catherine JonesResearch software identification - Catherine Jones
Research software identification - Catherine Jones
 
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
Commit to the Cause, Push for Change: Contributing to Call for Code Open Sour...
 
Serverless: The next major shift in cloud computing
Serverless: The next major shift in cloud computingServerless: The next major shift in cloud computing
Serverless: The next major shift in cloud computing
 
An introduction to Open Source for Cities
An introduction to Open Source for CitiesAn introduction to Open Source for Cities
An introduction to Open Source for Cities
 
All Researchers Should Become Entrepreneurs
All Researchers Should Become EntrepreneursAll Researchers Should Become Entrepreneurs
All Researchers Should Become Entrepreneurs
 
Quality, Cost, and Governance of Open Source Software
Quality, Cost, and Governance of Open Source SoftwareQuality, Cost, and Governance of Open Source Software
Quality, Cost, and Governance of Open Source Software
 
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform
20201107 Putting the DEV in Citizen DEVeloper with the Microsoft Power Platform
 
The Why of Go
The Why of GoThe Why of Go
The Why of Go
 
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical Study
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical StudyCharacteristics of Sustainable OSS Projects:
 A Theoretical and Empirical Study
Characteristics of Sustainable OSS Projects:
 A Theoretical and Empirical Study
 

Ähnlich wie What's new in the latest source{d} releases!

Unlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analyticsUnlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analyticssource{d}
 
PMI Thailand: DevOps / Roles of Project Manager (20-May-2020)
PMI Thailand:   DevOps / Roles of Project Manager (20-May-2020)PMI Thailand:   DevOps / Roles of Project Manager (20-May-2020)
PMI Thailand: DevOps / Roles of Project Manager (20-May-2020)Gonzague PATINIER
 
From 50 to 500 product engineers – data-driven approach to building impactful...
From 50 to 500 product engineers – data-driven approach to building impactful...From 50 to 500 product engineers – data-driven approach to building impactful...
From 50 to 500 product engineers – data-driven approach to building impactful...DevClub_lv
 
BuildingBlocksEbook-Sept2019.pdf
BuildingBlocksEbook-Sept2019.pdfBuildingBlocksEbook-Sept2019.pdf
BuildingBlocksEbook-Sept2019.pdfAndri Muhyidin
 
Bikram kishor rout
Bikram kishor routBikram kishor rout
Bikram kishor routBikram Rout
 
DEVNET-1125 Partner Case Study - “Project Hybrid Engineer”
DEVNET-1125	Partner Case Study - “Project Hybrid Engineer”DEVNET-1125	Partner Case Study - “Project Hybrid Engineer”
DEVNET-1125 Partner Case Study - “Project Hybrid Engineer”Cisco DevNet
 
DevOps-driving-blind
DevOps-driving-blindDevOps-driving-blind
DevOps-driving-blindPaul Peissner
 
The Need for Speed
The Need for SpeedThe Need for Speed
The Need for SpeedCapgemini
 
SA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterpriseSA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterpriseDavid Graham
 
What is the future of DevOps and its growing trends.pptx
What is the future of DevOps and its growing trends.pptxWhat is the future of DevOps and its growing trends.pptx
What is the future of DevOps and its growing trends.pptxCalidad Infotech
 
Measure and Accelerate Your Software Delivery
Measure and Accelerate Your Software DeliveryMeasure and Accelerate Your Software Delivery
Measure and Accelerate Your Software DeliveryAnand Chauhan
 
Desmistificando Tecnologias
Desmistificando TecnologiasDesmistificando Tecnologias
Desmistificando TecnologiasJuliano Martins
 
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
Platform Requirements for CI/CD Success—and the Enterprises Leading the WayPlatform Requirements for CI/CD Success—and the Enterprises Leading the Way
Platform Requirements for CI/CD Success—and the Enterprises Leading the WayVMware Tanzu
 
Patterns for Success: Lessons Learned When Adopting Enterprise DevOps
Patterns for Success: Lessons Learned When Adopting Enterprise DevOpsPatterns for Success: Lessons Learned When Adopting Enterprise DevOps
Patterns for Success: Lessons Learned When Adopting Enterprise DevOpsCognizant
 
ASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaAvisi B.V.
 
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEER
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEERA DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEER
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEEROrion eSolutions
 
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...Siva Rama Krishna Chunduru
 
Case Study: Practical tools and strategies for tackling legacy practices and ...
Case Study: Practical tools and strategies for tackling legacy practices and ...Case Study: Practical tools and strategies for tackling legacy practices and ...
Case Study: Practical tools and strategies for tackling legacy practices and ...Alejandro S.
 
Shrinking the Custom Application Development Cycle with Low-Code Platforms
Shrinking the Custom Application Development Cycle with Low-Code PlatformsShrinking the Custom Application Development Cycle with Low-Code Platforms
Shrinking the Custom Application Development Cycle with Low-Code PlatformsQuickBase, Inc.
 
Modernize Development with Agile Engineering Practices
Modernize Development with Agile Engineering PracticesModernize Development with Agile Engineering Practices
Modernize Development with Agile Engineering PracticesCollabNet
 

Ähnlich wie What's new in the latest source{d} releases! (20)

Unlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analyticsUnlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analytics
 
PMI Thailand: DevOps / Roles of Project Manager (20-May-2020)
PMI Thailand:   DevOps / Roles of Project Manager (20-May-2020)PMI Thailand:   DevOps / Roles of Project Manager (20-May-2020)
PMI Thailand: DevOps / Roles of Project Manager (20-May-2020)
 
From 50 to 500 product engineers – data-driven approach to building impactful...
From 50 to 500 product engineers – data-driven approach to building impactful...From 50 to 500 product engineers – data-driven approach to building impactful...
From 50 to 500 product engineers – data-driven approach to building impactful...
 
BuildingBlocksEbook-Sept2019.pdf
BuildingBlocksEbook-Sept2019.pdfBuildingBlocksEbook-Sept2019.pdf
BuildingBlocksEbook-Sept2019.pdf
 
Bikram kishor rout
Bikram kishor routBikram kishor rout
Bikram kishor rout
 
DEVNET-1125 Partner Case Study - “Project Hybrid Engineer”
DEVNET-1125	Partner Case Study - “Project Hybrid Engineer”DEVNET-1125	Partner Case Study - “Project Hybrid Engineer”
DEVNET-1125 Partner Case Study - “Project Hybrid Engineer”
 
DevOps-driving-blind
DevOps-driving-blindDevOps-driving-blind
DevOps-driving-blind
 
The Need for Speed
The Need for SpeedThe Need for Speed
The Need for Speed
 
SA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterpriseSA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterprise
 
What is the future of DevOps and its growing trends.pptx
What is the future of DevOps and its growing trends.pptxWhat is the future of DevOps and its growing trends.pptx
What is the future of DevOps and its growing trends.pptx
 
Measure and Accelerate Your Software Delivery
Measure and Accelerate Your Software DeliveryMeasure and Accelerate Your Software Delivery
Measure and Accelerate Your Software Delivery
 
Desmistificando Tecnologias
Desmistificando TecnologiasDesmistificando Tecnologias
Desmistificando Tecnologias
 
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
Platform Requirements for CI/CD Success—and the Enterprises Leading the WayPlatform Requirements for CI/CD Success—and the Enterprises Leading the Way
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
 
Patterns for Success: Lessons Learned When Adopting Enterprise DevOps
Patterns for Success: Lessons Learned When Adopting Enterprise DevOpsPatterns for Success: Lessons Learned When Adopting Enterprise DevOps
Patterns for Success: Lessons Learned When Adopting Enterprise DevOps
 
ASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de Miranda
 
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEER
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEERA DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEER
A DETAILED ROADMAP TO BECOMING A DEVOPS ENGINEER
 
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
 
Case Study: Practical tools and strategies for tackling legacy practices and ...
Case Study: Practical tools and strategies for tackling legacy practices and ...Case Study: Practical tools and strategies for tackling legacy practices and ...
Case Study: Practical tools and strategies for tackling legacy practices and ...
 
Shrinking the Custom Application Development Cycle with Low-Code Platforms
Shrinking the Custom Application Development Cycle with Low-Code PlatformsShrinking the Custom Application Development Cycle with Low-Code Platforms
Shrinking the Custom Application Development Cycle with Low-Code Platforms
 
Modernize Development with Agile Engineering Practices
Modernize Development with Agile Engineering PracticesModernize Development with Agile Engineering Practices
Modernize Development with Agile Engineering Practices
 

Mehr von source{d}

Overton, Apple Flavored ML
Overton, Apple Flavored MLOverton, Apple Flavored ML
Overton, Apple Flavored MLsource{d}
 
Code as Data workshop: Using source{d} Engine to extract insights from git re...
Code as Data workshop: Using source{d} Engine to extract insights from git re...Code as Data workshop: Using source{d} Engine to extract insights from git re...
Code as Data workshop: Using source{d} Engine to extract insights from git re...source{d}
 
Gitbase, SQL interface to Git repositories
Gitbase, SQL interface to Git repositoriesGitbase, SQL interface to Git repositories
Gitbase, SQL interface to Git repositoriessource{d}
 
Deduplication on large amounts of code
Deduplication on large amounts of codeDeduplication on large amounts of code
Deduplication on large amounts of codesource{d}
 
Assisted code review with source{d} lookout
Assisted code review with source{d} lookoutAssisted code review with source{d} lookout
Assisted code review with source{d} lookoutsource{d}
 
Machine Learning on Code - SF meetup
Machine Learning on Code - SF meetupMachine Learning on Code - SF meetup
Machine Learning on Code - SF meetupsource{d}
 
Inextricably linked reproducibility and productivity in data science and ai ...
Inextricably linked reproducibility and productivity in data science and ai  ...Inextricably linked reproducibility and productivity in data science and ai  ...
Inextricably linked reproducibility and productivity in data science and ai ...source{d}
 
source{d} Engine - your code as data
source{d} Engine - your code as datasource{d} Engine - your code as data
source{d} Engine - your code as datasource{d}
 
Introduction to the source{d} Stack
Introduction to the source{d} Stack Introduction to the source{d} Stack
Introduction to the source{d} Stack source{d}
 
source{d} Engine: Exploring git repos with SQL
source{d} Engine: Exploring git repos with SQLsource{d} Engine: Exploring git repos with SQL
source{d} Engine: Exploring git repos with SQLsource{d}
 
Introduction to source{d} Engine and source{d} Lookout
Introduction to source{d} Engine and source{d} Lookout Introduction to source{d} Engine and source{d} Lookout
Introduction to source{d} Engine and source{d} Lookout source{d}
 
Machine learning on Go Code
Machine learning on Go CodeMachine learning on Go Code
Machine learning on Go Codesource{d}
 
Improving go-git performance
Improving go-git performanceImproving go-git performance
Improving go-git performancesource{d}
 
Machine learning on source code
Machine learning on source codeMachine learning on source code
Machine learning on source codesource{d}
 

Mehr von source{d} (14)

Overton, Apple Flavored ML
Overton, Apple Flavored MLOverton, Apple Flavored ML
Overton, Apple Flavored ML
 
Code as Data workshop: Using source{d} Engine to extract insights from git re...
Code as Data workshop: Using source{d} Engine to extract insights from git re...Code as Data workshop: Using source{d} Engine to extract insights from git re...
Code as Data workshop: Using source{d} Engine to extract insights from git re...
 
Gitbase, SQL interface to Git repositories
Gitbase, SQL interface to Git repositoriesGitbase, SQL interface to Git repositories
Gitbase, SQL interface to Git repositories
 
Deduplication on large amounts of code
Deduplication on large amounts of codeDeduplication on large amounts of code
Deduplication on large amounts of code
 
Assisted code review with source{d} lookout
Assisted code review with source{d} lookoutAssisted code review with source{d} lookout
Assisted code review with source{d} lookout
 
Machine Learning on Code - SF meetup
Machine Learning on Code - SF meetupMachine Learning on Code - SF meetup
Machine Learning on Code - SF meetup
 
Inextricably linked reproducibility and productivity in data science and ai ...
Inextricably linked reproducibility and productivity in data science and ai  ...Inextricably linked reproducibility and productivity in data science and ai  ...
Inextricably linked reproducibility and productivity in data science and ai ...
 
source{d} Engine - your code as data
source{d} Engine - your code as datasource{d} Engine - your code as data
source{d} Engine - your code as data
 
Introduction to the source{d} Stack
Introduction to the source{d} Stack Introduction to the source{d} Stack
Introduction to the source{d} Stack
 
source{d} Engine: Exploring git repos with SQL
source{d} Engine: Exploring git repos with SQLsource{d} Engine: Exploring git repos with SQL
source{d} Engine: Exploring git repos with SQL
 
Introduction to source{d} Engine and source{d} Lookout
Introduction to source{d} Engine and source{d} Lookout Introduction to source{d} Engine and source{d} Lookout
Introduction to source{d} Engine and source{d} Lookout
 
Machine learning on Go Code
Machine learning on Go CodeMachine learning on Go Code
Machine learning on Go Code
 
Improving go-git performance
Improving go-git performanceImproving go-git performance
Improving go-git performance
 
Machine learning on source code
Machine learning on source codeMachine learning on source code
Machine learning on source code
 

Kürzlich hochgeladen

Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 

Kürzlich hochgeladen (20)

Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 

What's new in the latest source{d} releases!

  • 1. The Data Platform for your Software Development Life Cycle
  • 2. 2 Agenda Why source{d} ? How source{d} works Top use cases What’s new in the latest releases ? Demos! Q&A
  • 4. 4 All enterprises have Digital Transformation projects. 7 out of 10 fail.
  • 5. Entering a new Observability era 1990s Linux Apps are monolithics and the work split across silos: Development, Testing and Operations Git Version Control allowed developers to collaborate effectively 2000s DevOps CI / CD and container systems allowed Developers and Ops to collaborate effectively Observability Shared data, common processes and end to end visibility allowing business and IT leaders to collaborate effectively 2020s2010s
  • 6. 6 Large investment success! $200M+ average investment per year over five years for large companies to transform their business to digital COSTLY Sources: McKinsey: A CEO guide for avoiding the ten traps that derail digital transformation (2017); McKinsey: Digital Reinvention (2017). RISKY >70% failure rate In all IT platform renewal projects Veterans Affairs Wasted Closer to $2 Billion On Failed IT Projects Michigan Sues HP Over $49 Million IT Modernization Project
  • 7. 7 IT Modernization = opportunities $1.4 billion annual incremental revenues potential impact of the right transformation team over 9 months VERY REWARDING ✔ Reduces infrastructure and/or development costs ✔ Faster time to market & issue resolution ✔ Higher developer productivity & morale ✔ Shifting IT budget from maintenance to innovation, from CapEx to OpEx ✔ Tech stack is more appealing to engineering talents
  • 8. 8 What is the common thread between successful IT modernization projects? Clear visibility over technology portfolio, people and processes
  • 9. With no data, IT leaders are in the dark Lack of visibility comes from: ✖ Volume, variety, intricacy and versioning of source code ✖ No easy way to retrieve, parse and query source code history at scale ✖ Lack of proper documentation and/or expertise with legacy systems ✖ Source code, software development and business data are spread across many silos ✖ Shadow IT due to developer frustration with legacy systems & slow processes Higher risk of failure or future rework
  • 10. Where are we now and what should change? - How are my people, processes and technology today? - Which and how they need change to achieve our targets? What do we want and what do we get out of it? - What generates value or cuts costs aligned with our vision? - Which parts of the product and processes are suitable? 10 Modernization is a journey Who to involve and How do we measure progress? - What stakeholders & team are fit and what they care about? - What KPIs give stakeholders visibility on actual progress? SET TARGETS ASSESS & PLAN EXECUTE & MONITOR Adapted from: McKinsey & Co., Modernizing IT for a digital era (2016).
  • 11. 11 Modernization is not just about code Understand the technology in your organization. - Measure your technology transformation - Languages, frameworks, libs - Map architecture & issues - Map dependency & impact Analyze and drive behavior in your organization. - Codify your guidelines & best practices - Measure impact of actions - Adopt new practices (InnerSource) - Map/avoid compliance issues PEOPLE PROCESSES TECHNOLOGY Understand your existing talent & where you need to upskill. - Talent analysis - Skill gap analysis - Collaboration assessment - Project/Talent fit - Identifying knowledge leaders Adapted from: McKinsey & Co., Digital Reinvention – From disrupted to disruptor: Reinventing your business by transforming the core (2017).
  • 13. Make better decisions based on actionable insights from graphs, charts and tables 13 source{d} data platform TIMELY Get up-to-date insights into your Software Development Life Cycle SCALABLE AI-POWERED Leverage Machine Learning on Code to provide advanced and predictive analysis VISUAL Process billions of lines of source code from tens of thousands of developers
  • 14. 14 Insights from your entire SDLC
  • 15. Powerful analyses on demand Universal ASTs* enable deep & wide analyses across programming languages through semantic concepts 15 Answer your own hard unique questions at any time Empower your teams through SQL queries ACCESSIBLE FLEXIBLE & POWERFUL source code UASTs ← write questions get answers → * Universal ASTs were developed by source{d} as a language agnostic layer on top of source code, analyze source code independent of the diversity of programming languages
  • 16. 16 Built on top of our open-source +2.5k forks on GitHub hundreds of community members contribute back to source{d} projects go-git the core project of source{d} tech 3.8k stars & 390 forks 1.3k unique cloners in the last 30 days POPULAR IN OSS PROJECT HIGHLIGHT ENGAGED COMMUNITY +15.5k stars on Github source{d} is one of the most popular open-source software organizations
  • 18. Top use cases 18 Technical Debt Assessment & IT Modernization Cloud Native & Devops Adoption Engineering Effectiveness & Inner Source Talent Assessment & Management Engineering Observability is the key to successful IT initiatives
  • 19. 19 Technical Debt Assessment & Modernization Questions: ● How many COBOL or Fortran lines of code / files do you still have in your codebase? ● What % of your code/ apps is meant for mainframes? ● Do we have any unmaintained code? Queries: ● LoC & File counts per language / OS / framework ● # repositories per language ● New repos created per languages ● Arguments and methods count ● File and method lengths
  • 20. 20 Cloud Native & DevOps adoption Questions: ● What apps haven't been adapted to the cloud? ● % of apps that have been dockerized? ● Have all our teams upgraded to the latest version of Kubernetes? Queries: ● % of projects with Dockerfiles, Helm charts, etc ● Release tags ● Upcoming: Build data (# of builds / day, average build duration, etc)
  • 21. 21 Engineering Effectiveness and Inner Source Questions: ● Where is our development process slowing down? ● Who are the top performing developers on this project? ● How effective are we at cross-team / company collaboration? ● Is code being re-used? Queries: ● Code churn ● Per-project code ownership plots ● Top developers given project ownership, language and C# import criteria. ● Measure the effectiveness of onboarding processes (hire date to first commit merged?)
  • 22. 22 Talent Assessment and Management Questions: ● How effective are individual developers on my team and do they have the right skill set? ● Are any of my developers falling behind on work? How do they compare to the rest of the team? ● What are the mentorship opportunities I can give to my developers? Queries: ● "Impact" of each commit for each project ● # of additions, deletions, file changed by day, week, month, year ● # of new lines of code, comments or blank lines by day, week, month, year ● Detect clusters of developers with similar skills
  • 24. v0.11 recap 24 ● C# language support. ● Windows 10 support with Docker for Windows (experimental). ● Engine CLI can switch between different datasets. ● Performance improvements: traversing commits is up to 3x faster. ● Lots of bug fixes and stability improvements.
  • 25. v0.12 recap 25 ● Up to 2x performance improvement on language parsing. ● Default command line client for querying switched to official MySQL client. ● Lots of usability improvements. ● Lots of bug fixes.
  • 26. v0.13 highlights 26 ● Engine configuration can be edited with the srcd config command. ● CPU usage cap to avoid freezing the host on intensive workloads. ● Logging improved and more flexible. ● Command autocompletion.
  • 27. Next releases 27 ● Improvements to usability in the web interface ● Integrated customizable dashboard user interface ● Unified interface for dashboarding, querying, UAST inspection ● Built-in more advanced analyses: Git diff for trees, blobs; blame ● Enterprise Edition WHAT TO EXPECT
  • 30. Machine Learning for Large Scale Code Analysis sourced.tech blog.sourced.tech github.com/src-d