20151014 ing architecting for 400 teams
•Als POTX, PDF herunterladen•
6 gefällt mir•1,782 views
Presentation on the Dutch Agile and Architecture Convention of October 14th, 2015
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (14)
Andere mochten auch
Andere mochten auch (8)
Ähnlich wie 20151014 ing architecting for 400 teams
Ähnlich wie 20151014 ing architecting for 400 teams (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
20151014 ing architecting for 400 teams
- 1. Architecting for 400 agile squads Theory and Practice Agile and Software Architecture Symposium Arnhem. Oct 14th, 2015
- 2. Current: Chief Architect Domestic Bank Netherlands - Software Engineering, agile transformation, DevOps, Continuous Delivery, servant leadership, learning organizations, people, eternal student - Accountable for the design of the bank Architecture, way of working, engineering, simplifying and automating (silly) processes Past: Jack of all trades - Distinguished Software Engineer at a global Systems Integrator - Delivery Unit Manager, CTO, Agile coach Twitter: @henkkolk E-mail: henk.kolk@ing.nl We’re hiring Something about me… 2
- 3. Way back in 1908 … 3 • Henry Ford introduced the first affordable automobile: The T-Ford • The T-Ford opened up travel to the common middle class American • The T-Ford was mass-produced on moving assembly lines • This approach revolutionized transportation and the American industry • It disrupted prior “best practices” on how to organize efficiently • Significant productivity growth
- 4. However, 20 years later, in 1929 4 Black Tuesday • After years of a common belief in an unending bull market • Consumers have accumulated great debt • There were bank runs & the start of the great depression • 4000 banks closed in the 4 years that followed • Deep poverty for many • Faith in banks restored by creating new regulatory institutions in 1933
- 6. • 1771: Industrial Revolution • 1829: Age of Steam and Railways • 1875: Age of steel and electricity What was similar? • Technology revolution and creation of new infrastructure, leading to • Significantly higher productivity, • Resulting in a creative destruction of existing industries and infrastructures • New millionaires, financial derivatives, economic bubbles and subsequent crash We’ve seen this three times (before) 6 *) *) From Technological Revolutions and Financial Capital, C. Perez
- 7. Why is this interesting?
- 8. • 1971: Robert Noyce and Gordon Moore founded Intel and introduced the first general purpose programmable processor • Start of the Era of integrated electronics • Cheap, affordable, etc. (familiar?) • New productivity paradigm and new infrastructure • Unending bull market, consumers accumulating debt, financial derivatives, etc • Financial crashes in 1990 and 2007 We are probably in the backlash of a similar storm 8
- 9. So, what?
- 10. Somewhat every 50 years, there was a • Major technology revolution that introduces competitive new infrastructure, leading to higher productivity • The new infrastructure disrupted industry, commerce and society • There was a subsequent boom and bust of economies • After the bust, new infrastructure was in place • New social “best practices”, a new “common sense” • New legislation is lagging behind According to Carlota Perez there is an interesting pattern to be constructed from all of this 10
- 11. Prior vs. new common sense
- 12. • Each revolution is by definition different from the prior one • The new “common sense” principles will have to be socially learned • This learning must overcome the forces of inertia that stem from the previous paradigms 1980’s (stemming from the success of Fordism) • Mass production paradigm: centralized, hierarchical pyramid with functional departments • Implemented by almost every corporation and institutions • West and East • Schools and Universities • Hospitals Now • Decentralized network infrastructures, autonomous teams, etc • Battle between the “old common sense best practices” and the “new best practices” Key insight 12
- 13. Old paradigms & roles 13 • Business Architect • Solution Architect • Requirements Specifier • Designer • Coder • Tester • Deployer • Chief Engineer
- 14. Software Eating the World is Marc Andreessen
- 16. Quality of an IT Organization Quality of its Engineers is Ron van Kemenade
- 17. The agile journey of ING
- 18. 18 In 2009 ING had a traditional enterprise IT organization IT is a commodity; everyone can do IT Internal “customers” IT is a cost center Quality through process adherence Lots of manual work & handovers Multiple sourcing partners Scattered IT landscape Non-functionals provided by infra Starting position
- 19. 19 ING has been re-organizing for agility at scale on many levels Start of ING’s own Java community Engineering culture May 2010 Full reorganization i.e. 180 full DevOps teams Engineers hunger to take responsibility. May 2013 Oct 2009 New IT Mgt team The will to change Nov 2011 Discussion – who runs production. Clear demarcation responsibilities infra and applications Sep 2014 Need full automation infra & scalable systems Build private cloud Start full automation of IT processes Continuous Delivery - Jez Humble & Dave Farley May 2011 Oct 2010 Start of Mobile app development 1st Scrum team and start agile development Formal Platform Engineering teams API Platform, Cassandra, Continuous Delivery Nov 2014 July 2015 Need of commercial colleagues to join Full re-org to 400 BusDevOps squads New HR model for Software Engineers Attracting and nurturing full stack engineers October 2015
- 20. INGs agile journey so far has been based on 4 ideas 20 Continuous Delivery in all our teams Nothing beats engineering talent Partners are welcome, outsourcing not preferred We distinguish by building great software
- 21. From To • “IT enables the commercial strategy” “IT drives the commercial strategy” • “IT is a cost center” “IT is a value driver” • “Outsourcing for the lowest price” “Hiring the best talent” • “Buy before build” “Building as the way to understanding” • “Projects to drive change” “Line drives the change” Pervasive legacy beliefs are the key challenge to overcome
- 22. • There are tremendous differences in productivity and mastery • ING nurtures young engineers to grow fast • We recognize that expert and proficient engineers are as valuable (or more valuable) than managers • We recognize that during the journey to mastery, engineers have different learning needs ING’s People strategy: we are the place for great engineers 22 Novice Advanced Beginner Competent Proficient Expert
- 23. What does this mean for architects?
- 24. • Expert Engineers or Software Architects -> not always a clear difference • Engineering communities set the standards & standards are changing faster • Deep IT knowledge of IT Tribe leads and IT Chapter leads: They have a vision on IT too • Powerpoint or Visio lagging behind code (version control) and discovered state • Increasing need for global alignment (other ING countries) • Culture is key: the invisible rules of what it takes to be perceived as successful. This needs to be discussed. If success is created by teamwork, there is no more “I”. • Platforms rule. Platforms are designed and built by “Master Builders” The role of the traditional Architecture department changes 24
- 25. Continuous Delivery Platform Load & Performance Tests Soak Tests Resilience Tests Functional Tests Functional Component Tests Code Security Assurance Unit Tests Compile & Build Code Quality Assurance CID P1 P2ITT A
- 26. Big Hadoop DWH - RDBMS Fast Akka Scala Spray Spark Cassandra Data platform Akka, KafkaHadoop Cassandra Spray Millions of customers Billions of messages • Distributed computing and storage • Open Source based • Near Realtime + Big Data
- 27. API Platform Technologies being used • Java, Scala (JVM based languages) • JAX-RS • RX • Hystrix • Apache Cassandra • Nginx • Apache ZooKeeper • Apache Curator • Ribbon • Docker • Mesos • …
- 29. Design, like you give a damn! Flavia Sequira
- 30. Platform squads “We are here to make other squads Awesome!”
- 31. Be AWESOME Twitter: @henkkolk E-mail: henk.kolk@ing.nl We’re hiring
Hinweis der Redaktion
- Three parts to my story today: - to create a context I want to share some insights from the unique perspective of engineering in the banking industry, basically how technology disruptions tend to create financial booms and busts and a new “common sense”. - to share with you the journey that we are undertaking to become the best IT organisation in the Netherlands. I know this is a big claim to share what I’ve learned about architecting for 400 agile teams, and the culture of design that we are installing. Why: - To understand deeper the radical changes that agile and software engineering bring to our organizations and society - To discuss and give me feedback today on your insights on how the role of the classic enterprise architect is changing
- The T-For still makes the top-ten of most vehicles sold (currently 8th place)
- The T-For still makes the top-ten of most vehicles sold (currently 8th place)
- - Technology companies are having existing enterprises for breakfast - Kudos Marc Andreessen — Co-creator of the first web browser, Mosaic — Co-Founder of Netscape — Board member of HP, FaceBook, eBay — Cofounder of Venture Capitalist Andreessen Horrowitz “My own theory is that we are in the middle of a dramatic and broad technological and economic shift in which software companies are poised to take over large swathes of the economy. More and more major businesses and industries are being run on software and delivered as online services — from movies to agriculture to national defence. Many of the winners are Silicon Valley-style entrepreneurial technology companies that are invading and overturning established industry structures. Over the next 10 years, I expect many more industries to be disrupted by software, with new world-beating Silicon Valley companies doing the disruption in more cases than not.” [Software is eating the world](http://online.wsj.com/articles/SB10001424053111903480904576512250915629460) In the Financial Services Industry our competitors counted more than 3000 startups who intend to disrupt the industry. Quote CEO Domestic NL Nick Yue from the Management meeting on : “We are becoming more and more a technology company”. In his speech to 700 managers Nick gave various examples of software companies disrupting existing industries from his own experience. [Quote CEO ING Group Ralph Hamers from his speech on October 30th in ’The Economist’: “The challenge is the digital revolution that is going on (…) banking is in general in the digital domain“; “The main challenge I see, for us and for all other banks, is to become future-proof, that is: to remain fast, agile and innovative enough for the ever changing expectations of our customers.](http://www.ing.com/web/file?uuid=58b72380-01f3-4ddc-8f0a-7c46ade0ae3c&owner=087e41ac-0b7a-424f-9e1a-4740d759e49f) Today, there are 1000’s of startups in Financial Services. Many right here in London. Many in the Netherlands too. All of them are looking at friction in banking or insurance and are finding ways to make life easier for our customers, or cheaper.
- - Kudos Adrian Cockroft (next Speaker) — Example: Netflix (Check if Adrian talks about this, otherwise just do a reference to the next speaker, which is Adrian) — Example: Etsy — Example: Paypal
- This is more profound than it sounds – This is about talent that cannot be outsourced.
- - Existing Enterprises need to reduce a lot of complexity — Legacy way of organising, both structure and skills — Legacy Way of Working (processes), => from manual to simplified and automated — Legacy IT Systems, both applications and infra - Most complicated perhaps: Legacy Belief Systems — From IT is a cost centre to IT is the value driver — From IT enables the business to IT drives the business — From procuring average Engineering Services to hiring the best talent
- If the team has a strategy to always keep DR in sync with production, or, If the team deploys applications in an active / active setting across two datacenters, Then the release candidate can also be pushed to the other production site(s)
- Kudos: Natalino Busa, ING
- JAX-RS: a Java programming language API that provides support in creating web services Hystrix: a latency and fault tolerance library Apache Cassandra: an open source distributed database management system Nginx: a high-performance HTTP server and reverse proxy Apache ZooKeeper: provides a distributed configuration-, synchronization-, and naming registry- service Apache Curator: an API to simplify the usage of Zookeeper Ribbon: a Inter Process Communication library with built in software load balancers Tibco Business Works: components for SolSel as first class citizens of the API platform …
- Ron, Flavia and Lieke are training our
- This is more profound than it sounds – This is about talent that cannot be outsourced.
- This is more profound than it sounds – This is about talent that cannot be outsourced.
- - we are in te middle of a technical revolution that changes organisations, society, and legislation. - we are struggling with the prior social and economic “best practices” while we are learning to create new solutions and a better habitat for enigeers that create value for consumers