Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care

•

1 gefällt mir•1,031 views

In this engaging experience report, we will present 3 different views – Developer, Tester, Business Analyst – of implementing Acceptance Test Driven Development in a complex, data-driven domain. Hear how we used ATDD for building a ubiquitous language across the entire team, promoting faster feedback, and cultivating a culture where product owners were deeply invested in the quality of both every deliverable and the system as a whole.

Technologie Bildung

JEFFREY DAVIDSON consulting business analyst
ThoughtWorks.
jeffrey.davidson@thoughtworks.com
@JeffreyGoodReq
goodrequirements.com
www.thoughtworks.com
®
LAV PATHAK software engineer
ThoughtWorks.
lav.pathak@thoughtworks.com@lav_pathak
www.thoughtworks.com
®
SAM HOTOP senior test engineer
ThoughtWorks.
shotop@thoughtworks.com
samueljameshotop.blogspot.com
www.thoughtworks.com
®

Unit (1600)
Acceptance
(1250)
UI (100)
~2950
Total Tests

Build Times – Full Suite
16 mins: Pairing stations
35 mins: Unit & Acceptance / CI box
15 mins: UI Tests on CI box

When a
Bug is
found
Bug
conﬁrmed
QA pairing
with BA/PO!
Test(s) written &
ignored
Dev pair refactors
Acceptance
Test(s) Pass
Bug
Killed

Using ATDD to Build
Customers that Care
Jeffrey Davidson
Lav Pathak
Sam Hotop
Skills Matter
Agile Testing & BDD eXchange
NYC 2013

Weitere ähnliche Inhalte

Was ist angesagt?

Bamboo - an introduction

Sven Peters

A Second Look at Unit Testing by Roy Osherove

Roy Osherove

Drupalcamp Simpletest

lyricnz

Agile2013 - Integration testing in enterprises using TaaS - via Case Study

Anand Bagmar

Having one application to support is easy enough, but what if you have a CMS, an API, a design tool, and a core library that each other tool also needs to consume? Where do you even begin juggling the release management and cycle of so many interconnected and interdependent packages? Learn how a small team manages a large CMS project and utilizes real-world best practices of Git, CI/CD, and old fashion planning to bring a solid platform to thousands of editors and millions of viewers.

Composer at Scale, Release and Dependency Management

Joe Ferguson

Have you ever wondered what the best way would be to test emails? Or how you would go about testing a messaging queue? Making sure your components are correctly interacting with each other is both a tester and developer’s concern. Join us to get a better understanding of what you should test and how, both manually and automated. This session is the first ever in which we will have two units working together to give you a nuanced insight on all aspects of integration testing. We’ll start off exploring the world of integration testing, defining the terminology, and creating a general understanding of what phases and kinds of testing exist. Later on we’ll delve into integration test automation, ranging from database integration testing to selenium UI testing and even as far as LDAP integration testing. We have a wide variety of demos prepared where we will show you how easy it is to test various components of your infrastructure. Some examples: - Database testing (JPA) - Arquillian, exploring container testing, EJB testing and more - Email testing - SOAP testing using SoapUI - LDAP testing - JMS testing

Integration testing - A&BP CC

JWORKS powered by Ordina

It is easy to measure code coverage when running unit tests. However, very frequently the following questions come up: - How can we measure API test coverage and e2e / UI test coverage? - Does e2e / UI test coverage add value? - If not, what other data can we look at to know if the e2e tests have good coverage? This session is about understanding the above questions, and finding solutions for the same.

Measuring Coverage From E2E Tests

Anand Bagmar

What does it mean to 'do' Continuous Integration? It used to be enough to execute your unit tests in CI. But the bar is steadily raising for engineering practices. In the last decade we've seen tremendous improvements inacceptance testing. JavaScript is now a platform in it's own right. Cloudcomputing is now vital. There's growing interest in deployment to prod.So Continuous Integration is under more pressure than ever. As the bar slowly raises for engineering practices, we ll present 2011's minimum viable feature set for Continuous Integration

Continuous Integration, the minimum viable product

Julian Simpson

Since its beginning, the Performance Advisory Council aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing. During this event, 12 participants convened in Chamonix (France) exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.

Jonathon Wright - Intelligent Performance Cognitive Learning (AIOps)

Neotys_Partner

Ever kill a bug only to have it resurface later? How about that last intermittent bug you had to trace down? Looking forward to fixing it again when it pops back up? If you hate reanimated bugs then this session is for you. In this session, we will discuss the why and the how of building regression testing into your tests using the Codeception testing framework. Join me, let's hunt some zombie bugs. (Weapons not required)

Put an end to regression with codeception testing

Joe Ferguson

https://confengine.com/agile-india-2020/proposal/11065/visual-validation-the-missing-tip-of-the-automation-pyramid The top of the pyramid is our UI / end-2-end functional tests - which simulate end-user behavior and interactions with the product-under test. While Automation helps validate functionality of your product, aspects of UX validations can only be seen and captured by the human eye and is hence mostly a manual activity. This is an area where AI & ML can truly help. With everyone wanting to be Agile, make quick releases, the look & feel / UX validation, which is a slow, and error-prone activity, quickly becomes a huge bottleneck. In addition, with any UX related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling and worse - dilute your user-base. In this session, using numerous examples, we will explore: Why Automated Visual Validation is essential to be part of your Test Strategy Potential solutions / options for Automated Visual Testing, with pros & cons of each How an AI-powered tool, Applitools Eyes, can solve this problem.

Visual Validation - The missing tip of the automation pyramid @AgileIndia2020

Anand Bagmar

Show me the money!

Tomas Riha

Eradicate Flaky Tests - AppiumConf 2021

Anand Bagmar

We all know that automation is one of the key enablers for those on the CI-CD journey. Most teams are: • implementing automation • talking about its benefits • up-skilling themselves • talking about tooling • etc. In my experience, unfortunately most of the functional automation that is built is: • not optimal • not fit-for-purpose • does not run fast enough • gives inconsistent feedback, hence unreliable Hence, for the amount of effort invested in implementing automation, are you really getting the value from this activity? In this talk, we will discuss these challenges and why it would lead to poor ROI of automation. More importantly, we will discuss the following techniques to make automation valuable: • know the objective for the automation framework • establish criteria for tests to be automated • design your framework with proper abstraction layers • develop using appropriate design patterns

Does your functional automation really add value?

Anand Bagmar

We are used to people trying to sell us how awesome Continuous Delivery is, but with little examples. In this talk, I will show you parts of the pipeline our team has been implementing. Our objective is very simple: how to go from a commit to production without humans in the middle; but making sure that software goes through the proper functional and performance testing. I will discuss with you some of the biggest challenges we have found along the way.

Continuous Delivery-a practical case by Juan Jose Del Rio

J On The Beach

Test

Eddie Kao

This talk is a brief overview of how we deal with UI test architecture on our project. Complex backend, SPA as a frontend, 20+ different brands and 100+ features for each, more and more code. We will discuss: – fakes and test doubles, approaches how to build and maintain them; – development patterns, which help you to make your architecture more simple, stable and readable; – tips and tricks – how to make your life with UI tests easier.

An easy way to automate complex UI

Ivan Pashko

Мы уже разговаривали о self-healing автоматизации, как она работает, какие есть подходы, чем они хороши, плохи и о новом инструменте, который мы разрабатываем в EPAM. Наш продукт завершает стадию POC и настало время поделиться результатами и понять, насколько self-healing автоматизация поможет вашим тестам стать стабильнее? Или наоборот, навредит?... Приходи и узнаешь!

QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future

QAFest

Are you also having same question as that of John ? John : I am clueless how do i get started with performance testing ? John : What do I need to know about web application before getting started ? John : What are the tools that can help me understand my application ? John : How do performance testing tool work ? John : How do I choose a right tool for performance testing ? John : How do i come up with various scenarios ? Well then you are at right place .

Performance testing ( Approaching , Designing performance tests)

Abhijeet Patil

DevOps is a large part of a company of any size. In the 9+ years that I have been a professional developer I have always taken an interest in DevOps and have been the "server person" for most of the teams I have been a part of. I would like to teach others how easy it is to implement modern tools to make their everyday development and development processes better. I will cover a range of topics from "Stop using WAMP/MAMP and start using Vagrant", "version control isn't renaming files", "Automate common tasks with shell scripts / command line PHP apps" and "From Vagrant to Production".

Midwest PHP 2017 DevOps For Small team

Joe Ferguson

Was ist angesagt? (20)

Bamboo - an introduction

A Second Look at Unit Testing by Roy Osherove

Drupalcamp Simpletest

Agile2013 - Integration testing in enterprises using TaaS - via Case Study

Composer at Scale, Release and Dependency Management

Integration testing - A&BP CC

Measuring Coverage From E2E Tests

Continuous Integration, the minimum viable product

Jonathon Wright - Intelligent Performance Cognitive Learning (AIOps)

Put an end to regression with codeception testing

Visual Validation - The missing tip of the automation pyramid @AgileIndia2020

Show me the money!

Eradicate Flaky Tests - AppiumConf 2021

Does your functional automation really add value?

Continuous Delivery-a practical case by Juan Jose Del Rio

Test

An easy way to automate complex UI

QA Fest 2019. Анна Чернышова. Self-healing test automation 2.0. The Future

Performance testing ( Approaching , Designing performance tests)

Midwest PHP 2017 DevOps For Small team

Andere mochten auch

ATDD with Behat and Selenium (LDNSE6)

Shashikant Jagtap

IT Brunch - SpecFlow and Gherkin by Example

Dmytro Mindra

ATDD with SpecFlow

Arnon Axelrod

Introduction to ATDD with Cucumber and RSpec

Kenta Murata

ATDD in Practice

Steven Mak

Slides from presentation at the Chicago Quality Assurance Association, February 25, 2014. Acceptance Test Driven Development (ATDD) and Behavior Driven Development (BDD) are well-established Agile practices that rely on the knowledge and intuition of testers, product owners, and developers to identify and then translate statements into test suites. But the resulting test suites often cover only a small slice of happy-path behavior. And, as a BDD specification and its associated test code base grows over time, work to maintain it either crowds out new development and testing or, typically, is simply ignored. Either is high-risk. That’s how Agile teams get eaten by the testing BackBlob.Model Based Testing is a tool-based approach to automate the creation of test cases. This presentation will outline the techniques and benefits of MBT, and show how model-based testing can address both problems. A detailed demo of Spec Explorer, a free model-based testing tool shows how a model is constructed and used to create and maintain a test suite.

Model-based Testing: Taking BDD/ATDD to the Next Level

Bob Binder

Unit Testing, TDD and ATDD

Arnon Axelrod

Andere mochten auch (7)

ATDD with Behat and Selenium (LDNSE6)

IT Brunch - SpecFlow and Gherkin by Example

ATDD with SpecFlow

Introduction to ATDD with Cucumber and RSpec

ATDD in Practice

Model-based Testing: Taking BDD/ATDD to the Next Level

Unit Testing, TDD and ATDD

Ähnlich wie Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care

Stop Being Lazy and Test Your Software

Laura Frank Tacho

Asad Faruqui and Moni Mau say that their old regression automation used to take three-to-four days of execution time as they ran against different browser versions, locales, and currencies. They wanted to make the automation framework more efficient so features could go to market faster. Symantec explored Selenium Grid which could reduce the run time by offering some parallelism, but Asad and Moni wanted even more efficiency. They explain how they created both a framework in which they write modular test classes and an engine that can read test cases from a test repository (XML, database, or XLS sheet) and distribute the execution of these tests on virtualized images based on user requirements. If they don't have enough virtual machines, this creates a queue of outstanding jobs. The engine keeps track of results from execution of these classes, reports to the user when complete, and provides substantial error handling. Asad and Moni present this framework so you can learn from their approach and apply this framework to shorten execution times on regression automation.

Turbocharge Your Automation Framework to Shorten Regression Execution Time

Josiah Renaudin

This presentation on Continuous Delivery is from the November 2013 Automated Testing San Francisco meetup that took place at Constant Contact. The author/presenter is Matt Wilson, CTO of Lab Zero. Matt has advised clients at various industries including consumer brands, non-profits, start-ups, and financial services on Agile development, web application development, and other technology leadership challenges. This overview on Continuous Delivery highlights some of the best practices that Lab Zero has distilled, based on their many client engagements. --- About Matt Wilson: Matt is an enthused agile developer, architect, and consultant. He enjoys building elegant web services in Ruby. He believes that high-fives are underrated and measures the success of his day by how many he's seen. Prior to joining Lab Zero, Matt's work history includes: Co-founder/Architect at Earfl.com, Architect at Kodak Gallery, Developer at Westwave Communications, Engineer at Motorola, and Developer at Coldwell Banker. About Lab Zero: Lab Zero Innovations, Inc. provides web application development and technology leadership consulting. Our client relationships include staff augmentation, pure software development, project management, system integration, advisor/leadership roles. Contact us about your next project.

Don't hate, automate. lessons learned from implementing continuous delivery

Solano Labs

Enterprise Workflows When You Aren't Enterprise

Chris Tankersley

Presented by Laura Frank, Engineer, Codeship Testing software is necessary, no matter the size or status of your company. Introducing Docker to your development workflow can help you write and run your testing frameworks more efficiently, so that you can always deliver your best product to your customers and there are no excuses for not writing tests anymore. You’ll walk away from this talk with practical advice for using Docker to run your test frameworks more efficiently, as well as some solid knowledge of software testing principles.

DockerCon EU 2015: Stop Being Lazy and Test Your Software!

Docker, Inc.

Unit Testing like a Pro - The Circle of Purity

Victor Rentea

Do you ❤️ Mocks? When you write your first unit tests, especially on older codebases, mocking foreign code is key to survival. But as you grow older in the craft, you start piling up hours and days wasted to refactor fragile tests or to fix bugs that those heavy mock-based tests didn't catch. And so you start looking at Mocks differently. Let's go through the key factors to consider to strike the optimal balance between what needs to be mocked away and what code should be tested in integration. There's sometimes a fine line there, often interwoven with strong emotions: "Why am I testing this?" "Argh… these tests take too long" "Can this ever really break?" etc... Among the points that we'll touch on: - Mocks vs Refactoring - Mocks vs Reliability - Fine vs Coarse Mocks - Reproducibility - Partial Mocks - Mocking Statics - Alternatives to Mocks Speakers: Victor Rentea Victor is a Java Champion and Independent Trainer with an impressive experience: thousands of developers in dozens of companies trained in dedicated company sessions. He is the founder of one of the largest developer communities in Romania, Bucharest Software Craftsmanship Community and a top international conference speaker. To find more about him, join a live masterclass or call him in for a company dedicated training: victorrentea.ro

Don't Be Mocked by your Mocks - Best Practices using Mocks

Victor Rentea

AWS Lambda has changed the way we deploy and run software, but this new serverless paradigm has created new challenges to old problems - how do you test a cloud-hosted function locally? How do you monitor them? What about logging and config management? And how do we start migrating from existing architectures? In this talk Yan and Scott will discuss solutions to these challenges by drawing from real-world experience running Lambda in production and migrating from an existing monolithic architecture.

Serverless in production, an experience report (CoDe-Conf)

Yan Cui

DevOps in an Embedded World

Sajeewa Dayaratne

Unit tests & TDD

Dror Helper

Agile Software Development in Practice - A Developer Perspective

Wee Witthawaskul

Keynote AST 2016

Kim Herzig

Serverless in production, an experience report (Going Serverless)

Yan Cui

Slides of the Talk I gave at Devoxx Belgium 2019. === Abstract === Focusing on the creative work without being terrified of breaking the existing behavior can make software development very addictive! Good automated tests can buy you that! However, if your tests are not maintainable they may end up slowing you down and causing you painful headaches, compilation errors and spurious failures. To avoid that, your unit tests should be significant; expressive; clean; DRY; non-overlapping; and blazing fast. Writing good tests becomes the toughest challenge for any developer, no matter how battle-hardened: you need to balance risk with test maintenance costs, while looking out for test design smells that call for [risky] refactoring to drive your design towards a set of key principles (included:). Principles that will end up shaping the way you craft the Production code itself. Because in the end, a good, clean design is more important than coverage%. But testing gives you the best feedback to get there. Grab a black coffee and join this snippet from Victor’s Pro Unit Testing #training, to learn about testing priorities, buggy tests, the shared @Before, Mocks vs Stubs and how to reduce them by "purifying" your logic, testing Legacy Code and refactoring @Spy-es out. All of that in an entertaining, dynamic and memorable session.

The Art of Unit Testing - Towards a Testable Design

Victor Rentea

Serverless in production, an experience report (FullStack 2018)

Yan Cui

UI Testing

Josh Black

Serverless in production, an experience report (JeffConf)

Yan Cui

Compare squish tool vs telerik tool

Hoa Le

Automate test, tools, advantages, and disadvantages

Majid Hosseini

XP Injection

Mikalai Alimenkou

Ähnlich wie Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care (20)

Stop Being Lazy and Test Your Software

Turbocharge Your Automation Framework to Shorten Regression Execution Time

Don't hate, automate. lessons learned from implementing continuous delivery

Enterprise Workflows When You Aren't Enterprise

DockerCon EU 2015: Stop Being Lazy and Test Your Software!

Unit Testing like a Pro - The Circle of Purity

Don't Be Mocked by your Mocks - Best Practices using Mocks

Serverless in production, an experience report (CoDe-Conf)

DevOps in an Embedded World

Unit tests & TDD

Agile Software Development in Practice - A Developer Perspective

Keynote AST 2016

Serverless in production, an experience report (Going Serverless)

The Art of Unit Testing - Towards a Testable Design

Serverless in production, an experience report (FullStack 2018)

UI Testing

Serverless in production, an experience report (JeffConf)

Compare squish tool vs telerik tool

Automate test, tools, advantages, and disadvantages

XP Injection

Mehr von Skills Matter

This talk will look at 5 things Cucumber’s bad at, why that’s a good thing, and what it tells us about Cucumber’s sweet spot in a team’s toolkit. Many times, when people complain about something Cucumber’s not good at, they’re unwittingly describing something Cucumber shouldn't be good at. They’re revealing that they don’t quite understand BDD and Cucumber’s role in it. Cucumber is the world's most misunderstood collaboration tool and people need to hear this over and over again.

5 things cucumber is bad at by Richard Lawrence

Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (7)

Ähnlich wie Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care

Ähnlich wie Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care (20)

Mehr von Skills Matter

Mehr von Skills Matter (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Agile testing & bdd e xchange nyc 2013 jeffrey davidson & lav pathak & sam hotop on using atdd to build customers that care