SlideShare ist ein Scribd-Unternehmen logo
1 von 26
Downloaden Sie, um offline zu lesen
With TFS and Visual Studio
Angela Dugan
ALM Practice Manager
Polaris Solutions
Angela Dugan
Continuous integrations
Build | Deploy | Test

Testing toolbox

Manual testing
 User testing
 Ad-hoc exploratory testing
 Planned manual testing

Role tailored tools

User
Interface

Automated testing
 Keyword testing
 UI automation testing
 Performance testing

Services
Business Processes
Business Rules and Logic
Service integrations
Data access
Identity

Data

Automated testing
 Unit testing
 Integration testing
 Performance testing
 Load testing
Lab
manager

Lab management
services

Test runners

Diagnostic data
collectors

Test execution
services

Build engines

Pluggable components

Build
services

Lab
environments
Virtualization reduces cost to
provision environments
Modern apps run in diverse
environments
Difficult to repro issues found
Replicating environments for
test is time-consuming, costly

Dramatically reduced hardware
and maintenance expenses

Templates allow a wide range
of baselines to be spun up
quickly and on demand

Improved quality and reliability
of apps across platforms

Snapshots capture states for
reproducing test conditions
and verifying defects

Operations engaged in earlier
phases of testing
On-premise | Cloud
Create and manage virtual or physical environments for
Dev/Test
Take snapshots or revert to existing snapshots for any
virtual machine
Deploy current or any build to environment
Interact with virtual machines through the environment
viewer
Define test settings for environments
Test Controllers and Agents

Test agent controller
manages test agents

Web Server
Test Agent
Test Agent
Controller

Collect Intellitrace
Information

Client

Test Agent
Run Tests

Test Agent

Test Agent
Run Tests
Collect Test Impact
Data

Team
Foundation
Server

Collect System
Information

Network Emulation

Client

Register with Team
Project Collection

Database Server

Where to
run Tests?

Collect
Data?

Test agents run tests and collect
data or impact the system

Affect
Machine
Installed on the “client” machines
Three types of agents
Test Agent-Enables automated testing
Build Agent-Enables automated
deployment
Lab Agent-Enables network isolation

Install from the Lab Management
or TFS media
Can be installed/maintained using
the VMPrepTool
Create new multi-machine
environment choices
Create a new
environment using virtual
machine templates in
SCVMM

Create new
environments on
existing machines

Create an
environment using
machines running on
SCVMM
Quickly choose multiple
test suites to run after
deployment

Choose your environment,
and build, deploy and test in
that environment from a
single dialog
Spin up virtual test environments
from within Test Manager, or attach a
virtual environment to a manual
testing session

Snapshot environments
during manual testing to
increase reproducibility
Thumbnail view of each
machine in the environment
Developers can quickly debug
issues on the exact same
testing environment

Environment snapshot
taken and attached as a
link with bug
Test run results are attached to
specific builds and environments

Collect all the data required
to recreate bugs from virtual
environments
SCVMM Environment
Build-Deploy-Test
Snapshot / Restore
Share Bug Snapshots

Network Fencing
3rd Party Virtualization
Physical Machines

Standard Environment
Lab Management is included with Visual Studio Premium/Test
Pro
SCVMM license for dev/test is included

MSDN
Headless Hyper-V as the host OS
Guest OS license is part of MSDN subscription
Each person accessing the Virtual Machine Host (or accessing
a virtual machine on that host) must have an MSDN
subscription
ULTIMATE
Premium
Professional

Office
Web Access
SharePoint
Team Explorer
Everywhere

Test
Professional
Creating VMs
Create and store VMs - MSDN doc
Prepare a domain controller VM

Manage virtual environments
Creating virtual envs - MSDN doc
Creating and working with virtual envs
Concepts and guidelines
Creating network isolated environments

Networking
Networking basics
Network isolation
Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling
the test traffic in and out of Corp network
Network load balancer
Firewall rules

Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based
library and host
SAN support

Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual
environment
Setting up rules in Threat Management Gateway

Deployment and testing on a shared machine outside the envt

Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different
domain
DNS conditional forwarding
Microsoft Testing Tour - Setting up a Test Environment

Weitere ähnliche Inhalte

Was ist angesagt?

Top Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingTop Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingKanoah
 
Regression and performance testing
Regression and performance testingRegression and performance testing
Regression and performance testingHimanshu
 
Test Case Prioritization Techniques
Test Case Prioritization TechniquesTest Case Prioritization Techniques
Test Case Prioritization TechniquesKanoah
 
What is Ad-Hoc Testing
What is Ad-Hoc TestingWhat is Ad-Hoc Testing
What is Ad-Hoc TestingExforsys Inc
 
Importance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectImportance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectSarah Elson
 
Risk based regression testing approach
Risk based regression testing approachRisk based regression testing approach
Risk based regression testing approachAsim Ali
 
Smoke Testing
Smoke TestingSmoke Testing
Smoke TestingKanoah
 
Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Subrahmaniam S.R.V
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewSuhas Patil
 
Regression testing
Regression testingRegression testing
Regression testingHarsh verma
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testingpooja deshmukh
 
Defect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarDefect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarXBOSoft
 
Benefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsBenefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsKovair
 
Performance Testing
Performance TestingPerformance Testing
Performance TestingSelin Gungor
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testingToshi Patel
 
T19 performance testing effort - estimation or guesstimation revised
T19   performance testing effort - estimation or guesstimation revisedT19   performance testing effort - estimation or guesstimation revised
T19 performance testing effort - estimation or guesstimation revisedTEST Huddle
 
ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0Samer Desouky
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2Yogindernath Gupta
 

Was ist angesagt? (20)

Top Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingTop Chrome Extensions for Software Testing
Top Chrome Extensions for Software Testing
 
Regression and performance testing
Regression and performance testingRegression and performance testing
Regression and performance testing
 
Test Case Prioritization Techniques
Test Case Prioritization TechniquesTest Case Prioritization Techniques
Test Case Prioritization Techniques
 
What is Ad-Hoc Testing
What is Ad-Hoc TestingWhat is Ad-Hoc Testing
What is Ad-Hoc Testing
 
Importance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectImportance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your Project
 
Risk based regression testing approach
Risk based regression testing approachRisk based regression testing approach
Risk based regression testing approach
 
Smoke Testing
Smoke TestingSmoke Testing
Smoke Testing
 
Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager Overview
 
Regression testing
Regression testingRegression testing
Regression testing
 
Performance Testing - Keytorc Approach
Performance Testing - Keytorc ApproachPerformance Testing - Keytorc Approach
Performance Testing - Keytorc Approach
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
 
Defect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarDefect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft Webinar
 
Benefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsBenefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management Tools
 
Getting Ready for UAT
Getting Ready for UATGetting Ready for UAT
Getting Ready for UAT
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testing
 
T19 performance testing effort - estimation or guesstimation revised
T19   performance testing effort - estimation or guesstimation revisedT19   performance testing effort - estimation or guesstimation revised
T19 performance testing effort - estimation or guesstimation revised
 
ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
 

Andere mochten auch

Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & OptimizationAmbareesh Kulkarni
 
Dev/Test in the Cloud - F
Dev/Test in the Cloud - FDev/Test in the Cloud - F
Dev/Test in the Cloud - FChris Riley ☁
 
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...VMworld
 
Why You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudWhy You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudRightScale
 
Heterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestHeterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestQualiQuali
 
Dev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudDev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudAmazon Web Services
 
Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Koushik Arvapally
 
Big data architectures and the data lake
Big data architectures and the data lakeBig data architectures and the data lake
Big data architectures and the data lakeJames Serra
 

Andere mochten auch (10)

Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & Optimization
 
Dev/Test in the Cloud - F
Dev/Test in the Cloud - FDev/Test in the Cloud - F
Dev/Test in the Cloud - F
 
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
 
Why You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudWhy You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the Cloud
 
Heterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestHeterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/Test
 
Enterprise Dev and Test on AWS
Enterprise Dev and Test on AWSEnterprise Dev and Test on AWS
Enterprise Dev and Test on AWS
 
Dev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudDev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the Cloud
 
Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Oracle application testing suite (OATS)
Oracle application testing suite (OATS)
 
Test & Dev on the AWS Cloud
Test & Dev on the AWS CloudTest & Dev on the AWS Cloud
Test & Dev on the AWS Cloud
 
Big data architectures and the data lake
Big data architectures and the data lakeBig data architectures and the data lake
Big data architectures and the data lake
 

Ähnlich wie Microsoft Testing Tour - Setting up a Test Environment

Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFSChris Kadel, MBA
 
qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementsunil singh
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementRofiqi Setiawan
 
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S... Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...Skytap Cloud
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and executionClemens Reijnen
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release ManagementMicrosoft Switzerland (DX)
 
No More No Repro
No More No ReproNo More No Repro
No More No ReproAnna Russo
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementMicrosoft Developer Norway
 
Anatomy of a Build Pipeline
Anatomy of a Build PipelineAnatomy of a Build Pipeline
Anatomy of a Build PipelineSamuel Brown
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...DevDay.org
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ MicrosoftRobert MacLean
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingAngela Dugan
 
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!ThoughtWorks
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughAngela Dugan
 
Automated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS SitesAutomated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS Sitesjoelabrahamsson
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio OnlineVitor Tomaz
 
Dev ops developer (session 3)
Dev ops developer (session 3)Dev ops developer (session 3)
Dev ops developer (session 3)MSDEVMTL
 
Selenium Framework for Testing Web Application - Mindtree
Selenium Framework for Testing Web Application - MindtreeSelenium Framework for Testing Web Application - Mindtree
Selenium Framework for Testing Web Application - Mindtreesamirandev1
 

Ähnlich wie Microsoft Testing Tour - Setting up a Test Environment (20)

Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFS
 
qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagement
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab Management
 
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S... Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management
 
No More No Repro
No More No ReproNo More No Repro
No More No Repro
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
 
Anatomy of a Build Pipeline
Anatomy of a Build PipelineAnatomy of a Build Pipeline
Anatomy of a Build Pipeline
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ Microsoft
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated Testing
 
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
Automated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS SitesAutomated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS Sites
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
 
Test automation
Test automationTest automation
Test automation
 
Dev ops developer (session 3)
Dev ops developer (session 3)Dev ops developer (session 3)
Dev ops developer (session 3)
 
Selenium Framework for Testing Web Application - Mindtree
Selenium Framework for Testing Web Application - MindtreeSelenium Framework for Testing Web Application - Mindtree
Selenium Framework for Testing Web Application - Mindtree
 

Mehr von Angela Dugan

VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsVSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsAngela Dugan
 
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfVSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfAngela Dugan
 
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfVS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfAngela Dugan
 
Adaptability Quotient - DevUp 2022.pdf
Adaptability Quotient  - DevUp 2022.pdfAdaptability Quotient  - DevUp 2022.pdf
Adaptability Quotient - DevUp 2022.pdfAngela Dugan
 
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfMeasuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfAngela Dugan
 
Measuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfMeasuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfAngela Dugan
 
VS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsVS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsAngela Dugan
 
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021   VST09 agile team metrics Fast Focus - angela duganVS Live 2021   VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021 VST09 agile team metrics Fast Focus - angela duganAngela Dugan
 
THAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameTHAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameAngela Dugan
 
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAPLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAngela Dugan
 
Agile midwest 2019 tap, tap, tap communication
Agile midwest 2019   tap, tap, tap communicationAgile midwest 2019   tap, tap, tap communication
Agile midwest 2019 tap, tap, tap communicationAngela Dugan
 
That conference tap, tap, tap communication
That conference tap, tap, tap communicationThat conference tap, tap, tap communication
That conference tap, tap, tap communicationAngela Dugan
 
Agile days chicago 2018 - how do you measure up?
Agile days chicago 2018 -  how do you measure up?Agile days chicago 2018 -  how do you measure up?
Agile days chicago 2018 - how do you measure up?Angela Dugan
 
VS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upVS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upAngela Dugan
 
Chicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsChicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsAngela Dugan
 
APLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAPLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAngela Dugan
 
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckDev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckAngela Dugan
 
Dev up 2017 - how do you measure up
Dev up 2017 - how do you measure upDev up 2017 - how do you measure up
Dev up 2017 - how do you measure upAngela Dugan
 
That conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckThat conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckAngela Dugan
 
Chicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterChicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterAngela Dugan
 

Mehr von Angela Dugan (20)

VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsVSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
 
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfVSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
 
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfVS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
 
Adaptability Quotient - DevUp 2022.pdf
Adaptability Quotient  - DevUp 2022.pdfAdaptability Quotient  - DevUp 2022.pdf
Adaptability Quotient - DevUp 2022.pdf
 
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfMeasuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
 
Measuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfMeasuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdf
 
VS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsVS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skills
 
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021   VST09 agile team metrics Fast Focus - angela duganVS Live 2021   VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
 
THAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameTHAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback Game
 
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAPLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
 
Agile midwest 2019 tap, tap, tap communication
Agile midwest 2019   tap, tap, tap communicationAgile midwest 2019   tap, tap, tap communication
Agile midwest 2019 tap, tap, tap communication
 
That conference tap, tap, tap communication
That conference tap, tap, tap communicationThat conference tap, tap, tap communication
That conference tap, tap, tap communication
 
Agile days chicago 2018 - how do you measure up?
Agile days chicago 2018 -  how do you measure up?Agile days chicago 2018 -  how do you measure up?
Agile days chicago 2018 - how do you measure up?
 
VS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upVS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure up
 
Chicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsChicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teams
 
APLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAPLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuck
 
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckDev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
 
Dev up 2017 - how do you measure up
Dev up 2017 - how do you measure upDev up 2017 - how do you measure up
Dev up 2017 - how do you measure up
 
That conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckThat conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team Unstuck
 
Chicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterChicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matter
 

Kürzlich hochgeladen

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 

Kürzlich hochgeladen (20)

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 

Microsoft Testing Tour - Setting up a Test Environment

  • 1. With TFS and Visual Studio Angela Dugan ALM Practice Manager Polaris Solutions
  • 3. Continuous integrations Build | Deploy | Test Testing toolbox Manual testing  User testing  Ad-hoc exploratory testing  Planned manual testing Role tailored tools User Interface Automated testing  Keyword testing  UI automation testing  Performance testing Services Business Processes Business Rules and Logic Service integrations Data access Identity Data Automated testing  Unit testing  Integration testing  Performance testing  Load testing
  • 4. Lab manager Lab management services Test runners Diagnostic data collectors Test execution services Build engines Pluggable components Build services Lab environments
  • 5. Virtualization reduces cost to provision environments Modern apps run in diverse environments Difficult to repro issues found Replicating environments for test is time-consuming, costly Dramatically reduced hardware and maintenance expenses Templates allow a wide range of baselines to be spun up quickly and on demand Improved quality and reliability of apps across platforms Snapshots capture states for reproducing test conditions and verifying defects Operations engaged in earlier phases of testing
  • 7. Create and manage virtual or physical environments for Dev/Test Take snapshots or revert to existing snapshots for any virtual machine Deploy current or any build to environment Interact with virtual machines through the environment viewer Define test settings for environments
  • 8.
  • 9. Test Controllers and Agents Test agent controller manages test agents Web Server Test Agent Test Agent Controller Collect Intellitrace Information Client Test Agent Run Tests Test Agent Test Agent Run Tests Collect Test Impact Data Team Foundation Server Collect System Information Network Emulation Client Register with Team Project Collection Database Server Where to run Tests? Collect Data? Test agents run tests and collect data or impact the system Affect Machine
  • 10. Installed on the “client” machines Three types of agents Test Agent-Enables automated testing Build Agent-Enables automated deployment Lab Agent-Enables network isolation Install from the Lab Management or TFS media Can be installed/maintained using the VMPrepTool
  • 12. Create a new environment using virtual machine templates in SCVMM Create new environments on existing machines Create an environment using machines running on SCVMM
  • 13. Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog
  • 14. Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session Snapshot environments during manual testing to increase reproducibility
  • 15. Thumbnail view of each machine in the environment
  • 16. Developers can quickly debug issues on the exact same testing environment Environment snapshot taken and attached as a link with bug
  • 17. Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments
  • 18.
  • 19.
  • 20. SCVMM Environment Build-Deploy-Test Snapshot / Restore Share Bug Snapshots Network Fencing 3rd Party Virtualization Physical Machines Standard Environment
  • 21. Lab Management is included with Visual Studio Premium/Test Pro SCVMM license for dev/test is included MSDN Headless Hyper-V as the host OS Guest OS license is part of MSDN subscription Each person accessing the Virtual Machine Host (or accessing a virtual machine on that host) must have an MSDN subscription
  • 23.
  • 24. Creating VMs Create and store VMs - MSDN doc Prepare a domain controller VM Manage virtual environments Creating virtual envs - MSDN doc Creating and working with virtual envs Concepts and guidelines Creating network isolated environments Networking Networking basics Network isolation
  • 25. Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling the test traffic in and out of Corp network Network load balancer Firewall rules Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based library and host SAN support Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual environment Setting up rules in Threat Management Gateway Deployment and testing on a shared machine outside the envt Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different domain DNS conditional forwarding