How Atlassian is Planning for the Future - Ben Center, Atlassian NYC With over 130,000 customers, Atlassian has had to be laser-focused on the ever-changing landscape of software development, IT, and team collaboration. Acquisitions, partnerships, and product innovations have allowed Atlassian to continue supporting teams around the world. Learn about how the company is thinking about some of the challenges facing teams today, and what we have in store for the coming year. A Round Up of Third Party Testing Apps - Miles Faulkner, Blended Perspectives As a core tool for software development teams, Jira provides a platform for enabling and integrating testing functions as part of the SDLC. Miles Faulkner, Co-CEO of Blended Perspectives, will provide an analysis of three Jira testing apps (marketplace) to understand how they address the secret sauce of testing – how teams together identify problems and fix them quickly.

1. BEN CENTER | ENTERPRISE ADVOCATE | ATLASSIAN
How Atlassian is Planning
for the Future

3. FPO
QUICK SHOW
!"#$OF

4. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

5. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

6. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

7. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

8. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

9. Agenda
What we’ve been up to
This year’s focus
How we plan for the future
Cloud
Server/Data Center
Q&A

10. WHAT WE’VE
BEEN UP TO
ACQUISITIONS, JIRA 8.0, AND MORE

11. Opsgenie
Powerful alerting and on-call
management
Butler for Trello
Automate your workflow
Acquisitions

12. AfterBefore

13. JIRA
SOFTWARE
8.0

14. HOW ATLASSIAN
PLANS FOR THE
FUTURE

15. FPO
QUICK SHOW
!"#$OF

16. JRASERVER-9239
Kanban backlog
JRASERVER-1232
Priorities per project
JRASERVER-9688
Sprint deletion
JRASERVER-1749
Split issue
JRASERVER-3772
Drag & drop
sub-tasks
JSDSERVER-5834
Canned responses
JSDSERVER-3692
Collaborator
comments
JSDSERVER-3668
Automated
approvals
PTFOLIO-6628
Programs
PTFOLIO-1548
Parallel sprints
PTFOLIO-7905
Dependency report
CNFLSERVER-0991
Smart mentions
CNFLSERVER-3571
Mobile
CNFLSERVER-7060
Collaborative
editing
BBSERVER-4681
Delete Pull
Requests
BBSERVER-2291
Personal tokens
BBSERVER-2291
Webhooks
BMBOSERVER-6303
Bamboo Specs
BMBOSERVER-3325
Artifact handlers
BMBOSERVER-9701
Multiple repository
branching
JRASERVER-7346
Rename closed
sprint
JSDSERVER-5580
Advanced approvals
CNFLSERVER-3108
Email threading
BBSERVER-4334
Search
improvements

17. NOT CONSIDERED
5
RESOLVED – FIXED
16
IN CONSIDERATION
16
WON’T DO
3
TOP 40
JAC SUGGESTIONS

18. THIS YEAR’S
FOCUS

23. CLOUD

24. Atlassian
empowers modern
businesses with
cloud-based tools
and services that
accelerate and
scale the full
potential of every
team’s work.

25. Security-Centric Bias
Security is woven into the fabric
of our products, infrastructure,
and processes - rest assured
that your data is safeguarded.
ATLASSIAN CLOUD

26. Reliable Performance at
Scale
Scale confidently and securely
with products designed for high
performance, high availability.
ATLASSIAN CLOUD

27. Compliance Assurance
Our 3rd party-verified
compliance program adheres to
industry standards and best
practices, helping your company
stay atop of compliance
requirements
ATLASSIAN CLOUD

28. Privacy by Design
Highest bar for personal data
privacy ensures your organization
always meets obligations around
the globe.
ATLASSIAN CLOUD

29. Company-wide visibility, security, and control
across your entire Atlassian Cloud
infrastructure.
Atlassian Access

30. What’s New
in Cloud?
Stay Fast and Nimble
New project experience, redesigned issues, global
navigation
Truth at your fingertips
New Jira roadmaps, real-time dev status, more
integrations
Jira Mobile Updated
Cleaner interface, improved functionality

31. What’s New
in Cloud?
Revamped help center
Deliver effortless self-service for your customers.
Asset management
Gain complete control over all your assets with
the tools you already use.
Mobile app for your agents
Stay connected with your team’s activities and
deliver service on the go.

32. Fabric Editor
Cleaner interface, easier to find features, updated look
and layout, improved stability & reliability
New Default Templates
Create and collaborate over content quicker & easier
Slack Integration
Get notifications, view link previews, and reply to
comments/like pages directly in Slack
What’s New
in Cloud?
Collaborators as Page Authors
Credit all collaborators!

33. Security Privacy Reliability
# SSO/SAML (Access)
# 2FA (Access)
# SCIM (Access)
# Encryption in Transit
Today
Roadmap
# Audit Logs (Access)
# API Tokens (Access)
# Encryption At Rest
# Org OAuth app
controls
# RTBF management
# DLP Integrations
# EMM Integrations
# GDPR / DPA
# Privacy Shield
# Data Locality (Phase
# 5K scale
# Priority Support
# Storage (Premium)
# SLAs (Premium)

34. Compliance Support
# CSA (STAR Matrix)
# SOC 2 Type II
# ISO 27001
# ISO 27018
# PCI - DSS
Today
Roadmap
# HIPAA
# FedRAMP
# Responsive customer support
(phone, email, chat, et al)
# Technical support and
documentation
# Enterprise support
# Dedicated migration support
# Atlassian security &
implementation guides

35. Try Cloud, Migrate Later
Sign up for an extended trial version of Cloud now
(30 day or 60 days), migrate after trial
Migrate Your Data Now
Go all in for Cloud and we will migrate your data
for you.
Migration
Options

36. Try Cloud, Migrate Later
Sign up for an extended trial version of Cloud now
(30 day or 60 days), migrate after trial
Migrate Your Data Now
Go all in for Cloud and we will migrate your data
for you.
Migration
Options

37. SERVER AND
DATA
CENTER

38. Platform releases present
the opportunity to
modernize Jira for the
future.
WHY A PLATFORM RELEASE?

39. JIRA
SOFTWARE
8.0

40. LUCENE UPGRADE
AGILE BOARD SPEED
BATCHED EMAILS
Jira performance

41. 211234567890123
One email

42. Jira Server
Mobile
NATIVE APP
C
O
M
IN
G
SO
O
N

43. Jira Server
Mobile
NATIVE APP
atlassian.com/jira-server-mobile
C
O
M
IN
G
SO
O
N

44. Other Platform Releases

45. PORTFOLIO FOR JIRA
3.0
JIRA SERVICE DESK
4.0
CONFLUENCE
7.0
BITBUCKET
6.0

46. COMING SOON
IAAS

47. BEN CENTER | ENTERPRISE ADVOCATE | ATLASSIAN
Thank You

48. A Round Up of 3rd Party
Testing Apps
Miles Faulkner
Co CEO

49. • In depth support of business, IT and Service
Desk functions
• Wider range of solutions
• Independent, objective advice to clients (we
don’t build add-ons)
• Only Platinum Partner headquartered in
Canada. Offices in Missouri and Philadelphia
• Servicing North America
• Gold sponsor at Summit 2017

51. What we will cover tonight
1 Road rules and the spirit of the assessment
2 Testing – what’s it all about?
3 Criteria for assessment APEX
4 TM4J
5 X Ray
6 Zephyr
7 Assessment and Detailed head to head
8 Recommendations

52. Please none of this….
• If your product is here its because you’re
really already very successful
• These are of course opinions
• I am not a detailed expert – I may need
to get back to you …
• Please make your own mind up
• There is no perfect answer
• Use this to help you make the right
decision for you

53. Approach – part of a longer journey

54. The Testing World

55. How it all fits together….

56. Example of a test case execution etc
Quick demo here

57. So Many 3rd Party
Apps!

58. Where to
start?
Even in the Testing category there are 100+ apps!!
ADD LINK OR SHOW ON SLIDE….

59. Pick Me!
Number 1
App
Number 1
rated App
Top rated app
in the market
Etc Etc Etc

60. Market Share and growth
• X Ray fastest grower - impressive
• Zephyr flat in the last three months
App
%
growth
Net
increase
Share of
total
X Ray 3403 4208 23.7% 805 22.1%
Zephyr 13413 13454 0.3% 41 65.8%
TM4J 2263 2711 19.8% 448 13.3%
19079 20373
Active licenses on Marketplace as of Jan 5th
Source = Atlassian site on add on shows count of active licenses

61. Testing…

62. TESTING/QA TRIBE

63. Criteria for Assessment
Jira
“Mesh”
Features
Market
Share
Application Excellence Matrix
APEX
(how well
does the
app
leverage
Jira?)

64. Jira Mesh
• 3rd party apps work with Jira
• How much they do for
themselves vs allow Jira to do
“its thing” is a question of
solution architecture
• Issues integrate with
Confluence and BitBam
• Apps which only introduce a
reconfigured issue add little
real value
• Apps that are stand alone lack
the benefits of integration

65. Test Management 4 Jira

66. Adaptavist Web support is “unassuming”

67. TM4J is a more standalone app

68. TM4J Pros and Cons
Pros
• Solid reporting (self-contained within the TM4J app)
• Self-containment within TM4J can simplify configuration and is beneficial to some classes
of users
• The simplified configuration is available at the project level providing more flexibility
• Feature rich offering
Cons
• Test entities/artifacts cannot easily be linked to Jira entities
• Jira filters are not available, nor traditional gadgets or dashboards for testing in Jira
• Third party apps can't be used without specific integrations (no issue types); eg planning
apps, time management, reporting and others
• Scalability is an open question
• Lack of native code and build integrations

69. X-Ray

70. Web Presence Strong and dedicated

71. More complete “mesh” with Jira
All issue types available in Jira Projects

72. Enhanced Traceability

73. XRAY Pros/Cons
Most feature rich Jira server based app for testing
• Fully meshed with Jira
• Very strong test case repository
• Advanced email notifications
• Superior hierarchical traceability
• Excellent integration capabilities
• Excellent documentation that ties testing processes more integrally with the app.
Cons
• Involves a layer of additional configuration management which some
organizations may find "unyieldy“
• For very large instances some scalability concerns

74. Zephyr

75. Zephyr web support

76. More “mesh” with Jira

77. Nice Simple Traceability

78. Zephyr Pros and Cons
Pros
• Has a native importer
• Fastest, easiest app to set up, use and configure
• Test steps can be cloned across issues
• Easy to create new tests or defects
• Generally easy to use and intuitive interface
Cons
• Weak on preconditions for test cases
• Enabled globally rather than at the project level
• Not strong on email notifications
• Importing tests from different tools
• Is expensive when also including Zapi vs X Ray and J4MT
• Folder structure is a new feature and is tied only to test cycles.

79. Pricing

80. Pricing on the cloud
ZephyrX Ray TM4J

81. Thanks Interworks for this analysis !
Category Feature Xray Zephyr TM4J
Project
configuration
Integrates with existing JIRA project Yes Yes Yes
Supports separate JIRA testing project Yes No No
Design Create, edit, delete test cases Yes Yes Yes
Clone test cases Yes Yes Yes
Clone/Copy test steps within test case Yes Yes Yes
Reuse/Copy test steps between test cases Yes Yes Yes
Versioning/History of test cases Yes No Yes
Comments on test cases Yes Yes Yes
Restoring previous version of test case Yes No Yes
Hierarchical/Folder structure for test cases Yes No[1] Yes
Plan Support for Test Plans Yes Yes Yes
Execute Creation of test executions Yes Yes Yes
History of test executions Yes Yes Yes
Support for Test Environments Yes No Yes
Automated Time Tracking for test execution No No Yes
Traceability Linking User Stories with test cases Yes Yes Yes
Linking test cases with bugs Yes Yes Yes
Built-in User Story – test case – bug relationship report Yes Yes Yes
Integration of test artifacts in JIRA Agile board Yes Yes No
Automation[2] Native Support for BDD (Gherkin/Cucumber) Yes No No
Mark Test Case as Automated test Yes No No
Create Test Cases from automated tests results Yes No No
Import test results in Jira from automated test runs Yes
Cucumber
Behave
JUnit
TestNG
Nunit
Robot
No No
Built-in REST API Yes No Yes
CI/CD integration Jenkins add-on Yes No No
Bamboo add-on Yes No No
Customization Customize Test Execution status Yes Yes No
Customize Test Step Execution status Yes Yes No
Customize Test Case workflow Yes Yes?[3] No
Reporting Number of built-in reports 5 4 4
Number of built-in gadgets 6 8 20+
Score 36 23 25
[1] Folder structure
is supported only
for TestCycles
[2] Automation
and CI/CD
integration
features for Zephyr
are supported by
separate JIRA
plugin ZAPI that is
paid separately
from Zephyr. More
info on
ZAPI: https://mark
etplace.atlassian.c
om/apps/1211674
/zapi
[3] It is not well
documented
See source
https://interworks.co
m.mk/comparison-
of-jira-test-
management-
plugins/
Date late 2018

82. Findings APEX
This analysis doesn’t take into account automation – X Ray is
the clear winner in this category

83. Recommendations
• If you are a smaller organization with say less than 100-200 IT staff
and want a simpler application for testing – Zephyr could be a great
choice. Bear in mind that Zephyr is the most expensive app however.
• If you are a larger organization and testing is fairly
“compartmentalized” and you want less Jira administration and don’t
need integrations/automated testing TM4J is an option
• If you are a larger enterprise and looking for a full strength, highly
configurable solution for testing – go for Xray – it’s the winner also
on price

84. Thank You
WWW.BLENDEDPERSPECTIVES.COM
Questions?
Miles@Blended.net