IL TestShell Seminar OCT 2012

1. Automation solution @ Polycom
Moshe Reubinoff – Automation Team Leader
Guy Bachar – Testing Manager
© Polycom, Inc. All rights reserved.

2. Industry leader in conferencing and collaboration
Introduction to Polycom
© Polycom, Inc. All rights reserved. 2

3. Test automation architecture
• Infrastructure - A .NET API layer that enables performing actions on required
modules such as MCU, Endpoints, Media Manager, Putty and more. All from one
platform and in a Handy and easy way (AKA FANTA – Fully automated .NET api).
• .Net Tests - A set of simple actions based on FANTA that
Can be executed in a controlled way (as thread loop limit, time
limit, menus, etc.). The code is generic and can be easily reused.
• Compiled test – Each test based on FANTA is compiled as exe with his
required resources so it can be run independently. Arguments and
configurations flags can be passed from Excel.
• TestShell – Test are managed and run via TestShell (Other options
different off the shelf tools, QC, Batch Files, Task Schedulers)
• Web control – all the tests can be execute/ schedule by the web site.
• BI – each test/regression write the results to the database. The BI tool read the values
from the DB and present the statuses/coverage of the tests.
• ClearCase / SVN – All code of both FANTA and the tests based on it are managed in the ClearCase
© Polycom, Inc. All rights reserved. 3

4. © Polycom, Inc. All rights reserved.

5. FANTA
SoftMcu
RMX+
Endpoints
Shelf
(Polycom,
Tandberg)
DMA FANTA
PUTTY
U.C
ClientSDK
U.C Lync REPORTING
R13,R14
© Polycom, Inc. All rights reserved. 5

6. MCUs integration
• vSphere
• Amazon Cloud
• RMX
© Polycom, Inc. All rights reserved. 6

7. Code sample
© Polycom, Inc. All rights reserved. 7

8. Resource manager
• All resources are managed in a single repository
− Device tagging by user defined parameters and configurable
attributes.
− Easily find required device
− Track and Report device utilization
− Devices management by Domains and groups (users)
− Store, verify and activate topologies in a click (full solution
Topology)
− Lab monitoring
© Polycom, Inc. All rights reserved. 8

9. ENV
© Polycom, Inc. All rights reserved. 9

10. Tests Automation
• Quick test creation
− Simple graphical flowchart
− Easy device response analysis.
− integration with .net application.
− Configuration files Support.
− Single repository for Dependencies files.
• Embedded integration
− Control interfaces Telnet, SSH, Web Services, Serial…
− Scripts TCL, Per, Python…
− Custom drivers NET, Exe,…
© Polycom, Inc. All rights reserved. 10

11. Queue – State machine
• Schedules Tests
• Manage resources per
test
• Schedules the tests
according to the test Pr.
• One place for
execution.
• Domain support
• Keep the scheduler in
the DB
© Polycom, Inc. All rights reserved. 11

12. Queue – scheduler
© Polycom, Inc. All rights reserved. 12

13. Automation Report
© Polycom, Inc. All rights reserved. 13

14. Web control
© Polycom, Inc. All rights reserved. 14

15. Web control
© Polycom, Inc. All rights reserved. 15

16. BI
© Polycom, Inc. All rights reserved. 16

17. BI
© Polycom, Inc. All rights reserved. 17

18. BI
© Polycom, Inc. All rights reserved. 18

19. Challenges
• Testing in Real-time environment.
• Flexibility.
• Test development methodology.
• Test engineers training. (Manual & Automatic).
• Resource management / Test configuration
• Control different devices.
• Stabilize the environment.
• Analysis & reports.
© Polycom, Inc. All rights reserved. 19

20. Next Step
• Control more devices (MAC PCs, more platforms).
• Enlarge automation coverage.
• Automation framework enhancement (Web support –
RSS, SQL management)
• Automatic analysis (compare to previous results)
•…
© Polycom, Inc. All rights reserved. 20

21. Questions?
© Polycom, Inc. All rights reserved.