Bring your user and service stories to life through your tests.

1. @
$story->player()
Friday, 3 May 13

2. @
Bring Your Stories To Life
Through Your Tests
Friday, 3 May 13

3. @Introduce Yourselves
Friday, 3 May 13

4. @
@stuherbert
Friday, 3 May 13

5. @
Testing
I’m here to talk about
Friday, 3 May 13

6. @Don’t Switch Off Just Yet!
Friday, 3 May 13

7. @
Storyplayer
I’m here to launch
Friday, 3 May 13

8. @
Storyplayer
is a new open-source testing tool
Friday, 3 May 13

9. @
Created by
Friday, 3 May 13

10. @
built in
Friday, 3 May 13

11. @
hosted on
Friday, 3 May 13

12. @
to test this:
We’ve built it
Friday, 3 May 13

13. @DataSift Technical Architecture
Ultrahose
Archiver
push
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Node Shard
push
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Node Shard
ACL
(with interaction
counter)
HttpStreaming,PuSH,Search
Stream
Recorder
Monitoring
Aggregator
EDRs
(licensed
content
metrics)
Control
Channels
(D5)Hardware
LoadBalancer
Ultrahose
Archiver
100%
Prism
100%
Pickle
Filtering
Engine
Twitter
Facebook
Wikipedia
Reddit
LexisNexis
Meltwater
Estimize
Digg
@lorenzoalberton
DataSift Architecture 2.2
Links Resolution
+ OpenGraph
+ Twitter Cards
+ Metadata
Deletes
Processor
Redis
Input Streams
NewsCred
BoardReader
MySpace
SuperFeeder
Augmentation Pipeline
push
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Node Shard
push
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Pickle
Node
Node Shard
Monitoring
Kafka
Queue
Events
Storage
ACL
(with interaction
counter)
tracker
Limit
Manager
Authentication
Manager
Notification
Service
WEB
API
Stream .
Manager .DB
Definition .
Manager .DB
CSDL Compiler,
Validator,
Normaliser
Historics
Scheduler
Recording
Scheduler
Push
Scheduler
Interaction
Targets
Mapping
Filtering
Tardis
Pickle
Interaction
Targets
Mapping
Filtering
Tardis
Pickle
...
...
Hadoop
Titan Historics
Map/Reduce
HBase Cluster
Region 1 Region 2 Region N...
...
Data Node Data Node Data Node Data Node Data Node
100%
100%
Stop
PUB
License
Manager DB
Billing
Pipeline DB
DB
DB
Mask
Manager
DB
Connection
Manager
Time Machine + Insights
Post-Processing, Stream Analytics
jobs
DB
chunks
DB
chunk
selector
job
tracker
WorkerSnapshotter
Buffered
Streams
Redis
Worker
Worker
NodeMeteor
Real-time
Streams
Node
Node
HTTP Request
GET batch
PUSH
Scheduler
subscription X
subscription Y
job queuePUSH
Producer
Subscriptions
DB
PUSH
Delivery
HTTP(S) POST
(S)FTP
Amazon S3
DynamoDB
Microsoft Azure
MongoDB
Exports and
Analytics
WebSockets
HTTPStreaming
Delivery Subscriptions
Connections
Storage
kafka-consumer
Oracle
Stream
results
CouchDB
PickleDB .DB
Audit
Kafka
Kafka
Historical Queries
@datasift
Goblin Head
Goblin Head
Goblin Head
Goblin Tail
Goblin Tail
Goblin Tail
Interaction
Generation
Interaction
Generation
3rd party APIs
Demographics
Trends
Analysis
Sentiment
Analysis
Named
Entities
Topics
Analysis
Language
Detection
Klout
Score + Profile
Ogre
OgreOgreOgreOgre
Ogre
Ogre
OgreOgreOgreOgre
Ogre
Ogre
Ogre
Ogre
Ogre
OgreOgreOgreOgre
Ogre
Ogre
OgreOgreOgreOgre
Ogre
Ogre
OgreOgreOgreOgre
Ogre
Ogre
OgreOgreOgreOgre
Ogre
IBM Cognos
HDFS
Archiver
Data ingestion + Augmentation
Bit.ly
Stream
Splitter/Joiner
Deduper
Msg splitter
Google BigQuery
Stream results
Cloud Storage
DBs
BI tools
Friday, 3 May 13

14. @
It Plugs A Gap
In our testing strategy
Friday, 3 May 13

15. @
Testing Strategy?
What is our
Friday, 3 May 13

16. @
Layered Approach
Catch different problems
using different tools
Friday, 3 May 13

17. @Common Test Approach
Unit
Tests
Acceptance
Tests
Integration
Tests
Friday, 3 May 13

18. @The Focus Of Each Layer
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
Friday, 3 May 13

19. @The De Facto Standard
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
Friday, 3 May 13

20. @Popular Choices
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
BehatPHPSpec
Friday, 3 May 13

21. @The Neglected Layer
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
BehatPHPSpec
?
Friday, 3 May 13

22. @
Services & Systems?
How do we test
Friday, 3 May 13

23. @A Gap To Plug
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
BehatPHPSpec
Friday, 3 May 13

24. @Where Storyplayer Fits In
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
BehatPHPSpec
Storyplayer
Friday, 3 May 13

25. @
A Quick Tour
of Storyplayer
Friday, 3 May 13

26. @
Stories
It’s all about
Friday, 3 May 13

27. @
User Stories
The things that your
end-users can (and can’t!) do
Friday, 3 May 13

28. @
Service Stories
The things that your
internal systems can do
Friday, 3 May 13

29. @
Prose
Friday, 3 May 13

30. @
$story =
newStoryFor();
Friday, 3 May 13

31. @
Simple PHP Scripts
We don’t define a new class
for every story we want to test
Friday, 3 May 13

32. @
Avoids the
class AVeryLongAndInventiveClassname
* 1000 problem!
Friday, 3 May 13

33. @
Stories have up to
8 Phases
Friday, 3 May 13

34. @Creating The Test Conditions
Test Environment Setup1
Test Setup2
Friday, 3 May 13

35. @Before We Test
Pre-Test Prediction3
Pre-Test Inspection4
Friday, 3 May 13

36. @Perform The Story Steps
Action5
Friday, 3 May 13

37. @Did Anything Happen?
Post-Test Inspection6
Friday, 3 May 13

38. @Clean Up Afterwards
Test Teardown7
Test Environment Teardown8
Friday, 3 May 13

39. @
Closure
Each phase is a
Friday, 3 May 13

40. @
$story->setTestEnvironmentSetup(function($st) {
// story steps go here
});
Friday, 3 May 13

41. @
the $st object
All actions are done using
Friday, 3 May 13

42. @
The $st object
is a dynamic module loader
Friday, 3 May 13

43. @
Brand new objects
are instantiated
every new action
Friday, 3 May 13

44. @
This approach ensures
no weird bugs in tests
caused by re-using
objects between actions
Friday, 3 May 13

45. @
3 kinds of action
There are
Friday, 3 May 13

46. @
$st->fromXXXX()
Get the state of something
Friday, 3 May 13

47. @
$st->expectsXXXX()
Test the state of something
Friday, 3 May 13

48. @
$st->usingXXXX()
Change the state of something
Friday, 3 May 13

49. @
$story->addAction(function($st) {
$st->usingBrowser()->gotoPage(...);
$st->usingBrowser()->waitForTitle(...);
....
});
Friday, 3 May 13

50. @
$story->setPostTestInspection(function($st) {
$st->usingBrowser()->gotoPage(...);
$st->usingBrowser()->waitForTitle(...);
$st->expectsBrowser()
->has()
->linkWithText(“My Account”);
});
Friday, 3 May 13

51. @
14 Modules
Included
Friday, 3 May 13

52. @
Vagrant
Create test environments using
Friday, 3 May 13

53. @Using The Vagrant Module
SP
Vagrant VM
V
Vagrant VM
Creates
Friday, 3 May 13

54. @Using The Vagrant Module
Vagrant VM
VSP Service
Vagrant VM
Deploys
Friday, 3 May 13

55. @Using The Vagrant Module
Vagrant VM
VSP Service
Vagrant VM
Tests
SP
Friday, 3 May 13

56. @Using The Vagrant Module
Vagrant VM
VSP Service
Vagrant VM
Destroys
Friday, 3 May 13

57. @
SavageD
Monitor your VMs and processes using
(Another DataSift tool we’re releasing tonight)
Friday, 3 May 13

58. @Using SavageD
Vagrant VM
VSP
Vagrant VM
Creates
Friday, 3 May 13

59. @Using SavageD
Vagrant VM
VSP Service
Vagrant VM
Deploys
SavageD
Friday, 3 May 13

60. @Using SavageD
Vagrant VM
VSP Service
Vagrant VM
Tests
SP SavageD
Friday, 3 May 13

61. @Using SavageD
Vagrant VM
VSP Service
Vagrant VM
Tests
SP SavageD
Monitors
Friday, 3 May 13

62. @Using SavageD
Vagrant VM
VSP
Metrics Server
Service
Vagrant VM
Tests
SP
Monitors
statsdGraphite
SavageD
Reports To
Friday, 3 May 13

63. @
Graphite
Test your non-functional requirements with
Friday, 3 May 13

64. @Combined Testing Solution
Vagrant VM
VSP
Metrics Server
Service
Vagrant VM
Tests
SP
Monitors
statsdGraphite
SavageD
Reports To
Tests Metrics
Friday, 3 May 13

65. @Everything Should Log Metrics
Vagrant VM
VSP
Metrics Server
Vagrant VM
Tests
SP
Monitors
statsdGraphite
SavageD
Reports To
Tests Metrics
Service
Friday, 3 May 13

66. @
Your Own Modules
Extend Storyplayer with
Friday, 3 May 13

67. @
Pull Requests
Welcome :)
Friday, 3 May 13

68. @
OS X and Linux
Runs on
Friday, 3 May 13

69. @
PEAR
Installed via
Friday, 3 May 13

70. @
(Composer doesn’t support
installing packages system-wide yet)
Friday, 3 May 13

71. @
datasift.github.io
Docs available from
(WIP!!)
Friday, 3 May 13

72. @
Before You Go ...
Friday, 3 May 13

73. @This Model Is Incomplete
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
BehatPHPSpec
Storyplayer
Friday, 3 May 13

74. @... getting better :) ...
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
Storyplayer+
Friday, 3 May 13

75. @
Storyplayer
can test websites
and APIs too!
Friday, 3 May 13

76. @
Storyplayer
doesn’t replace Behat et al
Friday, 3 May 13

77. @
Behat
moves back to doing
what it does best
Friday, 3 May 13

78. @A Better Model Of Layered Testing
Functions
& Methods
User Interfaces
& APIs
Services
& Systems
PHPUnit
Storyplayer+
Acceptance
BehatPHPSpec
+
Friday, 3 May 13

79. @
Developers
take responsibility
for unit testing
Friday, 3 May 13

80. @
Developers + Testers
share responsibility
for testing
services & systems
user interfaces & APIs
Friday, 3 May 13

81. @
Product Owners
take responsibility
for acceptance testing
Friday, 3 May 13

82. @
Storyplayer
https://github.com/datasift/storyplayer/
available now!
Friday, 3 May 13

83. @
Thank you
PS: We’re hiring :-)
Friday, 3 May 13