Unobtrusive introduction to basic Complex Event Processing principles and building blocks. Review of the Microsoft StreamInsight.

1. MICROSOFT
STREAMINSIGHT
Yulian Slobodyan
L’viv, 2011
Breakthrough Guide

2. Introduction to CEP

3. recap(Strategic, Tactical)
strategic
tactical

4. scenarioA
Tokyo
Metro

5. scenarioA.Info







Anno 1927
#1 annual passenger rides
3,160,000,000
passengers/year
avg 6,330,000
passengers/day
24/7 mode
203.4 km system length
2009 profit ¥63,500,000,000

6. scenarioA.Issues.Take(1)
Pushers
押し屋 oshiya

7. scenarioA.Strategic





Reporting
Planning
Data Mining
Constraints
Detection
Forecasting

8. scenarioA.Tactical





Real-time Statistics
& Monitoring
On a Fly Analysis
Traffic Optimization
Systems
Management
Emergency
Response

9. scenarioA.Solutions[“RDBMS”]
Humans
Request
Data
Services
RDBMS
Presentation
tactical
Sensors
strategic

10. scenarioA.Solutions[“CEP”]
CEP
System
Humans
Services
Presentation
tactical
Sensors
strategic

11. Google(“CEP”)

Complex event processing (CEP) consists of





processing many events happening across all the layers of an
organization
identifying the most meaningful events within the event cloud
analyzing their impact
taking subsequent action in real time.
CEP Products

Sybase CEP, StreamBase
 Microsoft
StreamInsight

12. Compare(RDBMS, CEP)
RDBMS
Request
Paradigm
Latency
Throughput
CEP
On-Demand
Continuous
~ sec * n
~ ms * n
~ 100 * n/sec
~ 10,000 * n/sec

13. Microsoft StreamInsight

14. StreamInsight.Info




CEP engine from Microsoft
Part of MS SQL Server 2008/2008R2
Distributive
Uses SQL Server license key to activate
Two Editions:
 Standard
( SQL Server Standard/Enterprise/Web)
 Premium ( SQL Server
Datacenter/Developer/Eval)

Current version: 1.1

15. StreamInsight.Architecture

17. StreamInsight.EventStream.Tra
ce()
Stream Insight Runtime
Event
Source
Input
Adapter
Standin
g
Queries
Output
Adapter
Event
Sink

18. Data
Event Model
Event
Event Kind
Payload
Timestamp
Header
StreamInsight.Event.Structure

19. StreamInsight.EventKind
Average
Average
time
- INSERT event
- CTI (Current Time Increment) event

20. StreamInsight.EventModel

Point


Interval


“10:42:56.052 - item #123 passed the gate”
“01:12:00-01:35:00 - active sensor #17”
Edge


“12:00:00-∞ - temperature 17˚C”
“13:00:00-∞ - temperature 18.5˚C”

21. payloa
d
StreamInsight.EventModel.Edg
e
C
B
A
time

22. StreamInsight.InputAdapters

23. StreamInsight.OutputAdapters

24. StreamInsight.Queries

Standard LINQ operations
 Projection
 Filtering
 Joins
 Unions
 Grouping

Event Windows

25. StreamInsight.EventWindows

26. StreamInsight.EventWindows