Trio Notes

Trio: A System for Data , Uncertainty , and Lineage Search “stanford trio” DATA UNCERTAINTY LINEAGE

Trio ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Picture Data Uncertainty Lineage (“sourcing”)

Why Uncertainty + Lineage? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Uncertainty + Lineage? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Goal ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Trio }

The Trio Trio ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Running Example: Crime-Solving ,[object Object],[object Object],[object Object]

Data Model: Uncertainty ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Our Model for Uncertainty ,[object Object],[object Object],[object Object]

Our Model for Uncertainty ,[object Object],[object Object],[object Object],= Three possible instances (Amy, Honda) ∥ (Amy, Toyota) ∥ (Amy, Mazda) Saw (witness,car) { Honda, Toyota, Mazda } car Amy witness

Our Model for Uncertainty ,[object Object],[object Object],[object Object],Six possible instances ? (Amy, Honda) ∥ (Amy, Toyota) ∥ (Amy, Mazda) (Betty, Acura) Saw (witness,car)

Our Model for Uncertainty ,[object Object],[object Object],[object Object],? Six possible instances, each with a probability (Amy, Honda): 0.5 ∥ (Amy,Toyota): 0.3 ∥ (Amy, Mazda): 0.2 (Betty, Acura): 0.6 Saw (witness,car)

Deficiency in Model Suspects = π person (Saw ⋈ Drives) ? ? ? Does not correctly capture possible instances in the result CANNOT (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Billy, Honda) ∥ (Frank, Honda) (Hank, Honda) (Jimmy, Toyota) ∥ (Jimmy, Mazda) Drives (person,car) Jimmy Billy ∥ Frank Hank Suspects

Lineage to the Rescue ,[object Object],[object Object],[object Object],[object Object],[object Object]

Example with Lineage ? ? ? Suspects = π person (Saw ⋈ Drives) λ (31) = (11,2),(21,2) λ (32,1) = (11,1),(22,1); λ (32,2) = (11,1),(22,2) λ (33) = (11,1), 23 11 ID (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) 23 22 21 ID (Billy, Honda) ∥ (Frank, Honda) (Hank, Honda) (Jimmy, Toyota) ∥ (Jimmy, Mazda) Drives (person,car) 33 32 31 ID Jimmy Billy ∥ Frank Hank Suspects Correctly captures possible instances in the result

Uncertainty-Lineage Databases ( ULDBs ) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Querying ULDBs ,[object Object],[object Object],[object Object],TriQL

Initial TriQL Example SELECT Drives.person INTO Suspects FROM Saw, Drives WHERE Saw.car = Drives.car ? ? ? λ (31) = (11,2),(21,2) λ (32,1)=(11,1),(22,1); λ (32,2)=(11,1),(22,2) λ (33) = (11,1), 23 11 ID (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) 23 22 21 ID (Billy, Honda) ∥ (Frank, Honda) (Hank, Honda) (Jimmy, Toyota) ∥ (Jimmy, Mazda) Drives (person,car) 33 32 31 ID Jimmy Billy ∥ Frank Hank Suspects

Formal Semantics ,[object Object],D D 1 , D 2 , …, D n possible instances Q on each instance representation of instances Q(D 1 ), Q(D 2 ), …, Q ( D n ) D’ implementation of Q operational semantics D + Result

TriQL: Querying Confidences ,[object Object],[object Object],[object Object],[object Object],[object Object]

TriQL: Querying Lineage ,[object Object],[object Object],[object Object],[object Object],[object Object]

Operational Semantics ,[object Object],[object Object],[object Object],[object Object],[object Object],SELECT attr-list [ INTO table ] FROM X 1 , X 2 , ..., X n WHERE predicate

Operational Semantics ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],SELECT attr-list [ INTO table ] FROM X 1 , X 2 , ..., X n WHERE predicate

Operational Semantics: Example SELECT Drives.person FROM Saw, Drives WHERE Saw.car = Drives.car (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car)

Operational Semantics: Example SELECT Drives.person FROM Saw, Drives WHERE Saw.car = Drives.car (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car) (Cathy,Honda,Jim,Mazda) ∥ (Cathy,Honda,Bill,Mazda) ∥ (Cathy,Mazda,Jim,Mazda) ∥ (Cathy,Mazda,Bill,Mazda)

Operational Semantics: Example SELECT Drives.person FROM Saw, Drives WHERE Saw.car = Drives.car (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car) (Cathy,Honda,Jim,Mazda) ∥ (Cathy,Honda,Bill,Mazda) ∥ (Cathy,Mazda, Jim ,Mazda) ∥ (Cathy,Mazda, Bill ,Mazda)

Operational Semantics: Example SELECT Drives.person FROM Saw, Drives WHERE Saw.car = Drives.car (Cathy,Honda,Jim,Mazda) ∥ (Cathy,Honda,Bill,Mazda) ∥ (Cathy,Mazda, Jim ,Mazda) ∥ (Cathy,Mazda, Bill ,Mazda) (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car) (Cathy,Honda,Hank,Honda) ∥ (Cathy,Mazda,Hank,Honda)

Operational Semantics: Example SELECT Drives.person FROM Saw, Drives WHERE Saw.car = Drives.car (Cathy,Honda,Jim,Mazda) ∥ (Cathy,Honda,Bill,Mazda) ∥ (Cathy,Mazda, Jim ,Mazda) ∥ (Cathy,Mazda, Bill ,Mazda) (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car) (Cathy,Honda, Hank ,Honda) ∥ (Cathy,Mazda,Hank,Honda)

Operational Semantics: Example SELECT Drives.person INTO Suspects FROM Saw, Drives WHERE Saw.car = Drives.car ? ? λ ( ) = ... λ ( ) = ... (Cathy, Honda) ∥ (Cathy, Mazda) Saw (witness,car) (Hank, Honda) (Jim, Mazda) ∥ (Bill, Mazda) Drives (person,car) Jim ∥ Bill Hank Suspects

Confidences ,[object Object],[object Object],[object Object],[object Object],? ? ? 0.3 0.4 0.6 Probabilistic Min (Cathy, Honda): 0.6 ∥ (Cathy, Mazda): 0.4 Saw (witness,car) (Hank, Honda) (Jim, Mazda): 0.3 ∥ (Bill, Mazda): 0.6 Drives (person,car) Jim: 0.12 ∥ Bill: 0.24 Hank: 0.6 Suspects

Additional Query Constructs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Final Example Query Credibility List suspects with conf values based on accuser credibility (1, Amy, Jimmy) ∥ (1, Betty, Billy) ∥ (1, Cathy, Hank) (2, Cathy, Frank) ∥ (2, Betty, Freddy) PrimeSuspect (crime#, accuser, suspect) Cathy Betty Amy person 15 5 10 score Jimmy: 0.33 ∥ Billy: 0.5 ∥ Hank: 0.166 Frank: 0.25 ∥ Freddy: 0.75 Suspects

Final Example Query Credibility SELECT suspect, score/[sum(score)] as conf FROM (SELECT suspect, (SELECT score FROM Credibility C WHERE C.person = P.accuser) FROM PrimeSuspect P) (1, Amy, Jimmy) ∥ (1, Betty, Billy) ∥ (1, Cathy, Hank) (2, Cathy, Frank) ∥ (2, Betty, Freddy) PrimeSuspect (crime#, accuser, suspect) Cathy Betty Amy person 15 5 10 score Jimmy: 0.33 ∥ Billy: 0.5 ∥ Hank: 0.166 Frank: 0.25 ∥ Freddy: 0.75 Suspects

Trio System: Version 1 Standard relational DBMS Trio API and translator (Python) Command-line client Trio Metadata TrioExplorer (GUI client) Trio Stored Procedures Encoded Data Tables Lineage Tables Standard SQL ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Future Features (sample) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

but don’t forget the lineage… DATA UNCERTAINTY LINEAGE

Trio Notes

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (14)

More from Social Media Marketing

More from Social Media Marketing (20)

Recently uploaded

Recently uploaded (20)

Trio Notes