SlideShare ist ein Scribd-Unternehmen logo
1 von 77
Downloaden Sie, um offline zu lesen
blog: jabe.co
FAILING
principles and practices of
Vanity Validation a Paradox of Passionate Commitment
WELL
@cyetain
What was the last thing you
failed at?
What did you learn?
Did you share your failure
with anyone?
Pre-Talk Questions
blog: jabe.co
FAILING
principles and practices of
Vanity Validation a Paradox of Passionate Commitment
WELL
HELLLOOOO McFLY
TLC LABS
blog http://jabe.co
Send Anonymous Feedback
http://sayat.me/jabebloom
Joshua (Jabe) Bloom
CTO : The Library Corporation
& Consulting Practioner TLC Labs
#agile2013
@cyetain
Fail Fast
@cyetain
@cyetain
Learning occurs when we
detect and correct error. Error is
any mismatch between what
we intend an action to produce
and what actually happens
when we implement that action.
-Chris Argyris
@cyetain
How Do We Make Better Choices?
Why is it so hard to Fail?
Could we design a system to help?
@cyetain
One must treat his theory-in-
use as both a psychological
certainty and an intellectual
hypothesis.
-Chris Argyris
@cyetain
How wonderful that we have
met with a paradox. Now we
have some hope of making
progress.
-Niels Bohr
@cyetain
@cyetain
fake dictionary page from colbertnation.com
@cyetain
Although theory without
experiment is empty,
experiment without theory is
blind.
-Paul Thagard
@cyetain
3 Things To Leave With
• Failing Well Produces more Information than
Failing Poorly
• “Passionate Beliefs, Loosely Held”
• Reducing Variability too, Soon risks
suboptimal result, too Late increases Failure
blindness
@cyetain
We simply cannot rely on
randomness to correct
the problems that
randomness creates.
-Don Reinertsen
@cyetain
undifferentiated streams
of data
@cyetain
@cyetain
“Research is what
I’m doing when I
don’t know what
I’m doing.”
-Wernher von Braun
@cyetain
@cyetain
The Principle of Optimum Failure Rate
0% 100%
Probability of Failure
50%
PotentialInformation
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
Uncomfortable
Confident
@cyetain
Experience of Failure
NumberofSamples The Competency Trap
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
IdeasHidden
Risk
Hidden
Value
The Line of SURPRISE!
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
IdeasHidden
Risk
Hidden
Value
1
2
3
During Customer Development Focus on Interesting Ideas
Before Scaling Validate Your "We Know This Assumptions" to
reduce risk of Failure Demand
After Customer Validation Run experiments to Validate Assumptions of Failure
2
3
1
@cyetain
“The typical sequence of coin
tosses has high information
content but little value; an
ephemeris, giving the
positions of the moon and
planets every day for a
hundred years, has no more
information than the
equations of motion and
initial conditions from which
it was calculated, but saves
it’s owner the effort of
recalculating these positions.”
-Charles H. Bennett
@cyetain
Based on what we know
right now, what problems
do we have the least
amount of information
about that we can
reasonably expect to
understand?
@cyetain
@cyetain
Risk vs Uncertainty
@cyetain
Alteaory vs Epistemic
Uncertainties
@cyetain
Gamble Invest
@cyetain
Justified MVP
Value of Information
Cost of Acquisition
Cost of MVP
Unjustified
MVP
Over Justified
MVP
Justified
MVP
@cyetain
The first principle is that
you must not fool
yourself--and you are the
easiest person to fool.
-Richard Feynman
@cyetain
“Most people don’t know how to
learn. What’s more, those
members of the organization that
many assume to be the best at
learning are, in fact, not very
good at it. I am talking about the
well-educated, high-powered, high
commitment professionals”
-Chris Argyris
@cyetain
“Expertise … breeds an
inability to accept new
views.”
-Laski
@cyetain
@cyetain
VanityValidation
@cyetain
I need to be right even
if I'm wrong.
@cyetain
Defensive Reasoning
@cyetain
Remain in unilateral
control
@cyetain
Maximize "winning"
Minimize "losing"
@cyetain
Suppress negative
feelings
@cyetain
Be as "rational" as possible
-- by which people mean
defining clear objectives and
evaluating their behavior in
terms of whether or not
they have achieved them
@cyetain
Mindset Actions
Results Match
Results Mismatch
Single-loop
Double-loop
@cyetain
Valid Public
Information
@cyetain
@cyetain
whenever we propose a
solution to a problem, we
ought to try as hard as we
can to overthrow our solution,
rather than defend it.
-Karl Popper
@cyetain
• Identify Your Assumptions and Conclusions
CLEARLY AS POSSIBLE PUBLICLY
• Question Your Assumptions and Conclusions
• Seek Contrary Data
• Learn when to correct your Actions and
when to correct your Mindset
@cyetain
http://xkcd.com/
@cyetain
@cyetain
Abduction
not just for
Aliens
@cyetain
@cyetain
[Abduction] goes upon the hope that
there is sufficient affinity between the
reasoner's mind and nature's to render
guessing not altogether hopeless,
provided each guess is checked by
comparison with observation... The
effort should therefore be to make
each hypothesis... as near an even bet
as possible.
-Charles Peirce
@cyetain
ABDUCE
DEDUCE
INDUCE
Predictive
Probable
Plausible
The Way
Computers "Think"
The Way
Humans Think
Binary
Probability
Analogue
Justifiable
@cyetain
ABDUCE
DEDUCE
INDUCE
Experiences Hypothesises
Expected
Outcomes
If Coherent
If Expected Outcomes
Match Reality
Effective
Match
@cyetain
ABDUCE
DEDUCEINDUCE
@cyetain
ABDUCE
DEDUCEINDUCE
SURPRISE!!!
@cyetain
Multi-Hypothesis Research
!=
@cyetain
BRAINSTORM
@cyetain
Theories
Opinions
Hypothesizes
The Facts and Just
the Facts
@cyetain
Theories
Opinions
Hypothesizes
Constraints
Criteria
@cyetain
Theories
Opinions
Hypothesizes
Question
Facts
@cyetain
Theories
Opinions
Hypothesizes Request More
Information
@cyetain
NO TALKING!
@cyetain
How Would I Validate my
understanding of this
problem?
How Would I
solve this
Problem?
•Based on your experiences, what
would you do to solve this
problem? This is your Hypothesis.
•Identify What Needs to Be True if
your Hypothesis is true.
•Assert, Presume, Assume Truth
•Imagine Experiments that would
justify the Assumptions
@cyetain
I Assert that this I
know this
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
I Presume
Somebody
knows this
I am going to Assume
this is true for my
Hypothesis to be true
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
@cyetain
This is my Hypothesis,
Assumptions and
Experiments
Challenge
Assumptions &
Experiments
Rotate Pairs 2-3 Times
Allow Time for Revision Between Rounds
@cyetain
This is my Hypothesis,
Assumptions and
Experiments
@cyetain
Multiple Smaller Experiments
against
Multiple Abductive Hypotheses
instead of
Single Large Experiment
against
Single Hypotheses
@cyetain
Failing Well Produces more
Information than Failing
Poorly
@cyetain
What are You Doing w All that Information?
Incremental: Confirm. Disconfirm.
Iteratively: Select Next Step. Generate More
Options
@cyetain
Having “Passionate
Beliefs, Loosely Held”
FAILURE
MUST
BE AN OPTION
@cyetain
Reducing Variability too
soon risks suboptimal
result, too late increases
failure demand
@cyetain
@cyetain
Influences
&
Sources of More Information
@cyetain
Joshua (Jabe) Bloom
CTO : The Library Corporation
& TLC Labs
blog http://jabe.co
Send Anonymous Feedback
http://sayat.me/jabebloom

Weitere ähnliche Inhalte

Mehr von Jabe Bloom

Three frames DevOpsDays ATL
Three frames DevOpsDays ATLThree frames DevOpsDays ATL
Three frames DevOpsDays ATLJabe Bloom
 
Monkey Mind Knowledge Work
Monkey Mind Knowledge WorkMonkey Mind Knowledge Work
Monkey Mind Knowledge WorkJabe Bloom
 
Lean agile scotland 2013
Lean agile scotland 2013Lean agile scotland 2013
Lean agile scotland 2013Jabe Bloom
 
Speed design studio version4.6
Speed design studio version4.6Speed design studio version4.6
Speed design studio version4.6Jabe Bloom
 
Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Jabe Bloom
 
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Jabe Bloom
 
Multi Hypothesis Design Studio
Multi Hypothesis Design StudioMulti Hypothesis Design Studio
Multi Hypothesis Design StudioJabe Bloom
 

Mehr von Jabe Bloom (8)

Three frames DevOpsDays ATL
Three frames DevOpsDays ATLThree frames DevOpsDays ATL
Three frames DevOpsDays ATL
 
Monkey Mind Knowledge Work
Monkey Mind Knowledge WorkMonkey Mind Knowledge Work
Monkey Mind Knowledge Work
 
Lean agile scotland 2013
Lean agile scotland 2013Lean agile scotland 2013
Lean agile scotland 2013
 
Speed design studio version4.6
Speed design studio version4.6Speed design studio version4.6
Speed design studio version4.6
 
Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Agile Winnipeg iteration 22
Agile Winnipeg iteration 22
 
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
 
Multi Hypothesis Design Studio
Multi Hypothesis Design StudioMulti Hypothesis Design Studio
Multi Hypothesis Design Studio
 
LeanTX
LeanTXLeanTX
LeanTX
 

Kürzlich hochgeladen

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Kürzlich hochgeladen (20)

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Failing Well Agile 2013