This document discusses routers, sampling techniques for research, and implications for the future. It covers the history and evolution of routers, how to reduce errors in sampling like coverage, sampling, and nonresponse bias. It emphasizes the need for broad sampling, consistent methodology, understanding audiences, and providing reasonable surveys and incentives. The takeaways are that adaptation to change is important, researchers should critically evaluate their own work, and use creativity to develop new approaches while maintaining research fundamentals. The challenge is to refine methods and create new technology-driven solutions as the environment changes constantly.

1. Once upon a time…
A Brief History of Routers,
Our World Today, and
Implications for
the Future

2. How it Began (and Why)
Sampling Theory & Managing Bias
Next Steps for Router R-on-R
Takeaways for the Future

11. Rivers need Routers.
Routers don’t need Rivers.

12. Scalable
Valid
Replicable

15. Changing Market Forces
and
The Quest for Validity
Sampling procedures should be employed to produce research
having the greatest validity, through the reduction of error.

17. Validity and Quality
are not binary.
There is a continuum.

18. Sampling 101
• Coverage Error
– The result of all units in a defined population not having a known non-zero
probability of inclusion in the sample drawn to represent the population.
• Sampling Error
– The result of surveying a sample of the population rather than the entire
population. Inherent by virtue of the scientific method. You know the rules…
• Nonresponse Error
– The result of not getting some people to respond to the survey who, had they
done so, would have provided different answers than those who did respond.

19. Managing Bias
• Coverage Error
– Source broadly
– Identify and balance characteristics
– Stabilize your sampling frame
• Sampling Error
– Establish business rules, then draw samples consistently
– Analyze reasonable bases
• Nonresponse Error
– Understand your audience, and survey taking modes
– Provide a reasonable survey instrument
– Provide a reasonable (yet nominal) incentive

20. Managing Bias
• Coverage Error
– Source broadly
– Identify and balance characteristics
– Stabilize your sampling frame
• Sampling Error
– Establish business rules, then draw samples consistently
– Analyze reasonable bases
• Nonresponse Error
– Understand your audience, and survey taking modes
– Provide a reasonable survey instrument
– Provide a reasonable (yet nominal) incentive

30. Takeaways
• The evolution of routers is a great example of
adaptation to a changing world
• With that evolution comes appropriate critical
evaluation – giving ourselves a grade
• Our challenge is to use this guidance to refine
our methods and create totally new tech-
driven approaches

31. The Challenge for Researchers
Aware that there is no perfect research and
that our environment is ever-changing,
we understand our challenge:
• Maintain perspective,
with a foundation in
research fundamentals
• Use CREATIVITY and
CRITICAL EVALUATION
to develop our next
generation solutions
And execution wins.

32. Questions for the Day
Problems present opportunities…
what do we tackle next?
Which areas are ripe for new innovations?
Change necessitates evolution…
what’s next?

33. Thank You
Chuck Miller
chuck@dm2corp.com