Big Data Sustainability Paper Presentation: ssrn.com/abstract=2716785
I am a visiting scholar at Washington University School of Law researching how we as a society can gain the benefits of the Information Revolution without losing human values.
This is a presentation I gave at Strata Hadoop World 2016 in San Jose on a paper I wrote with Prof Dennis Hirsch titled Big Data Sustainability. Our paper uses the power of analogy to help inform what management approach businesses should employ to sustainably achieve the tremendous benefits of big data analytics while minimizing potential negative externalities.
I first demonstrates that, along with its many benefits, big data can create negative externalities that are structurally similar to environmental pollution. I conclude that just as the Industrial Revolution gave rise to Environmental Protection, the Digital Revolution is giving rise to Data Protection (aka Privacy).
Given the similarities, I then argue that we can learn from the evolution of environmental management to manage the negative externalities of the big data revolution as they emerge. I chronicle environmental management’s historical progression from a backend, siloed approach to a more collaborative and proactive environmental management system approach.
Finally I show how a big data management system approach aligns with agile software development and DevOps practices that companies use to develop and maintain big data applications, best practices in Privacy by Design and engineering, and emerging trends in organizational management theory.
At this critical, formative moment when organizations begin to leverage personal data toward revolutionary ends, we can readily learn from environmental management systems to embrace sustainable big data management from the outset.
13. Moore’s law states that the
number of transistors on a
chip will double about every
two years.
14.
15. "the book is an extension of the eye… clothing, an extension of the skin… electric
circuitry, an extension of the central nervous system”
The Medium is the Massage: An Inventory of Effects (1967)
Understanding Media: The Extensions of Man (1964)
"the medium is the message…”
“McLuhan’s maxim that “the medium is the message” conveys broadly how
technologies and media not only change the message but the very structure of
human thought and expression. We think and act differently when we use
different technologies to express ourselves or live our lives…
~ Richards & King in Big Data Ethics
16. #1 Robo-writers create content
By 2018, 20 percent of business content will be authored by machines.
#2 Things will need help
By 2020, autonomous software agents outside of human control will participate in 5 percent of all economic
transactions.
#3 Agents get independence
By 2020, autonomous software agents outside of human control will participate in 5 percent of all economic
transactions.
#4 You work for a robo-boss
By 2018, more than 3 million workers globally will be supervised by a “robo-boss.”
http://www.gartner.com/smarterwithgartner/gartner-predicts-our-digital-future/
18. “Big data promises to use this data to make the world
more transparent, but its collection is invisible, and its
tools and techniques are opaque, shrouded by layers of
physical, legal, and technical privacy by design.”
“If big data spells the end of privacy, then why is the big
data revolution occurring mostly in secret?”
~ Three Paradoxes of Big Data
19. “interesting morning hearing from people I typically don’t talk to.”
“I don’t think about privacy.”
“Privacy is a constraint.”
“I don’t want to know what you know about me. I want to know what you predict
about me. You can infer a lot more or less about data, what is important is what they
predict about.”
Data Scientist on
Privacy?
Data Scientist on
Identity
How will our right to identity, our right to say “I
am,” fare in the big data era? … “I am” and “I like”
risk becoming “you are” and “you will like.” ~
Three Paradoxes of Big Data
20. “We need a healthier balance of power between those who generate the data
and those who make inferences and decisions based on it, so that one doesn’t
come to unduly revolt or control the other.”
~ Three Paradoxes of Big Data
27. Silo Systemversus
• US Auto Companies
• Environmental Compliance
• Toyota Production System
• Environmental Mgmt System
28. Silo Systemversus
• US Auto Companies
• Environmental Compliance
• Waterfall
• Toyota Production System
• Environmental Mgmt System
• Agile / DevOps
29. Silo Systemversus
• US Auto Companies
• Environmental Compliance
• Waterfall
• IRB / CSRB
• Toyota Production System
• Environmental Mgmt System
• Agile / DevOps
• Big Data Mgmt System
33. Trust
“Your job … is to ensure the fast,
predictable, and uninterupted flow of
planned work that delivers value to the
business while minimizing impact and
disruption of unplanned work, so you
can provide stable, predictable, and
secure IT Service.”
37. “Too often the necessary controls and
measures to protect personal
information required by a process,
application, or system are either ignored
or bolted on at the 11th hour of
development.”
41. “The hope is that, in not too many years, human brains and computing
machines will be coupled together very tightly, and that the
resulting partnership will think as no human
brain has ever thought and process data in a way
not approached by the information-handling machines we know today.”
Man-Computer Symbiosis (1960)
J.C.R. Licklider
Washington University Undergrad
"Men will set the goals, formulate the hypotheses,
determine the criteria..."
Hinweis der Redaktion
Jamnagar refinery is the world's largest oil refinery with an aggregate capacity of 1.24 million barrels per day (bpd). The refinery complex is located at Jamnagar in Gujarat, India. It is owned and operated by Reliance Industries.
The refinery complex is spread across 7,500 acres and has more than 50 process units which refine the basic feedstock, crude oil to obtain various finished products.
The world's largest refinery took three years to complete and involved about $6bn of investment.
The refinery consists of hydrodesulphurisation, catalytic reforming, fluid catalytic cracking and delayed coking units. It also includes sulphur recovery, hydrogen generation, merox treating and TAME (Tertiary Amyl Methyl Ether) units.
The CSX train, with 109 tanker cars and two locomotives, derailed about 1:20 p.m. here in the southern part of the state, sending fireballs ripping through the air. The governor’s office released a statement Tuesday saying that 26 tankers had derailed and that “19 of those tankers were involved in the fire.”
But that is not all that has been growing.
Electronic circuitry aka transistors on a chip, has been doubling about every year for over 40 years and is now so powerful as to be approaching cost in pennys and transistors in atoms.
In fact there are several measures of digital technology are improving at exponential rates related to Moore's law, including the size, cost, density and speed of components.
In order to answer this question we have to take a step back to the 60s. Marshall McLuhan was a Canadian educator, philosopher, and scholar—a professor of English literature, a literary critic, a rhetorician, and a communication theorist. McLuhan's work is viewed as one of the cornerstones of the study of media theory, as well as having practical applications in the advertising and television industries.
Many here will know Marshall McLuhan’s favorite quote “the medium is the message” first raised in his 1964 book Understanding Media: The Extensions of Man.. McLuhan later revised this quote to say the medium is the Massage to emphasize his point.
McLuhan was ahead of his time in seeing a rapidly growing and global convergence between humanity and media or in his words, "the book is an extension of the eye… clothing, an extension of the skin… electric circuitry, an extension of the central nervous system”
Transition from a discussion of values to practices
This describes the two paths – you can adopt practices and hope for the best – this reminds of the process movement of the 80’s – just following these policies and procedures and all willl be well or you can adopt values and figure out the best practices for the job.
Sit together
Whole team
Informative workspace
Collective ownership
This describes the two paths – you can adopt practices and hope for the best – this reminds of the process movement of the 80’s – just following these policies and procedures and all willl be well or you can adopt values and figure out the best practices for the job.