The document discusses designing data preparation tools that can support users with different technical proficiencies, from non-technical users to expert users. It proposes using both visual "transform cards" and a script IDE mode to bridge the needs of different users. The tool would use progressive disclosure of scripting capabilities to ease non-technical users into more technical functions. A demo of the tool discussed implementing transform cards and ways to improve predictive data transformations through feedback.
Automating Google Workspace (GWS) & more with Apps Script
From Beginners to Experts, Data Wrangling for All
1. Alon Bartur Joseph McKenneyJingshu Chen
Principal Product Manager User Experience Designer Senior Software Engineer
Hadoop Summit
June 9th, 2015
From Beginner to Expert:
Data Wrangling For All
9. ““
LAUREN, DATA SCIENTIST
Preparing data for modeling or predictive analytics is painful, manual
and not repeatable across the organization. We need a more efficient
and reproducible way of preparing data for analysis.
““ I receive constant requests from the business for access to different data. I
need a faster way to produce the results they’re looking for in a
form that they can understand.
BEN, DATA PLATFORM ADMIN
Our Original Personas
15. Abstractions Can Be Useful
[a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:.[a-z0-9!#$
%&'*+/=?^_`{|}~-]+)*@
(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?.)+[a-
z0-9](?:[a-z0-9-]*[a-z0-9])?
16. Abstractions Can Be Useful
[a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:.[a-z0-9!#$
%&'*+/=?^_`{|}~-]+)*@
(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?.)+[a-
z0-9](?:[a-z0-9-]*[a-z0-9])?
{email}
17. ““
LAUREN, DATA SCIENTIST
Preparing data for modeling or predictive analytics is painful, manual
and not repeatable across the organization. We need a more efficient
and reproducible way of preparing data for analysis.
““ I receive constant requests from the business for access to different data. I
need a secure way of pointing them directly to the raw data so they can
explore and prepare it themselves.
BEN, DATA PLATFORM ADMIN
Today’s Personas
18. ““
LAUREN, DATA SCIENTIST
Preparing data for modeling or predictive analytics is painful, manual
and not repeatable across the organization. We need a more efficient
and reproducible way of preparing data for analysis.
““ I receive constant requests from the business for access to different data. I
need a secure way of pointing them directly to the raw data so they can
explore and prepare it themselves.
BEN, DATA PLATFORM ADMIN
““
JOHN, DATA ANALYST
I want direct access to the raw data so I can actually see the content of
different datasets to define my analytic requirements.
Today’s Personas
46. Non Technical Super Technical
>
I have to learn how to script?
The technical guys do the scripting
“
”
47. Non Technical Super Technical
>
I have to learn how to script?
The technical guys do the scripting
“
”
Why would I learn a new product?
I could code this in two minutes
“
”