1. Cognitive Video Regeneration:
From Script to Instant Video
Using Advanced Artificial Intelligence (A.I.) to
Create Hyper-Realistic, Human Video Avatars

2. White Paper | Cognitive Video Regeneration: From Script to Instant Video
Introduction
Seyyer, Inc. is a developer of the first, cognitive video-regeneration (CVR) platform. By blending facial
micro-expressions, human gesture-recognition technology and personalized-speech modeling, Seyyer will
create realistic, human video avatars. The artificial intelligence (A.I.) video personalization platform enables
users to create massive amounts of customizable, authentic video content, instantly and inexpensively.
Recognizing the paradigm shift in social communications, instant information sharing and consumerism,
Seyyer’s innovative, video-regeneration technology can elevate the user experience to a new level of
personalization. Applications range from targeted, human video marketing for advertising, branding and
entertainment to education and humanitarian applications.
1

3. White Paper | Cognitive Video Regeneration: From Script to Instant Video
Instant Information Sharing and
Personalization Dynamics
The advent of social media has not only brought a new level of transparency to the way we communicate, it
has allowed the average person unprecedented access to public figures, information and news and events
of the day. Micro blogging and Twitter in particular, have eliminated multiple degrees of separation between
celebrity and fan. It’s no surprise that the top ten most followed people on Twitter are invariably celebrities.
It is clear; audiences are hungry for more personalized information and access.
In the social media arena, no one is anonymous and few want to be. This is an era where personalization
and familiarity are premium, and to a large extent, anticipated. How often do we read emails or answer text
messages that don’t address us personally? People not only want to be known by name, they expect it.
Text to Video (TTV): From Ideas to Reality
Cognitive Video Regeneration (CVR), while still in its early stages of development, is poised to
fundamentally change the way we communicate. We’re at the edge of new era in information processing;
communicating through machine cognition. Google first pioneered the search space then began developing
the next generation of its technology with semantic search and contextual information. Apple pioneered
the first intuitive user interface with interactive touch screens. Microsoft introduced Kinect to accurately
quantify and track facial and body gestures in order to control devices. All these innovations have centered
on interpreting high-dimensional data. CVR’s unique possibilities now move high-dimensional data
processing into the space of original content creation.
“Similar to the way a human brain processes
and operates, CVR is able to create new
information based on all past observations.”
2

4. White Paper | Cognitive Video Regeneration: From Script to Instant Video
The Code on the Human Face
The human face is capable of over 3,000 different micro expressions according to Dr. Paul Ekman, one of the
more prominent experts on the human face. Most of these are hard-wired and universally recognizable across
cultures. This gives some hint into the complexity and nuance involved with human gesture recognition. It’s
useful to think of facial micro-expressions as high-dimensional signals. The fundamental question for us is: how
intelligent machines can recognize, learn, interpret and ultimately generate these perceptual symbols instantly.
The Path to CVR
To create a CVR generated “human” avatar, we first collect video and audio of the person talking with various
emotional expressions. The CVR engine then develops a Human model (the H-model) that incorporates that
person’s way of talking, including unique micro-expressions, gesture patterns, and speech cadence. The H-model
is the key to further production of new dialogue. The H-model is based on advanced mathematical techniques:
nonlinear estimation, Bayesian statistics, and the latest developments in machine learning.
CVR represents a complete departure from speech and video synthesis techniques that splice together short
segments of content from a dictionary. Such techniques can give realistic results when a restricted set of
utterances needs to be produced, but they do not have the generative power of CVR, which is based on the
most sophisticated artificial intelligence (AI) and statistical signal processing algorithms being delivered today.
Machine learning algorithms are capable of creating models that generalize from their original source material.
This is what allows the CVR engine to create realistic text-to-video (TTV) clips whose text is completely unrelated
to the training material used to create the H-Model. The video output of an H-model goes well beyond lip
synthesis to generate entire facial expressions. Similarly, the text controlling audio output can be annotated to
modify how fast the person talks, how certain words are stressed, and so on. These advanced features are
needed to get the breakthrough level of realism found in CVR technology.
When a user enters text copy, the CVR engine reconstructs the customized message drawing from existing H-model
memory. By blending gesture recognition technology with personalized speech modeling, the CVR platform renders
an avatar that appears identical to its human counterpart. Once the avatar is synthesized, the A.I. video personalization
platform can inexpensively and quickly create limitless amounts of scripted video content.
If the H-model resides on the cloud/server then the server can dish out the video directly to the intended
person. If the H-model resides on the smart phone of the intended user, then SMS text can be directly
converted to video on the device itself.
3

5. White Paper | Cognitive Video Regeneration: From Script to Instant Video
How Cognitive Video Regeneration will
Shift Paradigms
Though still in its infancy, the potential applications for CVR are limitless, particularly with the advent of more
sophisticated AI technologies.
“In the near future, having your own AI powered personal
avatar, optimized for sound and appearance, could be
as commonplace as having an email address or mobile
phone number.” and operates, CVR is able to create new
information based on all past observations.”
Most immediately, addressing ease-of-use and quality requirements, while eliminating the time and cost
constraints associated with traditional broadcast video, ushers in a new age of online personalization. News and
entertainment, publishing, social media, e-learning, mobile communications and targeted advertising are just a
few of the immediate potential applications. With CVR, educational content developers can create interactive
personalized video-based curricula. Advertisers can develop highly targeted and almost instantly updatable
mobile and online marketing campaigns that drive deeper consumer engagement. Retailers using the latest
social commerce engines can create hyper-realistic, customizable avatars to further augment and complement
their customers’ shopping experiences.
4

6. White Paper | Cognitive Video Regeneration: From Script to Instant Video
Personalized Advertising
Cognitive Video Regeneration technology is poised to solve multiple dilemmas marketers face with personalized
video advertising. Personalized video effectively blends the impact of a high- quality video experience with
the delivery of highly personalized messages to specific audience segments—or even individuals. Research
has proven that personalized advertising has emerged as the most effective and powerful form of advertising
available in today’s cluttered media landscape. A recent study shows that purchase intent and brand loyalty are
significantly higher with video ad personalization, yielding a 100% lift in brand favorability. (Source: Personalized
Video Ad Testing: Knowledge Networks, September, 2011)
While it is evident that personalization resonates when delivered in the form of online video ads, video
personalization remains a difficult proposition for advertisers. Personalized video ads are costly, time consuming,
and in many cases not practical. Production costs alone easily could run over tens of thousands of dollars for a
simple commercial video clip.
With Cognitive Video Regeneration, advertisers will have the tools to build personalized video ad campaigns
efficiently and effectively. Personalized video advertising will continue gaining momentum with its unique ability
to add real human interaction into marketing campaigns, and enable advertisers to develop positive relationships
with their customers.
5

7. White Paper | Cognitive Video Regeneration: From Script to Instant Video
Advertising is Only the Beginning
CVR enables advertisers to deliver branded content and develop targeted and almost instantly updatable mobile
and on-line marketing campaigns, but that’s only the beginning.
• ducational Content Developers -- Create personalized video-based curricula
E
to enhance the learning process.
• etailers – Enhance value of latest social commerce engines by creating
R
hyper-realistic, customizable avatars to further augment and complement their
customers’ shopping experiences.
• Social Media Sites – Create fun, customizable, shareable video experiences
and viral videos such as personalized video-SMS messages.
• Personalized Video Mail – Increase open and conversion rates with
personalized video mail. Industry reports suggest 21% higher conversion rates
in emails that included video.
• Branded Video eCards and Fan Cards – CVR powered eCards will feature a
branded dashboard that enables users to create fun, high-quality, personalized
video cards.
• ublishers – Enhance content in V-books, V-publishing, V- Entertainment, on-line
P
books, magazines and blogs.
• Video Personal Assistant – By combining Seyyer’s CVR platform with speech
recognition technology, imagine a personal assist mobile app.
Future Text to Video Applications
Advanced patterning in gesture recognition, voice tonality and contextual learning will bring increasing levels
of interactivity and responsive functionality to CVR powered AI avatars. This poses broad possibilities for
applications from the seemingly mundane to interactive agents that act to profoundly enhance the quality of life
for their human counterparts.
6