Metaverse is the converged world of physical world and virtual world that is hyper-connected, hyper-visualized, hyper-interacted, and hyper-reality enabled. Metaverse is a collection of fully connected interoperable physically augmented digital worlds with physical persistence that are converged with the virtually augmented physical world in which people and digital representations of people (digital people) can fully interact with one another and digital objects/environments (including digital twins) with full reality. Patents are a good information resource for obtaining the state of the art of metaverse technology innovation insights. As a metaverse technology innovation application, US20210004076 illustrates an AI innovation platform that provides a virtual AI development and testing environment.

1. 1
©2021 TechIPm, LLC All Rights Reserved http://www.techipm.com/
Metaverse AI Innovation Platform Insights from Patents
Alex G. Lee1
Metaverse is the converged world of physical world and virtual world that is hyper-connected, hyper-visualized,
hyper-interacted, and hyper-reality enabled. Metaverse is a collection of fully connected interoperable physically
augmented digital worlds with physical persistence that are converged with the virtually augmented physical world
in which people and digital representations of people (digital people) can fully interact with one another and digital
objects/environments (including digital twins) with full reality. Patents are a good information resource for
obtaining the state of the art of metaverse technology innovation insights. As a metaverse technology innovation
application, US20210004076 illustrates an AI innovation platform that provides a virtual AI development and
testing environment.
AI systems need to be trained and tested before deployment. Currently the data to train AI systems for the
deployment and testing use physical data and real environments. For example, developing a retail store AI system
that understands product stock availability, proper product merchandising, and shopper behavior requires physical
retail store mockups or test stores, actors or others performing the shopping tasks, and a very large number of
product types, product shelf positions, stock in/out configurations, plus physical cameras, and shelf and other
sensors that comprise the AI system.
1
Alex G. Lee, Ph.D Esq., is a principal consultant and patent attorney at TechIPm, LLC.

2. 2
©2021 TechIPm, LLC All Rights Reserved http://www.techipm.com/
The use of purely physical data and physical test environments in the development of AI systems, however,
presents many limitations. For example, the physical data needed to train the AI system must already exist or be
created. Although in some cases public datasets of image-based data may exist, this data is not typically tailored to
the specific use case. Furthermore, creating or collecting sufficient high quality data are very expense and time-
consuming. Once sufficient data is obtained, it has to be manually annotated. This process of labeling the data is
inherently slow, costly, and prone to errors and inaccuracies. Additionally, any changes to the project goals or
specifications can require repetition of the entire process, and physical environments, products and objects need to
be constructed to avoid the system failure when the AI system is deployed outside of the specific physical
development environment.
On the other hand, in the metaverse virtual AI development processes, AI model training data, system validation,
system deployment, and system testing can be performed within a real-time 3D virtual environment incorporating
objects, camera systems, sensors and digital human avatars representing the collaborating developers (who can
interact using AR/VR/MR devices). The virtual 3D spatial environment can be networked with external computer
resources and their digital twins to simulate the end-use environment of the AI system. This environment can
include various sub-systems that feed data into the AI system. This data can be captured and utilized to train and
validate the AI system, which can then itself be deployed into the same real-time virtual environment. Finally, real-
time motion capture techniques and human actors can be used to drive humanoid avatars within the virtual
environment.

3. 3
©2021 TechIPm, LLC All Rights Reserved http://www.techipm.com/
Following figure shows human actors 518A-B in the studio 560 can utilize a virtual environment computer system
522 and the VR devices 550 to simultaneously visualize and experience a virtual environment 502 through virtual
reality interfaces of the VR devices 550. Various motions or gestures of the human actors can be tracked by a
motion capture system 520 or other techniques. The human actors can also wear a plurality of markers 540 in the
studio and/or motion capture gloves 544. Actions of humanoid avatars and positions of other objects in the virtual
(manufacturing) environment can be recorded by a camera system 512, and the data stream can be fed into and
processed by an AI processing computer system 524. Additionally, data from any virtual sensors within the virtual
environment can be fed into and processed by an AI processing computer system 524 for processing.

4. 4
©2021 TechIPm, LLC All Rights Reserved http://www.techipm.com/