Cloud4all is an EC-funded project from the 7th Framework Programme. Cloud4all aims to develop a complete new paradigm in accessibility by augmenting adaptation of individual products and services for a person (2nd generation) with automatic personalization of any mainstream product or service a user encounters using cloud technologies to activate and augment any natural (built-in) accessibility or installed access features the product or service has (3rd generation), based on the user's needs and preferences. This presentation provides an overview of the different technical components that comprise the overall Cloud4all / GPII architecture.

1. Cloud platforms Lead to Open and Universal access
for people with Disabilities and for All
www.cloud4all.info
Cloud4all Technical Overview
Gregg Vanderheiden Ph.D.
Raising the Floor – International

2. Cloud4all Objectives
1. To test the concept of Auto-Personalization from Preferences
• Does it work – for users – and across technologies
• Can it be built in a scalable fashion
1. To build the first draft of essential GPII components
•
•
•
•
•
The Overall Architecture and run time components
The Semantic components (Ontologies, et al)
The Basic Data Sets required ( Registries and Databases )
The Data Maintenance and User Tools
The Standards
1. To create demonstration/test implementations
• Across technologies (Windows, Linux, Android etc)
• Across Application domains (PCs, Mobile, Web, Closed, Appliances, etc)
2

3. Major Components of GPII
US Dept of Ed
Will something
help me?
What?
Getting access
automatically,
anywhere, on
any device
Tools to make it
easier, lower-cost
to create & market
new solutions
3
Cloud4all
GPII
Unified Listing
& Marketplace
User
Awareness
Needs & Prefs
Discovery Aid
Needs & Prefs
Storage
Users find out
something exists
for them.
Users can find out
which types of
things help them
Users can store
needs & preferences
info for later use
Prefs & Perm
Server
Real Time
Matching
Delivery/Launch
Management
Media &
Materials
Assistance on
Demand (AOD)
User needs & prefs
stored securely and
available anywhere
Prefs and context
used to determine
best fit; here, now.
Built-in + AT are
auto-adjusted and
launched, anywhere
Auto- augmentation
transformation
and/or replacement
User can call up
any assistance
anywhere
Developers’
Space
Consumers
& Experts
Connection
Service
Creation Tools
GPII
Unified Listing
& Marketplace
Micro-Finance
Micro-Payment
Infrastructure
Free & commercial
parts to speed dev,
and lower costs
Experts, consumers,
testers etc to help
new developers
To make it easy to
Create AOD, Media,
& Material service
Developers can
quickly, efficiently
market worldwide
Mechanism for
Financing R&D
and Service Del
Find all solutions, AT
& Mainstream
device / feature / service
Shopping
Aid
Users can use their
profile to find just
what helps them

5. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
User Listeners
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Match Makers
Transformer
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
Basic Architecture
Limited Intelligence

6. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Arrows show general information
flow.
Preferences Server
Context rules
Match Makers
Transformer
N&P Ontology
N&P Ontology
Solutions Ontology
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
Adding Context and
Semantics Allows
Increased
Matchmaking
Intelligence

7. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
N&P Ontology
N&P Ontology
Solutions Ontology
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
A Personal
Control Panel
Allows users
real time
control of
their settings

8. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
N&P Ontology
N&P Ontology
Solutions Ontology
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
Which can also
(if the user
chooses)
change their
stored
preferences
for this context

9. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
The Matchmaker
can offer options
to the user
––––
The user can also
make decisions on
how it wants the
matchmaker to
operate

10. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
Now where did that Solutions
Registry come from ?

11. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
(AT only )
(AT + Mainstream)
AT
Other DBs
Mainstream
Global Solution
Registry
(Unified Listing)
GARI
Phone DB
(Mainstream)
Solutions

12. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
Settings
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
(AT only )
(AT + Mainstream)
AT
Other DBs
Mainstream
Global Solution
Registry
(Unified Listing)
GARI
Phone DB
(Mainstream)
Solutions
But Cloud4all/GPII will also match users
and different Media and Materials

13. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
GARI
Phone DB
(Mainstream)
Solutions
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources

14. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
GARI
Phone DB
(Mainstream)
Solutions
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
And we need tools to maintain the
metadata (semantics) for all of these.

15. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools

16. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
We also need a
way to create
(and edit)
User Needs &
Preferences Sets

17. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools

18. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
And, as is true
anytime you want
many entities to
communicate
effectively – we need
a common vocabulary.

19. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

20. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

21. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
Solutions Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Materials Ontology
(AT only )
Global Solution
Registry
(Unified Listing)
(AT + Mainstream)
AT
Other DBs
Mainstream
Other Ontologies
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

22. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Synthesized
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Service
Synth Tool
(AT only )
Global Solution
Registry
(Unified Listing)
Mainstream
Materials Ontology
Other Ontologies
(AT + Mainstream)
AT
Other DBs
Solutions Ontology
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

23. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Synthesized
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Service
Synth Tool
(AT only )
Global Solution
Registry
(Unified Listing)
Mainstream
Materials Ontology
Other Ontologies
(AT + Mainstream)
AT
Other DBs
Solutions Ontology
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

24. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Synthesized
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Spinal Matchmaker
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Service
Synth Tool
(AT only )
Global Solution
Registry
(Unified Listing)
Mainstream
Materials Ontology
Other Ontologies
(AT + Mainstream)
AT
Other DBs
Solutions Ontology
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

25. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Synthesized
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Spinal Matchmaker
Match Makers
Transformer
Management Options
N&P Ontology
N&P Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
Service
Synth Tool
(AT only )
Global Solution
Registry
(Unified Listing)
Mainstream
Materials Ontology
Other Ontologies
(AT + Mainstream)
AT
Other DBs
Solutions Ontology
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry

26. Real-time Components
Solutions
Installed
Network &
download
Lifecycle
Handlers
User Listeners
Legend:
User Interfaces
Not Cloud4all Funded
GPII project but not Cloud4all
Environment
Reporter
Device Reporter
Lifecycle
Manager
Settings
Handlers
Flow Manager
(local Solutions registry)
Arrows show general information
flow.
Preferences Server
Synthesized
Personal Control Panel
(includes Options /Suggestions UI and
ability to launch NP Editor)
Context rules
Spinal Matchmaker
Match Makers
Transformer
Kind of like a car.
Management Options
N&P Ontology
N&P Ontology
EASTIN
GROUP DBs
EASTIN+
Federation
It takes a lot of pieces to make
It takes a lot of pieces to make
a car simple to operate.
a car simple to operate.
Service
Synth Tool
(AT only )
Global Solution
Registry
(Unified Listing)
Mainstream
Materials Ontology
Other Ontologies
(AT + Mainstream)
AT
Other DBs
Solutions Ontology
GARI
Phone DB
(Mainstream)
Mainstream Data
Maintenance
Solutions
Common
Terms
Viewer/Editor
AT Data Maintenance
Federated
Search &
Delivery of
MM&R Metadata
Media, Materials & Resources
Manual Metadata
Generation Tools
Metadata AutoGeneration Tools
Semantic Tools
Common Terms
Registry