Automatic mapping of motivational text messages into ontological entities for smart coaching applications

•

2 gefällt mir•318 views

Unwholesome lifestyles can reduce lifespan by several years or even decades. Therefore, raising awareness and promoting healthier behaviors prove essential to revert this dramatic panorama. Virtual coaching systems are at the forefront of digital solutions to educate people and procure a more effective health self-management. Despite their increasing popularity, virtual coaching systems are still regarded as entertainment applications with an arguable efficacy for changing behaviors, since messages can be perceived to be boring, unpersonalized and can become repetitive over time. In fact, messages tend to be quite general, repetitive and rarely tailored to the specific needs, preferences and conditions of each user. In the light of these limitations, this work aims at help building a new generation of methods for automatically generating user-tailored motivational messages. While the creation of messages is addressed in a previous work, in this paper the authors rather present a method to automatically extract the semantics of motivational messages and to create the ontological representation of these messages. The method uses first natural language processing to perform a linguistic analysis of the message. The extracted information is then mapped to the concepts of the motivational messages ontology. The proposed method could boost the quantity and diversity of messages by automatically mining and parsing existing messages from the internet or other digitised sources, which can be later tailored according to the specific needs and particularities of each user.

Wissenschaft

AUTOMATIC MAPPING OF
MOTIVATIONAL TEXT MESSAGES INTO
ONTOLOGICAL ENTITIES FOR SMART
COACHING APPLICATIONS
C. VILLALONGA(*), H. OP DEN AKKER, H. HERMENS, L.J. HERRERA, H. POMARES, I. ROJAS,
O. VALENZUELA, O. BANOS
(*) claudia.villalonga@unir.net

23/3/18 2
E-COACHING
WHY IS IT THAT CHALLENGING?
 Major efforts have been mainly targeted
at improving the quantification part
(oversimplification vs exaggeration)
 “Generic” motivational messages (one-
size-does-not-fit-all)
 Shallow recommendations (explanation
of goals, how to reach them,
implications, etc.)
 We are still learning…

23/3/18 3
MOTIVATIONAL MESSAGES FOR E-COACHING
MAIN CHALLENGES
 Represent the principal, and perhaps more natural,
means for translating behavioral findings into easy-to-
follow and realizable recommendations (actions)
 KEY challenges:
 Generation of relevant messages tailored to the
performance, needs and characteristics of each
specific user [Noar2007]
 Fostering the diversity of the messages to
increase adherence and make the coaching system
more realistic and trustworthy [opdenAkker2015]
Noar et al. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychological bulletin 133, 4 (2007),
673.
op den Akker et al.Tailored motivational message generation: A model and practical framework for real-time physical activity coaching. Journal of
Biomedical Informatics 55 (2015), 104-115.

23/3/18 4
FRAMEWORK OF MOTIVATIONAL MESSAGES
PROPOSED SOLUTION

23/3/18 5
FRAMEWORK OF MOTIVATIONAL MESSAGES
MOTIVATIONAL MESSAGE ONTOLOGY
“You should walk the dog to the park early in the morning”

23/3/18 6
FRAMEWORK OF MOTIVATIONAL MESSAGES
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
“You should walk the dog to the park early in the morning”
Automatic Mapping

23/3/18 7
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
LINGUISTIC ANALYSIS
“You should walk the dog to the park early in the morning”
predicatesubject
Part of
Speech
pronoun
verb
verb
article
article
article
noun
noun
noun
adverb
preposition
preposition
Grammatical
Structure
object modifiermodifier

23/3/18 8
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
LINGUISTIC ANALYSIS
“You should walk the dog to the park early in the morning”
predicatesubject
pronoun
verb
verb
article
article
article
noun
noun
noun
adverb
preposition
preposition
object modifiermodifier
ACTION LOCATION TIMEELEMENT

23/3/18 9
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
ONTOLOGICAL REPRESENTATION
ACTION PLACE TIMEELEMENT
“You should walk the dog to the park early in the morning”

23/3/18 10
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
ONTOLOGICAL REPRESENTATION
“You should walk the dog to the park early in the morning”
TIME
ACTION
ELEMENT
PLACE

23/3/18 11
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
MESSAGE SPLITTING
“Walk or run to the park!”
“Walk to the park!” “Run to the park!”

23/3/18 12
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
MESSAGE INFERENCE
“Why don’t you go to the gym and practice some exercise?”
“Why don’t you go to the park and practice some exercise?”
Ontology reasoning

23/3/18 13
AUTOMATIC MAPPING OF MOTIVATIONAL TEXT MESSAGES
IMPLEMENTATION
 Java Implementation
 Stanford CoreNLP
 Apache Jena (v2.11.2)

23/3/18 14
CONCLUSIONS
This work contributes with:
 A new approach for automatically extracting the semantics of motivational
messages and creating the ontological representation of these messages
Future work:
 Evaluation of the message mapping method
 Improvement of the method to infer new messages based on the
knowledge modeled in the ontology
 Extension of the motivational message ontology to include more concepts
by linking available ontologies and thesaurus
 Implementation of the message retrieval method to have a fully functional
framework for the automatic generation of tailored coaching messages

23/3/18 15
Thank you!
Questions?
This project has received funding from the European Union’s Horizon 2020 research
and innovation programme under grant agreement No 769553.

Weitere ähnliche Inhalte

Mehr von Oresti Banos

In the last decade, mobile health (mHealth) has developed as a natural consequence of the advances in mobile technologies, the growing spread of mobile devices, and their application in the provision of novel health services. mHealth has demonstrated the potential to make the health care sector more efficient and sustainable and to increase the healthcare quality. Considering the boost to the healthcare area which will be provided by mHealth, many organizations and governments have engaged in innovating in this area. In this context, this work investigated the role of innovation in the area of mHealth for patient monitoring in order to determine the trends and the performance of the innovation activities in this domain. Proxy indicators, like intellectual property statistics and scientific publication statistics, were utilized to measure the outputs of innovation during the period of time from 2006 to 2015 in Europe. Two studies were performed to provide quantitative measures for the indicators measuring innovation outputs in the domain of mHealth for patient monitoring and three main conclusions were observed. First, even if there was a lot of research in Europe in mHealth for patient monitoring, the vast majority of the enterprises did not protect their inventions. Second, a strong research collaboration in the area of mHealth for patient monitoring took place between researchers affiliated to institutions of different European countries and even with researchers working in Asian or American institutions. Finally, an increasing trend on the number of published articles about mHealth for patient monitoring was identified. Therefore, the findings of the studies demonstrated the great interest that has arisen the field of mHealth and the huge involvement in innovation activities in the area of mHealth for patient monitoring.

Analysis of the Innovation Outputs in mHealth for Patient Monitoring

Oresti Banos

The evaluation of cancer patients’ recovery is still under the big subjectivity of physicians. Many different systems have been successfully implemented for physical activity evaluation, nonetheless there is still a big leap into Performance Status evaluation with ECOG and Karnofsky’s Performance Status scores. An automatic system for data recovering based on Android smartphone and wearables has been developed. A gamification implementation has been designed for increasing patients’ motivation in their recovery. Furthermore, novel and without-precedent algorithms for Performance Status (PS) and Physical Activity (PA) assessment have been developed to help oncologists in their diagnoses.

First Approach to Automatic Performance Status Evaluation and Physical Activi...

Oresti Banos

Knee alignment measurements are one of the most extended indicators of knee-complex injuries such as anterior cruciate ligament injury and patellofemoral pain syndrome. The Frontal Plane Projection Angle (FPPA) is widely used as a 2-D estimation of knee alignment. How- ever, traditional procedures to measure this angle suffer from practical limitations, which leads to huge time investments when evaluating multiple subjects. This work presents a novel video analysis system aimed at supporting experts in the dynamic measurement of the FPPA in a cost-effective and easy way. The system employs Kinect V2 depth sensor to track reflective markers attached to the patient leg joints to provide an automatic estimation of the angle formed by the hip, knee and ankle joints. Information registered by the sensor is processed and managed by a computer application that simplifies expert’s work and expedites the analysis of the test results.

First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...

Oresti Banos

This work presents the Mining Minds Context Ontology, an ontology for the identification of human behavior. This ontology comprehensively models high-level context based on low-level information, including the user activities, locations, and emotions. The Mining Minds Context Ontology is the means to infer high-level context from the low-level information. High-level contexts can be inferred from unclassified contexts by reasoning on the Mining Minds Context Ontology. The Mining Minds Context Ontology is shown to be flexible enough to operate in real life scenarios in which emotion recognition systems may not always be available. Furthermore, it is demonstrated that the activity and the location might not be enough to detect some of the high-level contexts, and that the emotion enables a more accurate high-level context identification. This work paves the path for the future implementation of the high-level context recognition system in the Mining Minds project.

High-Level Context Inference for Human Behavior Identication

Oresti Banos

There exist multiple activity recognition solutions offering good results under controlled conditions. However, little attention has been given to the development of functional systems operating in realistic settings. In that vein, this work aims at presenting the complete process for the design, implementation and evaluation of a real-time activity recognition system. The proposed recognition system consists of three wearable inertial sensors used to register the user body motion, and a mobile application to collect and process the sensory data for the recognition of the user activity. The system not only shows good recognition capabilities after online evaluation but also after analysis at runtime. In view of the obtained results, this system may serve for the recognition of some of the most frequent daily physical activities.

On the Development of A Real-Time Multi-Sensor Activity Recognition System

Oresti Banos

Trunk endurance tests are widely used in physical medicine to assess the muscle status of people affected by low back pain. Nevertheless, traditional evaluation procedures suffer from practical limitations, which can lead to potential misdiagnoses. This work presents mDurance, a novel mobile health system aimed at supporting specialists in the functional assessment of trunk endurance by using wearable and mobile devices. The system makes use of a wearable inertial sensor to track the patient trunk posture, while portable electromyography sensors are employed to seamlessly measure the electrical activity produced by the trunk muscles. The information registered by the sensors is processed and managed by a mobile application that facilitates the expert normal routine, while reducing the impact of human errors and expediting the analysis of the test results. The reliability and usability of mDurance is proved through a case study, thus demonstrating its potential interest for regular physical therapy routines.

Facilitating Trunk Endurance Assessment by means of Mobile Health Technologies

Oresti Banos

The monitoring of human lifestyles has gained much attention in the recent years. This work presents a novel approach to combine multiple context-awareness technologies for the automatic analysis of people’s conduct in a comprehensive and holistic manner. Activity recognition, emotion recognition, location detection, and social analysis techniques are integrated with ontological mechanisms as part of a framework to identify human behavior. Key architectural components, methods and evidences are described in this paper to illustrate the interest of the proposed approach.

Mining Human Behavior for Health Promotion

Oresti Banos

The recognition of human activity has been extensively investigated in the last decades. Typically, wearable sensors are used to register body motion signals that are analyzed by following a set of signal processing and machine learning steps to recognize the activity performed by the user. One of the most important steps refers to the signal segmentation, which is mainly performed through windowing approaches. In fact, it has been proved that the choice of window size directly conditions the performance of the recognition system. Thus, instead of limiting to a specific window configuration, this work proposes the use of multiple recognition systems operating on multiple window sizes. The suggested model employs a weighted decision fusion mechanism to fairly leverage the potential yielded by each recognition system based on the target activity set. This novel technique is benchmarked on a well-known activity recognition dataset. The obtained results show a significant improvement in terms of performance with respect to common systems operating on a single window size.

Multiwindow Fusion for Wearable Activity Recognition

Oresti Banos

The world is witnessing a spectacular shift in the delivery of health and wellness care. The key ingredient of this transformation consists in the use of revolutionary digital technologies to empower people in their self-management as well as to enhance traditional care procedures. While substantial domain-specific contributions have been provided to that end in the recent years, there is a clear lack of platforms that may orchestrate, and intelligently leverage, all the data, information and knowledge generated through these technologies. This work presents Mining Minds, an innovative framework that builds on the core ideas of the digital health and wellness paradigms to enable the provision of personalized healthcare and wellness support. Mining Minds embraces some of the currently most prominent digital technologies, ranging from Big Data and Cloud Computing to Wearables and Internet of Things, and state-of-the-art concepts and methods, such as Context-Awareness, Knowledge Bases or Analytics, among others. This paper aims at thoroughly describing the efficient and rational combination and interoperation of these modern technologies and methods through Mining Minds, while meeting the essential requirements posed by a framework for personalized health and wellness support.

Mining Minds: an innovative framework for personalized health and wellness su...

Oresti Banos

This paper presents a novel watermarking scheme for authentication of digital color images in social networks. The procedure consists of the embedding of a binary watermark image, containing the owner information, into the image to be authenticated. In order to minimize the artifacts in the host image the process is carried out in the wavelets domain. Concretely, the watermark embedding is performed in the HL4 and LH4 sub-band coefficients of the red, green and blue channels of the original image, based on an optimal channel selection quantization technique. To ensure a high robustness to tampering and malicious attacks a key-based pixel shuffling mechanism is further used. The reverse process is likewise identified for the extraction of the watermark from the authenticated image. Both embedding and extraction procedures are benchmarked on diverse color images and under the effects of different types of attacks, including geometric, non-geometric, and JPEG compression transformations. The proposed scheme proves to support imperceptible watermarking, while also showing a high resiliency to common image processing operations.

A Novel Watermarking Scheme for Image Authentication in Social Networks

Oresti Banos

Mobile health is an emerging field which is attracting much attention. Nevertheless, tools for the development of mobile health applications are lacking. This work presents mHealthDroid, an open source Android implementation of a mHealth Framework designed to facilitate the rapid and easy development of biomedical apps. The framework is devised to leverage the potential of mobile devices like smartphones or tablets, wearable sensors and portable biomedical devices. The framework provides functionalities for resource and communication abstraction, biomedical data acquisition, health knowledge extraction, persistent data storage, adaptive visualization, system management and value-added services such as intelligent alerts, recommendations and guidelines.

mHealthDroid: a novel framework for agile development of mobile health appli...

Oresti Banos

Sistema automático para la estimación de la presión arterial a partir de pará...

Oresti Banos

Diseño e implementación de técnicas de monitorización indoor en e-salud

Oresti Banos

Reconocimiento automático de la actividad física diaria aplicado a contextos ...

Oresti Banos

So far little attention has been paid to activity recognition systems limitations during out-of-lab daily usage. Sensor displacement is one of these major issues, particularly deleterious for inertial on-body sensing. The effect of the displacement normally translates into a drift on the signal space that further propagates to the feature level, thus modifying the expected behavior of the predened recognition systems. On the use of several sensors and diverse motion-sensing modalities, in this paper we compare two fusion methods to evaluate the importance of decoupling the combination process at feature and classication levels under realistic sensor congurations. In particular a 'feature fusion' and a 'multi-sensor hierarchical-classifier' are considered. The results reveal that the aggregation of sensor-based decisions may overcome the difficulties introduced by the displacement and confirm the gyroscope as possibly the most displacement-robust sensor modality. This presentation illustrates part of the work described in the following articles: * Banos, O., Damas, M., Pomares, H., Rojas, I.: Handling displacement effects in on-body sensor-based activity recognition. In: Proceedings of the 5th International Work-conference on Ambient Assisted Living an Active Ageing (IWAAL 2013), San José, Costa Rica, December 2-6, (2013) * Banos, O., Damas, M., Pomares, H., Rojas, I. On the Use of Sensor Fusion to Reduce the Impact of Rotational and Additive Noise in Human Activity Recognition. Sensors, vol. 12, no. 6, pp. 8039-8054 (2012)

Handling displacement effects in on-body sensor-based activity recognition

Oresti Banos

Ensuring ubiquity, robustness and continuity of monitoring is of key importance in activity recognition. To that end, multiple sensor congurations and fusion techniques are ever more used. In this paper we present a multi-sensor meta-classier that aggregates the knowledge of several sensor-based decision entities to provide a unique and reliable activity classication. This model introduces a new weighting scheme which improves the rating of the impact that each entity has on the decision fusion process. Sensitivity and specicity are particularly considered as insertion and rejection weighting metrics instead of the overall accuracy classication performance proposed in a previous work. For the sake of comparison, both new and previous weighting models together with feature fusion models are tested on an extensive activity recognition benchmark dataset. The results demonstrate that the new weighting scheme enhances the decision aggregation thus leading to an improved recognition system. This presentation illustrates part of the work described in the following articles: * Banos, O., Damas, M., Pomares, H., Rojas, F., Delgado-Marquez, B. & Valenzuela, O. Human activity recognition based on a sensor weighting hierarchical classifier. Soft Computing - A Fusion of Foundations, Methodologies and Applications, Springer Berlin / Heidelberg, vol. 17, pp. 333-343 (2013) * Banos, O., Damas, M., Pomares, H., Rojas, I.: Activity recognition based on a multi-sensor meta-classifier. In: Proceedings of the 2013 International Work Conference on Neural Networks (IWANN 2013), Tenerife, Spain, June 12-14, (2013)

Activity recognition based on a multi-sensor meta-classifier

Oresti Banos

This work introduces an open benchmark dataset to investigate inertial sensor displacement effects in activity recognition. While sensor position displacements such as rotations and translations have been recognised as a key limitation for the deployment of wearable systems, a realistic dataset is lacking. We introduce a concept of gradual sensor displacement conditions, including ideal, self-placement of a user, and mutual displacement deployments. These conditions were analysed in the dataset considering 33 fitness activities, recorded using 9 inertial sensor units from 17 participants. Our statistical analysis of acceleration features quantified relative effects of the displacement conditions. We expect that the dataset can be used to benchmark and compare recognition algorithms in the future. This presentation illustrates part of the work described in the following article: * Banos, O., Toth, M. A., Damas, M., Pomares, H., Rojas, I., Amft, O.: A benchmark dataset to evaluate sensor displacement in activity recognition. In: Proceedings of the 14th International Conference on Ubiquitous Computing (Ubicomp 2012), Pittsburgh, USA, September 5-8, (2012)

A benchmark dataset to evaluate sensor displacement in activity recognition

Oresti Banos

The analysis of daily living human behavior has proven to be of key importance to prevent unhealthy habits. The diversity of activities and the individuals’ particular execution style determine that several sources of information are normally required. One of the main issues is to optimally combine them to guarantee performance, scalability and robustness. In this paper we present a fusion classification methodology which takes into account the potential of the individual decisions yielded at both activity and sensor classification levels. Particularly tested on a wearable sensors based system, the method reinforces the idea that some parts of the body (i.e., sensors) may be specially informative for the recognition of each particular activity, thus supporting the ranking of the decisions provided by each associated sensor decision entity. Our method systematically outperforms the results obtained by traditional multiclass models which otherwise may require a high-dimensional feature space to acquire a similar performance. The comparison with other activity-recognition fusion approaches also demonstrates our model scales significantly better for small sensor networks. This presentation illustrates part of the work described in the following articles: * Banos, O., Damas, M., Pomares, H., Rojas, F., Delgado-Marquez, B. & Valenzuela, O. Human activity recognition based on a sensor weighting hierarchical classifier. Soft Computing - A Fusion of Foundations, Methodologies and Applications, Springer Berlin / Heidelberg, vol. 17, pp. 333-343 (2013) * Banos, O., Damas, M., Pomares, H., Rojas, I.: Recognition of Human Physical Activity based on a novel Hierarchical Weighted Classification scheme. In: Proceedings of the 2011 International Joint Conference on Neural Networks (IJCNN 2011), IEEE, San José, California, July 31- August 5, (2011)

Recognition of Human Physical Activity based on a novel Hierarchical Weighted...

Oresti Banos

Mehr von Oresti Banos (18)