SlideShare ist ein Scribd-Unternehmen logo
1 von 2
Downloaden Sie, um offline zu lesen
Automated visual evaluation (AVE) is a promising
technology that uses a machine learning (ML)
classifier to predict the likelihood of pathology in a
cervical image. AVE is accurate, fast, and
inexpensive, and thus it has tremendous potential.
Because AVE is based on ML and not an in vitro
assay, very little is known about which features
affect its performance, and which do not.
Introduction Methods Results
Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia
TAP TO RETURN
TO KIOSK MENU
This analysis examines the performance of AVE
under different imaging conditions. There are 2
types of analyses presented. In one type of
analysis, the images are modified by a specific
effect through image processing and manipulation,
and the performance drop off is measured. The
other analysis involves grouping image metadata
and comparing different sub-cohorts.
The goal of this study is to characterize which
imaging features AVE is sensitive to. The analysis
was done on a global set of images collected by
users of the Enhanced Visual Assessment (EVA)
System across the globe.
KC Fernandes1, T Freitas1, Y Zall2, R Nissim2, D Levitz2
1 NILG.ai, Porto, Portugal; 2 MobileODT Ltd., Tel Aviv, Israel
AUC = 0.87
AUC = 0.85
AUC = 0.875
1- spec
Recall (Sens)
SensPrecision(PPV)
A data set comprising of images from N=202
patients (72 abnormal, 130 normal) was used for
testing an AVE classifier. The global distribution
of data, as well as base classifier performance,
are shown below.
ROC curve
Precision – Recall (PR) curve
ROCAUC
ROCAUC
ROCAUC
Effect size
Effect size
Effect size
Effect size
Effect size
Effect size
The 3 most relevant augmentation analyses are shown below. On the left are examples of an effect of
different sizes on a handful of images. On the right is the corresponding drop in the area under the (ROC
– Receiver Operating Characteristic) curve (AUC). Note the effect chart on left corresponds to white area
in graphs. Gray regions correspond to images far outside the expected range, with little information.
Additional augmentation analyses Statistical distribution analyses
CONCLUSIONS
Funding
This study was funded by MobileODT.
Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia
KC Fernandes1, T Freitas1, Y Zall2, R Nissim2, D Levitz2
1 NILG.ai, Porto, Portugal; 2 MobileODT Ltd., Tel Aviv, Israel
AfricaAsia
Samsung J500 (EVA 3.0) Samsung J530 (EVA 3 Plus)
Cervix Translation Cervix Rotation
Bounding box expansion Bounding box contraction
Shear Cervix flip
Frequent vs. rare users
The AVE classifier tested is very sensitive to blur,
moderately sensitive to background lighting and
shadows, and not sensitive to translations, rotations,
scaling, shear, and flips. These results were
expected.
The AVE classifier is also sensitive to phone model
and geography. However, the 2 parameters cannot
be isolated in the current data set. Additionally, the
AVE classifier is sensitive to the frequency of usage,
with better performance on common users, as
opposed to rate users.
These tests and results should be considered when
training and testing new AVE classifiers.
Augmentation analyses showing affine transformations did
not influence the AVE prediction scores
A comparison of the probability density functions (PDFs) of AVE prediction scores for different
geographies and phone models. These results suggest that the classifier distinguishes between
normal, and 2 types of abnormals – those from Africa (Samsung J530) and those from Asia
(Samsung J500). Moreover, this suggests a correlation between phone model and geography
Frequent and rare users also
have very different ROC curves.

Weitere ähnliche Inhalte

Ähnlich wie Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia

U-Net transfer learning backbones for lesions segmentation in breast ultrasou...
U-Net transfer learning backbones for lesions segmentation in breast ultrasou...U-Net transfer learning backbones for lesions segmentation in breast ultrasou...
U-Net transfer learning backbones for lesions segmentation in breast ultrasou...IJECEIAES
 
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET-  	  Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET-  	  Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET- Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET Journal
 
Reject film Analysis
Reject film AnalysisReject film Analysis
Reject film Analysissunil seksana
 
White Paper, Esaote VNAV in Endocrinology
White Paper, Esaote VNAV in EndocrinologyWhite Paper, Esaote VNAV in Endocrinology
White Paper, Esaote VNAV in EndocrinologyMIDEAS
 
Ultrasound image segmentation through deep learning based improvised U-Net
Ultrasound image segmentation through deep learning based  improvised U-NetUltrasound image segmentation through deep learning based  improvised U-Net
Ultrasound image segmentation through deep learning based improvised U-Netnooriasukmaningtyas
 
PRESENTATION-Zain - Copy.pptx
PRESENTATION-Zain - Copy.pptxPRESENTATION-Zain - Copy.pptx
PRESENTATION-Zain - Copy.pptxssuser17040e
 
Comparison of filtering and
Comparison of filtering andComparison of filtering and
Comparison of filtering andcsandit
 
Comparison of filtering and
Comparison of filtering andComparison of filtering and
Comparison of filtering andcsandit
 
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...Associate Professor in VSB Coimbatore
 
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSING
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSINGRETINA DISEASE IDENTIFICATION USING IMAGE PROCESSING
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSINGIRJET Journal
 
IRJET- Real-Time Partial Face Occlusion Detection using Matlab
IRJET-	 Real-Time Partial Face Occlusion Detection using MatlabIRJET-	 Real-Time Partial Face Occlusion Detection using Matlab
IRJET- Real-Time Partial Face Occlusion Detection using MatlabIRJET Journal
 
Segmentation and Registration of OARs in HaN Cancer
Segmentation and Registration of OARs in HaN CancerSegmentation and Registration of OARs in HaN Cancer
Segmentation and Registration of OARs in HaN CancerIRJET Journal
 
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...IRJET Journal
 
IEEE Medical image Title and Abstract 2016
IEEE Medical image Title and Abstract 2016 IEEE Medical image Title and Abstract 2016
IEEE Medical image Title and Abstract 2016 tsysglobalsolutions
 
Automated Cervicography Using a Machine Learning Classifier
Automated Cervicography Using a Machine Learning ClassifierAutomated Cervicography Using a Machine Learning Classifier
Automated Cervicography Using a Machine Learning ClassifierMobileODT
 
IRJET- Survey on Detection of Cervical Cancer
IRJET- Survey on Detection of Cervical CancerIRJET- Survey on Detection of Cervical Cancer
IRJET- Survey on Detection of Cervical CancerIRJET Journal
 
IRJET- Unsupervised Detecting and Locating of Gastrointestinal Anomalies
IRJET-  	  Unsupervised Detecting and Locating of Gastrointestinal AnomaliesIRJET-  	  Unsupervised Detecting and Locating of Gastrointestinal Anomalies
IRJET- Unsupervised Detecting and Locating of Gastrointestinal AnomaliesIRJET Journal
 
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...cscpconf
 
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...csandit
 

Ähnlich wie Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia (20)

U-Net transfer learning backbones for lesions segmentation in breast ultrasou...
U-Net transfer learning backbones for lesions segmentation in breast ultrasou...U-Net transfer learning backbones for lesions segmentation in breast ultrasou...
U-Net transfer learning backbones for lesions segmentation in breast ultrasou...
 
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET-  	  Retinal Fundus Image Segmentation using Watershed AlgorithmIRJET-  	  Retinal Fundus Image Segmentation using Watershed Algorithm
IRJET- Retinal Fundus Image Segmentation using Watershed Algorithm
 
Reject film Analysis
Reject film AnalysisReject film Analysis
Reject film Analysis
 
White Paper, Esaote VNAV in Endocrinology
White Paper, Esaote VNAV in EndocrinologyWhite Paper, Esaote VNAV in Endocrinology
White Paper, Esaote VNAV in Endocrinology
 
Ultrasound image segmentation through deep learning based improvised U-Net
Ultrasound image segmentation through deep learning based  improvised U-NetUltrasound image segmentation through deep learning based  improvised U-Net
Ultrasound image segmentation through deep learning based improvised U-Net
 
PRESENTATION-Zain - Copy.pptx
PRESENTATION-Zain - Copy.pptxPRESENTATION-Zain - Copy.pptx
PRESENTATION-Zain - Copy.pptx
 
Comparison of filtering and
Comparison of filtering andComparison of filtering and
Comparison of filtering and
 
Comparison of filtering and
Comparison of filtering andComparison of filtering and
Comparison of filtering and
 
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...
Computer Aided Diagnosis For Retinal Lesion Detection Based on Adaptive Boost...
 
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSING
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSINGRETINA DISEASE IDENTIFICATION USING IMAGE PROCESSING
RETINA DISEASE IDENTIFICATION USING IMAGE PROCESSING
 
13 influence of corneal volume
13 influence of corneal volume13 influence of corneal volume
13 influence of corneal volume
 
IRJET- Real-Time Partial Face Occlusion Detection using Matlab
IRJET-	 Real-Time Partial Face Occlusion Detection using MatlabIRJET-	 Real-Time Partial Face Occlusion Detection using Matlab
IRJET- Real-Time Partial Face Occlusion Detection using Matlab
 
Segmentation and Registration of OARs in HaN Cancer
Segmentation and Registration of OARs in HaN CancerSegmentation and Registration of OARs in HaN Cancer
Segmentation and Registration of OARs in HaN Cancer
 
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...
IRJET -An Automatated Learning Approach for Detection of Diabetic Retinopathy...
 
IEEE Medical image Title and Abstract 2016
IEEE Medical image Title and Abstract 2016 IEEE Medical image Title and Abstract 2016
IEEE Medical image Title and Abstract 2016
 
Automated Cervicography Using a Machine Learning Classifier
Automated Cervicography Using a Machine Learning ClassifierAutomated Cervicography Using a Machine Learning Classifier
Automated Cervicography Using a Machine Learning Classifier
 
IRJET- Survey on Detection of Cervical Cancer
IRJET- Survey on Detection of Cervical CancerIRJET- Survey on Detection of Cervical Cancer
IRJET- Survey on Detection of Cervical Cancer
 
IRJET- Unsupervised Detecting and Locating of Gastrointestinal Anomalies
IRJET-  	  Unsupervised Detecting and Locating of Gastrointestinal AnomaliesIRJET-  	  Unsupervised Detecting and Locating of Gastrointestinal Anomalies
IRJET- Unsupervised Detecting and Locating of Gastrointestinal Anomalies
 
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...
Discovering Abnormal Patches and Transformations of Diabetics Retinopathy in ...
 
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...
DISCOVERING ABNORMAL PATCHES AND TRANSFORMATIONS OF DIABETICS RETINOPATHY IN ...
 

Kürzlich hochgeladen

EXERCISE PERFORMANCE.pptx, Lung function
EXERCISE PERFORMANCE.pptx, Lung functionEXERCISE PERFORMANCE.pptx, Lung function
EXERCISE PERFORMANCE.pptx, Lung functionkrishnareddy157915
 
High-Performance Thin-Layer Chromatography (HPTLC)
High-Performance Thin-Layer Chromatography (HPTLC)High-Performance Thin-Layer Chromatography (HPTLC)
High-Performance Thin-Layer Chromatography (HPTLC)kishan singh tomar
 
pA2 value, Schild plot and pD2 values- applications in pharmacology
pA2 value, Schild plot and pD2 values- applications in pharmacologypA2 value, Schild plot and pD2 values- applications in pharmacology
pA2 value, Schild plot and pD2 values- applications in pharmacologyDeepakDaniel9
 
AORTIC DISSECTION and management of aortic dissection
AORTIC DISSECTION and management of aortic dissectionAORTIC DISSECTION and management of aortic dissection
AORTIC DISSECTION and management of aortic dissectiondrhanifmohdali
 
MedMatch: Your Health, Our Mission. Pitch deck.
MedMatch: Your Health, Our Mission. Pitch deck.MedMatch: Your Health, Our Mission. Pitch deck.
MedMatch: Your Health, Our Mission. Pitch deck.whalesdesign
 
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdf
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdfSGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdf
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdfHongBiThi1
 
historyofpsychiatryinindia. Senthil Thirusangu
historyofpsychiatryinindia. Senthil Thirusanguhistoryofpsychiatryinindia. Senthil Thirusangu
historyofpsychiatryinindia. Senthil Thirusangu Medical University
 
Different drug regularity bodies in different countries.
Different drug regularity bodies in different countries.Different drug regularity bodies in different countries.
Different drug regularity bodies in different countries.kishan singh tomar
 
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdf
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdfPAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdf
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdfDolisha Warbi
 
Trustworthiness of AI based predictions Aachen 2024
Trustworthiness of AI based predictions Aachen 2024Trustworthiness of AI based predictions Aachen 2024
Trustworthiness of AI based predictions Aachen 2024EwoutSteyerberg1
 
Basic structure of hair and hair growth cycle.pptx
Basic structure of hair and hair growth cycle.pptxBasic structure of hair and hair growth cycle.pptx
Basic structure of hair and hair growth cycle.pptxkomalt2001
 
Clinical Research Informatics Year-in-Review 2024
Clinical Research Informatics Year-in-Review 2024Clinical Research Informatics Year-in-Review 2024
Clinical Research Informatics Year-in-Review 2024Peter Embi
 
Role of Soap based and synthetic or syndets bar
Role of  Soap based and synthetic or syndets barRole of  Soap based and synthetic or syndets bar
Role of Soap based and synthetic or syndets barmohitRahangdale
 
Pharmacokinetic Models by Dr. Ram D. Bawankar.ppt
Pharmacokinetic Models by Dr. Ram D.  Bawankar.pptPharmacokinetic Models by Dr. Ram D.  Bawankar.ppt
Pharmacokinetic Models by Dr. Ram D. Bawankar.pptRamDBawankar1
 
power point presentation of Clinical evaluation of strabismus
power point presentation of Clinical evaluation  of strabismuspower point presentation of Clinical evaluation  of strabismus
power point presentation of Clinical evaluation of strabismusChandrasekar Reddy
 
Female Reproductive Physiology Before Pregnancy
Female Reproductive Physiology Before PregnancyFemale Reproductive Physiology Before Pregnancy
Female Reproductive Physiology Before PregnancyMedicoseAcademics
 
Using Data Visualization in Public Health Communications
Using Data Visualization in Public Health CommunicationsUsing Data Visualization in Public Health Communications
Using Data Visualization in Public Health Communicationskatiequigley33
 
SGK ĐIỆN GIẬT ĐHYHN RẤT LÀ HAY TUYỆT VỜI.pdf
SGK ĐIỆN GIẬT ĐHYHN        RẤT LÀ HAY TUYỆT VỜI.pdfSGK ĐIỆN GIẬT ĐHYHN        RẤT LÀ HAY TUYỆT VỜI.pdf
SGK ĐIỆN GIẬT ĐHYHN RẤT LÀ HAY TUYỆT VỜI.pdfHongBiThi1
 
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdf
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdfSGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdf
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdfHongBiThi1
 

Kürzlich hochgeladen (20)

EXERCISE PERFORMANCE.pptx, Lung function
EXERCISE PERFORMANCE.pptx, Lung functionEXERCISE PERFORMANCE.pptx, Lung function
EXERCISE PERFORMANCE.pptx, Lung function
 
Rheumatoid arthritis Part 1, case based approach with application of the late...
Rheumatoid arthritis Part 1, case based approach with application of the late...Rheumatoid arthritis Part 1, case based approach with application of the late...
Rheumatoid arthritis Part 1, case based approach with application of the late...
 
High-Performance Thin-Layer Chromatography (HPTLC)
High-Performance Thin-Layer Chromatography (HPTLC)High-Performance Thin-Layer Chromatography (HPTLC)
High-Performance Thin-Layer Chromatography (HPTLC)
 
pA2 value, Schild plot and pD2 values- applications in pharmacology
pA2 value, Schild plot and pD2 values- applications in pharmacologypA2 value, Schild plot and pD2 values- applications in pharmacology
pA2 value, Schild plot and pD2 values- applications in pharmacology
 
AORTIC DISSECTION and management of aortic dissection
AORTIC DISSECTION and management of aortic dissectionAORTIC DISSECTION and management of aortic dissection
AORTIC DISSECTION and management of aortic dissection
 
MedMatch: Your Health, Our Mission. Pitch deck.
MedMatch: Your Health, Our Mission. Pitch deck.MedMatch: Your Health, Our Mission. Pitch deck.
MedMatch: Your Health, Our Mission. Pitch deck.
 
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdf
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdfSGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdf
SGK RỐI LOẠN TOAN KIỀM ĐHYHN RẤT HAY VÀ ĐẶC SẮC.pdf
 
historyofpsychiatryinindia. Senthil Thirusangu
historyofpsychiatryinindia. Senthil Thirusanguhistoryofpsychiatryinindia. Senthil Thirusangu
historyofpsychiatryinindia. Senthil Thirusangu
 
Different drug regularity bodies in different countries.
Different drug regularity bodies in different countries.Different drug regularity bodies in different countries.
Different drug regularity bodies in different countries.
 
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdf
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdfPAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdf
PAIN/CLASSIFICATION AND MANAGEMENT OF PAIN.pdf
 
Trustworthiness of AI based predictions Aachen 2024
Trustworthiness of AI based predictions Aachen 2024Trustworthiness of AI based predictions Aachen 2024
Trustworthiness of AI based predictions Aachen 2024
 
Basic structure of hair and hair growth cycle.pptx
Basic structure of hair and hair growth cycle.pptxBasic structure of hair and hair growth cycle.pptx
Basic structure of hair and hair growth cycle.pptx
 
Clinical Research Informatics Year-in-Review 2024
Clinical Research Informatics Year-in-Review 2024Clinical Research Informatics Year-in-Review 2024
Clinical Research Informatics Year-in-Review 2024
 
Role of Soap based and synthetic or syndets bar
Role of  Soap based and synthetic or syndets barRole of  Soap based and synthetic or syndets bar
Role of Soap based and synthetic or syndets bar
 
Pharmacokinetic Models by Dr. Ram D. Bawankar.ppt
Pharmacokinetic Models by Dr. Ram D.  Bawankar.pptPharmacokinetic Models by Dr. Ram D.  Bawankar.ppt
Pharmacokinetic Models by Dr. Ram D. Bawankar.ppt
 
power point presentation of Clinical evaluation of strabismus
power point presentation of Clinical evaluation  of strabismuspower point presentation of Clinical evaluation  of strabismus
power point presentation of Clinical evaluation of strabismus
 
Female Reproductive Physiology Before Pregnancy
Female Reproductive Physiology Before PregnancyFemale Reproductive Physiology Before Pregnancy
Female Reproductive Physiology Before Pregnancy
 
Using Data Visualization in Public Health Communications
Using Data Visualization in Public Health CommunicationsUsing Data Visualization in Public Health Communications
Using Data Visualization in Public Health Communications
 
SGK ĐIỆN GIẬT ĐHYHN RẤT LÀ HAY TUYỆT VỜI.pdf
SGK ĐIỆN GIẬT ĐHYHN        RẤT LÀ HAY TUYỆT VỜI.pdfSGK ĐIỆN GIẬT ĐHYHN        RẤT LÀ HAY TUYỆT VỜI.pdf
SGK ĐIỆN GIẬT ĐHYHN RẤT LÀ HAY TUYỆT VỜI.pdf
 
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdf
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdfSGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdf
SGK RỐI LOẠN KALI MÁU CỰC KỲ QUAN TRỌNG.pdf
 

Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia

  • 1. Automated visual evaluation (AVE) is a promising technology that uses a machine learning (ML) classifier to predict the likelihood of pathology in a cervical image. AVE is accurate, fast, and inexpensive, and thus it has tremendous potential. Because AVE is based on ML and not an in vitro assay, very little is known about which features affect its performance, and which do not. Introduction Methods Results Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia TAP TO RETURN TO KIOSK MENU This analysis examines the performance of AVE under different imaging conditions. There are 2 types of analyses presented. In one type of analysis, the images are modified by a specific effect through image processing and manipulation, and the performance drop off is measured. The other analysis involves grouping image metadata and comparing different sub-cohorts. The goal of this study is to characterize which imaging features AVE is sensitive to. The analysis was done on a global set of images collected by users of the Enhanced Visual Assessment (EVA) System across the globe. KC Fernandes1, T Freitas1, Y Zall2, R Nissim2, D Levitz2 1 NILG.ai, Porto, Portugal; 2 MobileODT Ltd., Tel Aviv, Israel AUC = 0.87 AUC = 0.85 AUC = 0.875 1- spec Recall (Sens) SensPrecision(PPV) A data set comprising of images from N=202 patients (72 abnormal, 130 normal) was used for testing an AVE classifier. The global distribution of data, as well as base classifier performance, are shown below. ROC curve Precision – Recall (PR) curve ROCAUC ROCAUC ROCAUC Effect size Effect size Effect size Effect size Effect size Effect size The 3 most relevant augmentation analyses are shown below. On the left are examples of an effect of different sizes on a handful of images. On the right is the corresponding drop in the area under the (ROC – Receiver Operating Characteristic) curve (AUC). Note the effect chart on left corresponds to white area in graphs. Gray regions correspond to images far outside the expected range, with little information.
  • 2. Additional augmentation analyses Statistical distribution analyses CONCLUSIONS Funding This study was funded by MobileODT. Device Impact on Machine Learning Classifier Accuracy in Detecting Cervical Dysplasia KC Fernandes1, T Freitas1, Y Zall2, R Nissim2, D Levitz2 1 NILG.ai, Porto, Portugal; 2 MobileODT Ltd., Tel Aviv, Israel AfricaAsia Samsung J500 (EVA 3.0) Samsung J530 (EVA 3 Plus) Cervix Translation Cervix Rotation Bounding box expansion Bounding box contraction Shear Cervix flip Frequent vs. rare users The AVE classifier tested is very sensitive to blur, moderately sensitive to background lighting and shadows, and not sensitive to translations, rotations, scaling, shear, and flips. These results were expected. The AVE classifier is also sensitive to phone model and geography. However, the 2 parameters cannot be isolated in the current data set. Additionally, the AVE classifier is sensitive to the frequency of usage, with better performance on common users, as opposed to rate users. These tests and results should be considered when training and testing new AVE classifiers. Augmentation analyses showing affine transformations did not influence the AVE prediction scores A comparison of the probability density functions (PDFs) of AVE prediction scores for different geographies and phone models. These results suggest that the classifier distinguishes between normal, and 2 types of abnormals – those from Africa (Samsung J530) and those from Asia (Samsung J500). Moreover, this suggests a correlation between phone model and geography Frequent and rare users also have very different ROC curves.