Document Understanding as Cloud APIs and Generative AI Pre-labeling Extraction and Classification

Document Understanding as
Cloud APIs and Generative AI
Pre-labeling Extraction and
Classification
Diana Gray
Community Marketing
Manager AMER
@UiPath
Meet today’s team:
Monica Luca
Senior Product Manager
@UiPath
Russel Alfeche
Technology Leader, RPA
qBotica
& UiPath MVP
Sharon Palawandram
Senior Machine Learning
Consultant Ashling Partners
& UiPath MVP
3
UiPath Community Meetings:
• AMER Developer Community sessions
• You are encouraged to network with Speakers and MVPs and share your
LinkedIn url in the chat box. We want to get to know you !
• These sessions are for you to engage with us on topics that interest you or that
you want to share with the UiPath AMER Community
• Please use the chat to place questions until Q&A
• If you have any topics that you want us to cover, please email
diana.gray@uipath.com
4
Safe Harbor​
This presentation may include forward-looking statements. Forward looking statements include all statements that are not historical facts, and in
some cases, can be identified by terms such as “anticipate,” “believe,” “estimate,” “expect,” “intend,” “may,” “might,” “plan,” “project,” “will,” “would,”
“should,” “could,” “can,” “predict,” “potential,” “continue,” or the negative of these terms, and similar expressions that concern our expectations,
strategy, plans or intentions. By their nature, these statements are subject to numerous risks and uncertainties, including factors beyond our
control, that could cause actual results, performance or achievement to differ materially and adversely from those anticipated or implied in the
statements. Although our management believes that the expectations reflected in our statements are reasonable, we cannot guarantee that the
future results, levels of activity, performance or events and circumstances described in the forward-looking statements will be achieved or occur.
Recipients are cautioned not to place undue reliance on these forward-looking statements, which speak only as of the date such statements are
made and should not be construed as statements of fact. ​
This meeting is strictly confidential. By participating in this meeting, you agree to keep any information we provide confidential and not to disclose
any of the information to any other parties without our prior express written permission. Neither the information contained in this presentation, nor
any further information made available by us or any of our affiliates or employees, directors, representatives, officers, agents or advisers in
connection with this presentation will form the basis of or be construed as a contract or any other legal obligation. ​
5
1. Document Understand as Cloud APIs 2. Generative AI Pre-labelling Extraction and
Classification
Agenda
1. Document
Understanding
Cloud APIs
The UiPath ™ word mark, logos, and robots are registered
trademarks owned by UiPath, Inc. and its affiliates.
©2023 UiPath. All rights reserved.
7
Use case: Airports serve millions of
passengers every day – to ensure security,
immigration compliance, and safety,
Passports are scanned.
Challenge: Passcan offers airports a software
which scans documents, identifies whether
they are passports and extracts the
information from them. This information is
then checked against Border Control and
Immigration Systems or Security Databases,
to verify whether the passenger can proceed
to check in. Passcan requires a near real-time
solution, to not make the passengers wait and
want to be able to consume it via Python
code, as their software is built in it.
Solution: UiPath offers
Document Understanding
capabilities as Cloud APIs – so
that Passcan can easily
consume APIs to process the
documents and provide their
services to airports.
Scenario: Provide Passport reading
capabilities to airports
2. Generative AI
Pre-labelling
Extraction and
Classification
The UiPath ™ word mark, logos, and robots are registered
trademarks owned by UiPath, Inc. and its affiliates.
©2023 UiPath. All rights reserved.
9
What is It?
Classify Document and
Extract Document Data
Activities enhanced with
generative capabilities, allowing
users to input a prompt based
on which the document is
classified, or data is extracted
from it – no model setup
required, just activities!
Who Needs It?
- Citizen & RPA developers
looking to leverage
Document Understanding
- without model setup, to
quickly get up & running
when pretrained models are
not available
- to process unstructured
documents
Customer Benefits
- Ability to process
unstructured documents
- Get up & running quickly, no
model setup required
Generative extraction & classification in
Studio Web
10
Use Cases
1. As a recruiter, I want to search for skilled candidates (a certain skill set) in CVs. Before extracting
the data, I want to see whether the documents sent via email are indeed CVs – or something else
(e.g., Cover letter)
2. As a Lawyer, when identifying a certain type of contract, then I want to extract certain clauses if
available in contracts.
3. As an HR Manager, I want to extract the name & dob of employees, regardless of whether from
passport, id or drivers license - I just need these 2 fields.
11
Task: Michelle receives various return
requests via email, based on:
• Warranty document – she needs to verify that
the product corresponds to the product
mentioned in the Invoices
• Invoice – she will forward the document to a
colleague of hers for checking
Scenario: Automating order returns
Michelle, Customer Support
Agent, UiPeople
• MacBook User
• No Coding skills
• No AI skills
1 von 11

Más contenido relacionado

Similar a Document Understanding as Cloud APIs and Generative AI Pre-labeling Extraction and Classification(20)

TOP SAILPOINT INTERVIEW QUESTIONTOP SAILPOINT INTERVIEW QUESTION
TOP SAILPOINT INTERVIEW QUESTION
Infosec Train394 views
Inna pidicho.pdfInna pidicho.pdf
Inna pidicho.pdf
Rohit Radhakrishnan123 views
Breaking down the Microsoft AI Platform Breaking down the Microsoft AI Platform
Breaking down the Microsoft AI Platform
Digital Transformation EXPO Event Series85 views
Wokato-Value Proposition.pptxWokato-Value Proposition.pptx
Wokato-Value Proposition.pptx
shivipandey1626 views
Intro to MP.pptxIntro to MP.pptx
Intro to MP.pptx
RohitRadhakrishnan898 views
Session 2023-11.pptxSession 2023-11.pptx
Session 2023-11.pptx
AndreeaTom43 views

Más de DianaGray10(20)

Último(20)

Document Understanding as Cloud APIs and Generative AI Pre-labeling Extraction and Classification

  • 1. Document Understanding as Cloud APIs and Generative AI Pre-labeling Extraction and Classification
  • 2. Diana Gray Community Marketing Manager AMER @UiPath Meet today’s team: Monica Luca Senior Product Manager @UiPath Russel Alfeche Technology Leader, RPA qBotica & UiPath MVP Sharon Palawandram Senior Machine Learning Consultant Ashling Partners & UiPath MVP
  • 3. 3 UiPath Community Meetings: • AMER Developer Community sessions • You are encouraged to network with Speakers and MVPs and share your LinkedIn url in the chat box. We want to get to know you ! • These sessions are for you to engage with us on topics that interest you or that you want to share with the UiPath AMER Community • Please use the chat to place questions until Q&A • If you have any topics that you want us to cover, please email diana.gray@uipath.com
  • 4. 4 Safe Harbor​ This presentation may include forward-looking statements. Forward looking statements include all statements that are not historical facts, and in some cases, can be identified by terms such as “anticipate,” “believe,” “estimate,” “expect,” “intend,” “may,” “might,” “plan,” “project,” “will,” “would,” “should,” “could,” “can,” “predict,” “potential,” “continue,” or the negative of these terms, and similar expressions that concern our expectations, strategy, plans or intentions. By their nature, these statements are subject to numerous risks and uncertainties, including factors beyond our control, that could cause actual results, performance or achievement to differ materially and adversely from those anticipated or implied in the statements. Although our management believes that the expectations reflected in our statements are reasonable, we cannot guarantee that the future results, levels of activity, performance or events and circumstances described in the forward-looking statements will be achieved or occur. Recipients are cautioned not to place undue reliance on these forward-looking statements, which speak only as of the date such statements are made and should not be construed as statements of fact. ​ This meeting is strictly confidential. By participating in this meeting, you agree to keep any information we provide confidential and not to disclose any of the information to any other parties without our prior express written permission. Neither the information contained in this presentation, nor any further information made available by us or any of our affiliates or employees, directors, representatives, officers, agents or advisers in connection with this presentation will form the basis of or be construed as a contract or any other legal obligation. ​
  • 5. 5 1. Document Understand as Cloud APIs 2. Generative AI Pre-labelling Extraction and Classification Agenda
  • 6. 1. Document Understanding Cloud APIs The UiPath ™ word mark, logos, and robots are registered trademarks owned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
  • 7. 7 Use case: Airports serve millions of passengers every day – to ensure security, immigration compliance, and safety, Passports are scanned. Challenge: Passcan offers airports a software which scans documents, identifies whether they are passports and extracts the information from them. This information is then checked against Border Control and Immigration Systems or Security Databases, to verify whether the passenger can proceed to check in. Passcan requires a near real-time solution, to not make the passengers wait and want to be able to consume it via Python code, as their software is built in it. Solution: UiPath offers Document Understanding capabilities as Cloud APIs – so that Passcan can easily consume APIs to process the documents and provide their services to airports. Scenario: Provide Passport reading capabilities to airports
  • 8. 2. Generative AI Pre-labelling Extraction and Classification The UiPath ™ word mark, logos, and robots are registered trademarks owned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
  • 9. 9 What is It? Classify Document and Extract Document Data Activities enhanced with generative capabilities, allowing users to input a prompt based on which the document is classified, or data is extracted from it – no model setup required, just activities! Who Needs It? - Citizen & RPA developers looking to leverage Document Understanding - without model setup, to quickly get up & running when pretrained models are not available - to process unstructured documents Customer Benefits - Ability to process unstructured documents - Get up & running quickly, no model setup required Generative extraction & classification in Studio Web
  • 10. 10 Use Cases 1. As a recruiter, I want to search for skilled candidates (a certain skill set) in CVs. Before extracting the data, I want to see whether the documents sent via email are indeed CVs – or something else (e.g., Cover letter) 2. As a Lawyer, when identifying a certain type of contract, then I want to extract certain clauses if available in contracts. 3. As an HR Manager, I want to extract the name & dob of employees, regardless of whether from passport, id or drivers license - I just need these 2 fields.
  • 11. 11 Task: Michelle receives various return requests via email, based on: • Warranty document – she needs to verify that the product corresponds to the product mentioned in the Invoices • Invoice – she will forward the document to a colleague of hers for checking Scenario: Automating order returns Michelle, Customer Support Agent, UiPeople • MacBook User • No Coding skills • No AI skills