What's with the 1s and 0s? Making sense of binary data at scale with Tika and...
Die SlideShare-Präsentation wird heruntergeladen.
×
![Content analysis with Apache Tika Paolo Mottadelli - [email_address] or [email_address]](https://image.slidesharecdn.com/apacheconus2008tikapresentationpaolomottadelli-1225999621640751-8/75/content-analysis-with-apache-tika-1-2048.jpg?cb=1665149345)
Hier ansehen
Weitere Verwandte Inhalte
Diashows für Sie (20)
Ähnlich wie Content Analysis with Apache Tika (20)
Weitere von Paolo Mottadelli (11)
Aktuellste (20)
Content Analysis with Apache Tika
- Content analysis with Apache Tika Paolo Mottadelli - [email_address] or [email_address]
- Main challenge Lucene index
- Other challenges
- What is Tika? Another Indian Lucene project? No.
- What is Tika? It is a Toolkit
- Current coverage
- A brief history of Tika Sponsored by the Apache Lucene PMC
- Tika organization Changing after graduation
- Getting Tika … and contributing
- Tika Design
- The Parser interface <ul><li>void parse(InputStream stream, ContentHandler handler, Metadata metadata) throws IOException, SAXException, TikaException; </li></ul>
- Tika Design
- Document input stream
- Tika Design
- XHTML SAX events <ul><li><html xmlns="http://www.w3.org/1999/xhtml"> </li></ul><ul><li><head> </li></ul><ul><li><title>...</title> </li></ul><ul><li></head> </li></ul><ul><li><body> ... </body> </li></ul><ul><li></html> </li></ul>
- Why XHTML? <ul><li>Reflect the structured text content of the document </li></ul><ul><li>Not recreating the low level details </li></ul><ul><li>For low level details use low level parser libs </li></ul>
- ContentHandler (CH) and Decorators (CHD)
- Tika Design
- Document metadata
- … more metadata: HPSF
- Tika Design
- Parser implementations
- The AutoDetectParser <ul><li>Encapsulates all Tika functionalities </li></ul><ul><li>Can handle any type of document </li></ul>
- Type Detection MimeType type = types.getMimeType(…);
- tika-mimetypes.xml <ul><li>An example: Gzip </li></ul><ul><li><mime-type type="application/x-gzip"> </li></ul><ul><li><magic priority="40"> </li></ul><ul><li><match value="3713" type="string“ offset="0" /> </li></ul><ul><li></magic> </li></ul><ul><li><glob pattern="*.tgz" /> </li></ul><ul><li><glob pattern="*.gz" /> </li></ul><ul><li><glob pattern="*-gz" /> </li></ul><ul><li></mime-type> </li></ul>
- Supported formats
- A really simple example <ul><li>InputStream input = MyTest.class.getResourceAsStream("testPPT.ppt"); </li></ul><ul><li>Metadata metadata = new Metadata(); </li></ul><ul><li>ContentHandler handler = new BodyContentHandler(); </li></ul><ul><li>new OfficeParser ().parse(input, handler, metadata); </li></ul><ul><li>String contentType = metadata.get(Metadata. CONTENT_TYPE) ; </li></ul><ul><li>String title= metadata.get(Metadata. TITLE) ; </li></ul><ul><li>String content = handler.toString() ; </li></ul>
- Future Goals
- Who uses Tika?
