Solr and ManifoldCF

•

1 gefällt mir•1,810 views

Minoru Osuka

Technologie

Who am I ?
大須賀稔 (Minoru Osuka) 
<minoru@apache.org>!
Committer and PMC member of ManifoldCF  
at Apache Software Foundation.!
Senior Consultant 
at RONDHUIT CO, Ltd.!
Formerly Senior Application Engineer 
at Rakuten, Inc.

What I do ?
Installation support for Solr as an IT consultant.!
!

Solr trainer.!
!

Solr and ManifoldCF developer.

Contents
What is ManifoldCF ?!
Project status!
Architecture!
Use case!
Resources!
Books!
Demonstration

What is ManifoldCF ?
Open Source Crawler!

Admin GUI!

Built-in scheduler!

Job Management!

Get contents from repositories!

Status Report!

Push contents to another servers!

History Report

Authority Service!
Security Search Component
Plugin!
REST API

Project status
Latest version : 1.3!

IBM FileNet !

Solr!

Atlassian JIRA!

Elasticsearch!

Dropbox!

MetaCarta Geographic Text Search!

Google Drive!

OpenSearchServer!

Windows Shares!

Microsoft SharePoint 2003/2007/2010!

HDFS !

Alfresco!

Generic File System!

OpenCMIS!

Generic JDBC!

EMC Documentum!

Generic Web!

Autonomy Meridio

Generic RSS

Architecture
Push 
Contents

Security 
Search Component 
Plugin

Output
Connector

Job

Repository
Connector

Authority
Service

Security 
Search Component 
Plugin

SharePoint 
Plugin

Get 
ACLs

Use case
Web Search Engine!

3. Indexing the
Web contents

Solr!
Hadoop!

HDFS Repository 
Connector

Solr 
Connector

HDFS / MapReduce!
ManifoldCF!
Solr Connector!
HDFS Connector!
Web Connector

2. Reduce the HTML noise /
Calculate the page rank
HDFS Output 
Connector
1. Crawling the
Web contents

Web 
Connector

Resources
Project Home 
http://manifoldcf.apache.org/!
Javadoc 
http://manifoldcf.apache.org/release/trunk/en_US/javadoc.html!
Source code 
http://svn.apache.org/repos/asf/manifoldcf/!
JIRA 
https://issues.apache.org/jira/browse/CONNECTORSC!
Conﬂuence 
https://cwiki.apache.org/conﬂuence/display/CONNECTORS/Index

Books
ManifoldCF in Action!
http://www.manning.com/wright/

PR
Seminar in RONDHUIT!
Apache Solr ご紹介セミナー!
Training in RONDHUIT!
Solr 4 基礎 / 応用 / クラウド分散運用 / DIH!
ManifoldCF 入門

Now Hiring !
We are looking for human resources with the desire to grow
together and continue to create the future.!
Consultant!
Technical Support Engineer

Weitere ähnliche Inhalte

Was ist angesagt?

Mini Training FlywayBetclic Everest Group Tech Team

What's New In Rails 4.2Creston Jamison

Search api d8Dropsolid

A Cassandra driver from and for the Lua communityThibault Charbonnier

Database migrations with Flyway and LiquibaseLars Östling

Tear It Down, Build It Back Up: Empowering Developers with Amazon CloudFormationJames Andrew Vaughn

ストリーミングデータのアドホック分析エンジンの比較Yoshiyasu SAEKI

Scaling MySQL using FabricKarthik .P.R

Oslo Vancouver Project UpdateBen Nemec

Logging with Elasticsearch, Logstash & KibanaAmazee Labs

Design and architecture of JackrabbitJukka Zitting

Queryable State for Kafka Streamsを使ってみたYoshiyasu SAEKI

.Net standard 2.0Scott Golightly

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有Yoshiyasu SAEKI

"How about no grep and zabbix?". ELK based alerts and metrics.Vladimir Pavkin

Filipe paternot - Case Study: Zabbix Deployment at Globo.comZabbix

Deploying Immutable infrastructures with RabbitMQ and SolrJordi Llonch

/path/to/content - the Apache Jackrabbit content repositoryJukka Zitting

Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤Yoshiyasu SAEKI

Presto Testing Tools: Benchto & Tempto (Presto Boston Meetup 10062015)Matt Fuller

Was ist angesagt? (20)

Mini Training Flyway

What's New In Rails 4.2

Search api d8

A Cassandra driver from and for the Lua community

Database migrations with Flyway and Liquibase

Tear It Down, Build It Back Up: Empowering Developers with Amazon CloudFormation

ストリーミングデータのアドホック分析エンジンの比較

Scaling MySQL using Fabric

Oslo Vancouver Project Update

Logging with Elasticsearch, Logstash & Kibana

Design and architecture of Jackrabbit

Queryable State for Kafka Streamsを使ってみた

.Net standard 2.0

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有

"How about no grep and zabbix?". ELK based alerts and metrics.

Filipe paternot - Case Study: Zabbix Deployment at Globo.com

Deploying Immutable infrastructures with RabbitMQ and Solr

/path/to/content - the Apache Jackrabbit content repository

Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤

Presto Testing Tools: Benchto & Tempto (Presto Boston Meetup 10062015)

Ähnlich wie Solr and ManifoldCF

Federico Feroldi: PHP in Yahoo!Francesco Fullone

Federico Feroldi Php In YahooFederico Feroldi

Skinny Framework Progress SituationKazuhiro Sera

PHP is the King, nodejs is the Prince and Lua is the foolAlessandro Cinelli (cirpo)

Developer’s intro to the alfresco platformAlfresco Software

Pharo StatusJannik Laval

Learn PHP Lacture1ADARSH BHATT

Real time cloud native open source streaming of any data to apache solrTimothy Spann

Intro to Perfect - LA presentationTim Taplin

PHP is the king, nodejs is the prince and Lua is the foolAlessandro Cinelli (cirpo)

Web Frameworks of the Futureelliando dias

Apache Phoenix Query Server PhoenixCon2016Josh Elser

[CocoaHeads Tricity] Do not reinvent the wheelMateusz Klimczak

De-Mystifying the Apache Phoenix QueryServerJosh Elser

CMIS: An Open API for Managing ContentJeff Potts

Laravel 4 presentationAbu Saleh Muhammad Shaon

PHPID-OL#29 The Change Maker FrameworkSteeven Salim

ApacheCon NA 2011 reportKoji Kawamura

Apache Deep Learning 101 - DWS Berlin 2018Timothy Spann

Intro to Alfresco for DevelopersJeff Potts

Ähnlich wie Solr and ManifoldCF (20)

Federico Feroldi: PHP in Yahoo!

Federico Feroldi Php In Yahoo

Skinny Framework Progress Situation

PHP is the King, nodejs is the Prince and Lua is the fool

Developer’s intro to the alfresco platform

Pharo Status

Learn PHP Lacture1

Real time cloud native open source streaming of any data to apache solr

Intro to Perfect - LA presentation

PHP is the king, nodejs is the prince and Lua is the fool

Web Frameworks of the Future

Apache Phoenix Query Server PhoenixCon2016

[CocoaHeads Tricity] Do not reinvent the wheel

De-Mystifying the Apache Phoenix QueryServer

CMIS: An Open API for Managing Content

Laravel 4 presentation

PHPID-OL#29 The Change Maker Framework

ApacheCon NA 2011 report

Apache Deep Learning 101 - DWS Berlin 2018

Intro to Alfresco for Developers

Kürzlich hochgeladen

Training state-of-the-art general text embeddingZilliz

Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software

SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero

"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed

Search Engine Optimization SEO PDF for 2024.pdfRankYa

Story boards and shot lists for my a level piececharlottematthew16

Powerpoint exploring the locations used in television show Time Clashcharlottematthew16

CloudStudio User manual (basic edition):comworks

Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy

Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz

Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson

DMCC Future of Trade Web3 - Special EditionDubai Multi Commodity Centre

WordPress Websites for Engineers: Elevate Your Brandgvaughan

Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited

My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays

Kürzlich hochgeladen (20)

Training state-of-the-art general text embedding

Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation

SIP trunking in Janus @ Kamailio World 2024

"Federated learning: out of reach no matter how close",Oleksandr Lapshyn

"Debugging python applications inside k8s environment", Andrii Soldatenko

Scanning the Internet for External Cloud Exposures via SSL Certs

Search Engine Optimization SEO PDF for 2024.pdf

Story boards and shot lists for my a level piece

Powerpoint exploring the locations used in television show Time Clash

CloudStudio User manual (basic edition):

Vertex AI Gemini Prompt Engineering Tips

Human Factors of XR: Using Human Factors to Design XR Systems

DevoxxFR 2024 Reproducible Builds with Apache Maven

Vector Databases 101 - An introduction to the world of Vector Databases

Are Multi-Cloud and Serverless Good or Bad?

DMCC Future of Trade Web3 - Special Edition

WordPress Websites for Engineers: Elevate Your Brand

Ensuring Technical Readiness For Copilot in Microsoft 365

My Hashitalk Indonesia April 2024 Presentation

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack

Solr and ManifoldCF

1. Solr And ManifoldCF minoru@apache.org

2. Who am I ? 大須賀稔 (Minoru Osuka)  <minoru@apache.org>! Committer and PMC member of ManifoldCF   at Apache Software Foundation.! Senior Consultant  at RONDHUIT CO, Ltd.! Formerly Senior Application Engineer  at Rakuten, Inc.

3. What I do ? Installation support for Solr as an IT consultant.! ! Solr trainer.! ! Solr and ManifoldCF developer.

4. Contents What is ManifoldCF ?! Project status! Architecture! Use case! Resources! Books! Demonstration

5. What is ManifoldCF ? Open Source Crawler! Admin GUI! Built-in scheduler! Job Management! Get contents from repositories! Status Report! Push contents to another servers! History Report Authority Service! Security Search Component Plugin! REST API

6. Project status Latest version : 1.3! IBM FileNet ! Solr! Atlassian JIRA! Elasticsearch! Dropbox! MetaCarta Geographic Text Search! Google Drive! OpenSearchServer! Windows Shares! Microsoft SharePoint 2003/2007/2010! HDFS ! Alfresco! Generic File System! OpenCMIS! Generic JDBC! EMC Documentum! Generic Web! Autonomy Meridio Generic RSS

7. Architecture Push  Contents Security  Search Component  Plugin Output Connector Job Repository Connector Authority Service Security  Search Component  Plugin SharePoint  Plugin Get  ACLs

8. Use case Web Search Engine! 3. Indexing the Web contents Solr! Hadoop! HDFS Repository  Connector Solr  Connector HDFS / MapReduce! ManifoldCF! Solr Connector! HDFS Connector! Web Connector 2. Reduce the HTML noise / Calculate the page rank HDFS Output  Connector 1. Crawling the Web contents Web  Connector

9. Demonstration

10. Resources Project Home  http://manifoldcf.apache.org/! Javadoc  http://manifoldcf.apache.org/release/trunk/en_US/javadoc.html! Source code  http://svn.apache.org/repos/asf/manifoldcf/! JIRA  https://issues.apache.org/jira/browse/CONNECTORSC! Conﬂuence  https://cwiki.apache.org/conﬂuence/display/CONNECTORS/Index

11. Books ManifoldCF in Action! http://www.manning.com/wright/

12. PR Seminar in RONDHUIT! Apache Solr ご紹介セミナー! Training in RONDHUIT! Solr 4 基礎 / 応用 / クラウド分散運用 / DIH! ManifoldCF 入門

13. Now Hiring ! We are looking for human resources with the desire to grow together and continue to create the future.! Consultant! Technical Support Engineer

14. Thank you for your attention !

Solr and ManifoldCF

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Solr and ManifoldCF

Ähnlich wie Solr and ManifoldCF (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Solr and ManifoldCF