TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

•Als PPTX, PDF herunterladen•

0 gefällt mir•960 views

This document summarizes Jeff Rueppel's presentation on streamlining the setup of Moses, an open source machine translation tool, for industry users. It describes Adobe's efforts to create tooling for Moses, including a corpus tool, training tool, and testing tool. It also discusses automating the Moses training process and using RPM packages and a YUM repository to efficiently manage dependencies and simplify the installation of Moses on CentOS systems. The goal is to reduce the lengthy, manual setup process to a single automated command.

Technologie

TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE

The Simple Install – Streamlining Moses Setup for Industry
Scale Users

11:30-11:45
Wednesday, 17 October

Jeff Rueppel
Adobe

Adobe Open Source MT Tooling And Best Practices
Jeffrey Rueppel | MT Architect – Multilingual Content Intelligence Team

Two Efforts – Tooling and Efficiency
1. Tooling:
• Corpus Tool
• Training Tool
• Testing Tool
2. Efficiency:
• Automated
Trainer
• RPM + YUM

3

1. Tooling/Efficiency – Automated
Trainer

8

2. Efficiency - Why Streamline?
Answer: Installing Moses In A Custom Environment Takes….

A
Long
Time.

*Methuselah tree is now estimated at being 4,841 years
old
9

2. Efficiency - Standard Moses Install
1.
2.
Install Dependency Packages
Compile and Install Language
Practice
Models and GIZA++
3. Check Out Source Code From
GITHUB
4. Copy BIN and Source Scripts to
Destination Folder
5. Download Sample Model And
Translate Something

10

2. Streamlined Installation
Streamlined
Moses
Installation
Instructions
Fit On One
Page
11

2. How did we do it?
1. Created RPM Package of dependencies
(CENT OS6 in our Case)

2. Private YUM repository to centralize package
management

+

YUM (Yellow Dog Updater
Modified)
12

2. RPM PACKAGE CREATION
glibc-devel
Required glibc-headers
libstdc++-devel
For Building Boost-devel
xmlrpc-c-devel
zlib-deve
Moses-suite-devel
giza-pp
irstlm

Boost
Required xmlrpc-c
giza-pp
To Run irstlm
zlib
perl-CGI
perl GD
perl-XML-Twig

13

2. YUM Repository
1. Create a repository definition on the local machine -
/etc/yum.repos.d
2. Execute: yum install moses-core-irstlm
3. Execute: yum install moses-test-suite
4. /moses-suite/bin/moses-suite-test-inst.sh

14

TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

Weitere ähnliche Inhalte

Was ist angesagt?

M|18 Planning for Disaster Recovery, online and offline

MariaDB plc

제2회난공불락 오픈소스 세미나 커널튜닝

Tommy Lee

An introduction to the basics of primary storage in CloudStack, including a discussion of the challenges of guaranteeing storage performance in a cloud. Learn how to leverage the latest enhancements to CloudStack to enable storage administrators to deliver consistent, repeatable performance to 10s, 100s or 1,000s of application workloads in parallel. View now for a detailed look at CloudStack enhancements, the management benefits they provide, and common go-to-market approaches.

Guaranteeing CloudStack Storage Performance

NetApp

Xen in Linux 3.x (or PVOPS)

The Linux Foundation

MongoDB Backup & Disaster Recovery

Elankumaran Srinivasan

Sequelize js

Joan Yin

ZFS in 30 minutes

William Hathaway

제3회난공불락 오픈소스 인프라세미나 - lustre

Tommy Lee

4. storage lvm

Marian Marinov

Flourish16

Dru Lavigne

Integration testing can be an intimidating task to tackle. Where do you start? What is Marvin? What is Jenkins and how does it apply to my testing efforts? How can I leverage a virtual infrastructure to minimize the number of physical hosts that are required? This presentation discusses approaches to leveraging these tools and building an automated regression test suite for a collection of ever-growing features.

CloudStack Automated Integration Testing with Marvin

NetApp

Wish list from PostgreSQL - Linux Kernel Summit 2009

Takahiro Itagaki

ZFS Tutorial USENIX June 2009

Richard Elling

Topics: Brief concept about LVM To know more about Offer- http://mazenet-chennai.in/mazenet-offers.html Syllabus- http://www.mazenet-chennai.in/redhat-training-in-chennai.html Slide share- http://www.slideshare.net/mazenet_solution/presentations For more events- http://mazenet-chennai.in/mazenet-events.html All videos- https://www.youtube.com/c/Mazenetsolution Facebook- https://www.facebook.com/Mazenet.IT.Solution/ Twitter- https://twitter.com/Maze_net Mail us - marketing@mazenetsolution.com Contact- 9629728714

Red Hat - LVM - Mazenet Solution

Mazenetsolution

Scale2014

Dru Lavigne

Was ist angesagt? (15)

M|18 Planning for Disaster Recovery, online and offline

제2회난공불락 오픈소스 세미나 커널튜닝

Guaranteeing CloudStack Storage Performance

Xen in Linux 3.x (or PVOPS)

MongoDB Backup & Disaster Recovery

Sequelize js

ZFS in 30 minutes

제3회난공불락 오픈소스 인프라세미나 - lustre

4. storage lvm

Flourish16

CloudStack Automated Integration Testing with Marvin

Wish list from PostgreSQL - Linux Kernel Summit 2009

ZFS Tutorial USENIX June 2009

Red Hat - LVM - Mazenet Solution

Scale2014

Andere mochten auch

Enhancing the Quality of Terminological Resources: the LISE Tools and Platfor...

TAUS - The Language Data Network

9 February 2011, TAUS Round Table, Amsterdam, Rahzeb Choudhury

TAUS - The Language Data Network

TAUS MT SHOWCASE, The WeMT Program, Olga Beregovaya, Welocalize, 10 October 2...

TAUS - The Language Data Network

At the TAUS User Conference, a number of attendees pitched brief proposals for achieving greater power and efficiency in the translation chain through innovations involving sharing and pooling ideas and effort. Fred Hollowood from Symantec reported on a tool he has developed to generate linguistic feedback from MT production. It provides scores for MT engines and localization projects, and intuitive insights into post editing operations based on the GTM metric. He plans to open source it for the translation community at large.

TAUS USER CONFERENCE 2010, Collaborate to innovate - Fred Hollowood, Symantec

TAUS - The Language Data Network

TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Monaco, Serge Gladhoff, Logrus...

TAUS - The Language Data Network

Olga Beregovaya, CEO Americas, PROMT PROMT's approach to engine hybridization differs from many other companies’ technology, using statistical methods on every stage of translation process: pre-editing, transfer and post-editing. The hybrid engine defines syntactic, lexical and grammar choices on an “atomic” level, rather than processing complete translated sentences. Pilot case examples will be used to demonstrate the robustness of advances.

TAUS USER CONFERENCE 2010, The Deep Hybrid machine translation engine

TAUS - The Language Data Network

Multilingual Term Extraction as a Service from Acrolinx, CHAT2013

TAUS - The Language Data Network

Andere mochten auch (7)

Enhancing the Quality of Terminological Resources: the LISE Tools and Platfor...

9 February 2011, TAUS Round Table, Amsterdam, Rahzeb Choudhury

TAUS MT SHOWCASE, The WeMT Program, Olga Beregovaya, Welocalize, 10 October 2...

TAUS USER CONFERENCE 2010, Collaborate to innovate - Fred Hollowood, Symantec

TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Monaco, Serge Gladhoff, Logrus...

TAUS USER CONFERENCE 2010, The Deep Hybrid machine translation engine

Multilingual Term Extraction as a Service from Acrolinx, CHAT2013

Ähnlich wie TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

Deploying Foreman in Enterprise Environments

inovex GmbH

OpenNebula, the foreman and CentOS play nice, too

inovex GmbH

the NML project

Lei Yang

The Deck by Phil Polstra GrrCON2012

Philip Polstra

AWS Community Day 2022 David Kirk_Hybrid Local Development Environments with...

AWS Chicago

Real-World Docker: 10 Things We've Learned

RightScale

Cobbler, Func and Puppet: Tools for Large Scale Environments

Michael Zhang

Presented at Open Source Summit Japan (http://sched.co/AOmo) - - - Slowness of CI is a critical issue in software development, because it discourages engineers from writing tests, and hence deteriorates the quality of the product. In this presentation, Akihiro Suda will talk about how to accelerate CI by executing test functions in parallel, across a Docker Swarm-mode cluster. One of the major challenges was the nonuniformity of the makespan. e.g. some chunk of test functions can take 30 minutes, some chunk can take just 10 seconds... So, he mitigates such a nonuniformity by randomizing the composition of chunks of test functions. As a result, for example, the integration test of Docker itself that had taken more than 80 minutes can be finished in 4 minutes, with 10 Docker Swarm-mode nodes. This hack can be easily applied to CI of other software as well.

Parallelizing CI using Docker Swarm-Mode

Akihiro Suda

OPTEE on QEMU - Build Tutorial

Dalton Valadares

How to install_and_configure_r_on_a_linux_server

sushantbit04

Some experiences for porting application to Intel Xeon Phi

Maho Nakata

EM12C High Availability without SLB and RAC

Secure-24

This presentation details some of the basic features of Oracle Solaris 11 that can be used as building blocks to deploy an enterprise application. Specifically, it uses a simple deployment example to create an IPS package for an application, integrates that application with SMF to provide an initial level of continuous service availability, deployed in an Oracle Solaris Zone using network virtualization to throttle bandwidth. Using this simple deployment example, additional integrated services like Immutable Zones, Delegated Administration, Firewall or Load Balancing, an administrator can build up to a more advanced deployment scenario.

Oracle Solaris 11 - Best for Enterprise Applications

glynnfoster

Rule of two

Rich Moyse

This presentation is about the main tasks which Linux kernel platform engineers take care of. The talk includes real-life cases which help understand the role of respective specialists and might be helpful to those who consider such change in their careers. The talk was delivered by Sam Protsenko (Software Engineer, Consultant, GlobalLogic) at GlobalLogic Embedded Career Day #2 on February 10, 2018. More about GlobalLogic Embedded Career Day #2: https://www.globallogic.com/ua/events/globallogic-kyiv-embedded-career-day-2-materials

Linux Kernel Platform Development: Challenges and Insights

GlobalLogic Ukraine

Polstra 44con2012

Philip Polstra

Hacking and Forensics on the Go - 44CON 2012

44CON

This talk will focus on how we deploy and manage CentOS on our fleet at Facebook, and showcase challenges, best practices and lessons learned working with a deployment of hundreds of thousands of machines. We'll discuss challenges encountered over the years, tools that we developed to overcome them, the process used to integrate upstream updates, packaging tools and workflows and configuration management challenges. The talk is mostly focused on bare metal, but will cover some container best practices as well. We'll also focus on our interactions with the RPM, Yum, Anaconda and systemd projects to showcase how to work with the upstream community.

Running CentOS on the Facebook fleet

Davide Cavalca

NFD9 - Matt Peterson, Data Center Operations

Cumulus Networks

Docker and Puppet — Puppet Camp L.A. — SCALE12X

Jérôme Petazzoni

Ähnlich wie TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012 (20)

Deploying Foreman in Enterprise Environments

OpenNebula, the foreman and CentOS play nice, too

the NML project

The Deck by Phil Polstra GrrCON2012

AWS Community Day 2022 David Kirk_Hybrid Local Development Environments with...

Real-World Docker: 10 Things We've Learned

Cobbler, Func and Puppet: Tools for Large Scale Environments

Parallelizing CI using Docker Swarm-Mode

OPTEE on QEMU - Build Tutorial

How to install_and_configure_r_on_a_linux_server

Some experiences for porting application to Intel Xeon Phi

EM12C High Availability without SLB and RAC

Oracle Solaris 11 - Best for Enterprise Applications

Rule of two

Linux Kernel Platform Development: Challenges and Insights

Polstra 44con2012

Hacking and Forensics on the Go - 44CON 2012

Running CentOS on the Facebook fleet

NFD9 - Matt Peterson, Data Center Operations

Docker and Puppet — Puppet Camp L.A. — SCALE12X

Mehr von TAUS - The Language Data Network

TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...

TAUS - The Language Data Network

TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...

TAUS - The Language Data Network

TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...

TAUS - The Language Data Network

TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...

TAUS - The Language Data Network

TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...

TAUS - The Language Data Network

As contents published on the Internet are becoming more and more dominated by videos, requirements on the language translation have also changed. Specifically, video publishers and distributors have a significant interest in balancing both the translation time and the accuracy. To this end, Pactera has invested in solutions, which leverage machine translation to reduce the overall translation time, and recruit human translators to improve the accuracy in a Wikipedia-like fashion. At Pactera, we aim to help video contents to reach billions of people that were not possible before.

Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...

TAUS - The Language Data Network

Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)

TAUS - The Language Data Network

Review processes as the last step in quality assurance workflows are “notorious for causing delays and frustrations”. The reason normally is a flawed process: Many manual steps for the PMs, the lack of intuitive, layout-oriented collaboration software, plus the expectation of review to “fix a broken translation” in the last second rather than giving strategic process input. globalReview shifts this paradigm: As an integrated, collaborative platform with full layout editing it provides a positive review experience. At the same time, it pushes quality upstream applying DQF principles: Flexible content profiles define precise quality expectations; issue categories and scoring effectively gauge and also track translation quality over time; a sampling module allows for fast yet accurate quality evaluation. Put together, this allows the customer to raise the process from painful review to strategic quality management and gain valuable business intelligence.

Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...

TAUS - The Language Data Network

A translation memory P2P trading platform - to make global translation memory...

TAUS - The Language Data Network

The presentation will introduce the NLP technologies used in Shiyibao and the main product features, covering the following points: Function of giving automatic grades for translations based on translation quality automatic evaluation algorithm; Function of giving automatic comments based on rules matching; Function of sorting translations according to their similarity or some specific fragments to dramatically improve the efficiency of reviewing and commenting on translations.

Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...

TAUS - The Language Data Network

In today’s digital economy, content is becoming smaller, more fragmented, and in need of on-demand translation in minutes and around the clock. Traditional localization models are no longer sufficient in meeting these always-on, agile, fast, and small translation requirements of the digital age. This is why mobile translation services like Stepes that are able to deliver quality, speed, and scalability are poised to see tremendous growth. During this 6-minute presentation, Stepes will demonstrate live its instant human translation service for micro content. Powered by human translators from around the world, Stepes is the world’s first mobile translation ecosystem delivering quality translation services using a networking model similar to Uber and Lyft.

Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...

TAUS - The Language Data Network

Farmer Lv (TrueTran)

TAUS - The Language Data Network

Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...

TAUS - The Language Data Network

Computer Aided Translation Training System (CATS) provides a package solutions to the problems of translation translation. CATS combines artificial intelligence, data collection, and visualization of information technology, which makes the translation teaching, class management and monitoring on one single platform areality. Translation and interpretaton teaching resources on CATS are updated regularly into detailed categories, making the teaching materials easy to access. CATS supports translation and interpretation teaching and practices, company internships as well as scientific research.

The Theory and Practice of Computer Aided Translation Training System, Liu Q...

TAUS - The Language Data Network

Translation Technology Showcase in Shenzhen

TAUS - The Language Data Network

Most of LSPs have not converted the translated bilingual documents to TM till now. Even the LSPs have established TMs, they are also confronted with disordered management of TMs and low efficiency. This report will share the way of quick TM establishment with Tmxmall Cloud-Based Smart Aligner, the way of Management of large-scale TMs with Private Cloud-Based TM for achieving pre-translation with large-scale TMs and team cooperation and etc.. Besides, the report will introduce Tmxmall TM marketplace, which is expected to promote TM sharing. Finally, we will share the experience of LSPs on alignment and Private Cloud-Based TM management for reducing translation costs and increasing profits.

How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)

TAUS - The Language Data Network

SDL is the leader in global content management and language translation solutions. With more than 20 years of experience, SDL helps companies build relevant online experiences that deliver transformative business results on a global scale. Translation Industry continues to grow, and Freelancers, LSPs and Corporate clients all see increased demand as more and more content is created, so we have to address them all. As a Market-leading translation productivity tool, SDL Trados Studio is trusted by over 200,000 translation professionals to boost productivity, control quality and aid collaboration. SDL has launched Trados Studio 2017. This presentation will introduce SDL Trados Studio 2017 and highlight SDL’s new productivity booster- UPLIFT, which is well welcomed by global clients.

SDL Trados Studio 2017, Jocelyn He (SDL)

TAUS - The Language Data Network

How we train post-editors - Yongpeng Wei (Lingosail)

TAUS - The Language Data Network

A use-case for getting MT into your company, Kerstin Berns (berns language c...

TAUS - The Language Data Network

QE integrated in XTM, by Bob Willans (XTM)

TAUS - The Language Data Network

Mehr von TAUS - The Language Data Network (20)