The SAWA Corpus - A parallel Corpus English - Swahili

•Download as PPT, PDF•

1 like•1,004 views

Guy De Pauw

by Guy De Pauw, Peter Waiganjo Wagacha and Gilles-Maurice de Schryver

Technology

The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

Resource-scarceness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data-driven approaches ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Machine Translation ,[object Object],[object Object],[object Object],[object Object],data-driven Learn translation from examples: !! Parallel corpus !!

Parallel Corpus ,[object Object],[object Object],[object Object]

Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

3 phases ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Word alignment ,[object Object],No she ‘ s uh , , up north La , , , yuko , aa juu kaskazini

Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

Word alignment ,[object Object],[object Object]

Current results ,[object Object],Precision Recall F (  =1) 39.4% 44.5% 41.79%

Alignment problems nimemkatalia have turned him down I

Morphological decomposition have turned him down I ni+ me+ m+ katalia

Current results ,[object Object],[object Object],Precision Recall F (  =1) 50.2% 64.5% 55.8%

Future work ,[object Object],[object Object],[object Object]

Future work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object]

Similar to The SAWA Corpus - A parallel Corpus English - Swahili

Writing Template With Drawing Box. Online assignment writing service.Jeanne Hall

CASL Report1TEDxBaltimore

Essay On Down Syndrome.pdfChristina Morgan

Essay On Down Syndrome.pdfJenn Cooper

How To Write An Essay On Your Ipad. Online assignment writing service.Amy Cruz

Doc106Dr Lendy Spires

Writing To Inform - Poverty - GCSE English - Marked By Teachers.ComNicole Gomez

Examples Of Informal Essay. Fantastic Informal Essay ThatsnotusHeidi Marshall

Essay Writers Online.pdfVictoria Coleman

Essay Writers Online. College essay: Professional essay writers onlineYngris Seino

Essay On ReligionRobin Ortiz

Community Health and Social Services Network: Improving Access to Health and ...CMA Medeiros

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docxlorileemcclatchie

Similar to The SAWA Corpus - A parallel Corpus English - Swahili (13)

Writing Template With Drawing Box. Online assignment writing service.

CASL Report1

Essay On Down Syndrome.pdf

How To Write An Essay On Your Ipad. Online assignment writing service.

Doc106

Writing To Inform - Poverty - GCSE English - Marked By Teachers.Com

Examples Of Informal Essay. Fantastic Informal Essay Thatsnotus

Essay Writers Online.pdf

Essay Writers Online. College essay: Professional essay writers online

Essay On Religion

Community Health and Social Services Network: Improving Access to Health and ...

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docx

Recently uploaded

Designing for Hardware Accessibility at ComcastUXDXConf

Intro in Product Management - Коротко про професію продакт менеджераMark Opanasiuk

Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin

10 Differences between Sales Cloud and CPQ, Blanka DoktorováCzechDreamin

Google I/O Extended 2024 WarsawGDSC PJATK

Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge

What's New in Teams Calling, Meetings and Devices April 2024Stephanie Beckett

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlPeter Udo Diehl

Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomCzechDreamin

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfFIDO Alliance

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin

Where to Learn More About FDO _ Richard at FIDO Alliance.pdfFIDO Alliance

Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Julian Hyde

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...marcuskenyatta275

Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin

ECS 2024 Teams Premium - Pretty SecureFemke de Vroome

Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxDavid Michel

WSO2CONMay2024OpenSourceConferenceDebrief.pptxJennifer Lim

The Metaverse: Are We There Yet?Mark Billinghurst

IESVE for Early Stage Design and PlanningIES VE

Recently uploaded (20)

Designing for Hardware Accessibility at Comcast

Intro in Product Management - Коротко про професію продакт менеджера

Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade

10 Differences between Sales Cloud and CPQ, Blanka Doktorová

Google I/O Extended 2024 Warsaw

Enterprise Knowledge Graphs - Data Summit 2024

What's New in Teams Calling, Meetings and Devices April 2024

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl

Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...

Where to Learn More About FDO _ Richard at FIDO Alliance.pdf

Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...

Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder

ECS 2024 Teams Premium - Pretty Secure

Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

The Metaverse: Are We There Yet?

IESVE for Early Stage Design and Planning

The SAWA Corpus - A parallel Corpus English - Swahili

1. The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

10.

11.

12. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

13. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

14. Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

15. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

16. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

17. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

18. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

19. Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

20. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

21.

22. Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

23.

24.

25.

26. Alignment problems nimemkatalia have turned him down I

27. Morphological decomposition have turned him down I ni+ me+ m+ katalia

28.

29.

30.

31.

32.

The SAWA Corpus - A parallel Corpus English - Swahili

Recommended

Recommended

More Related Content

Similar to The SAWA Corpus - A parallel Corpus English - Swahili

Similar to The SAWA Corpus - A parallel Corpus English - Swahili (13)

More from Guy De Pauw

More from Guy De Pauw (20)

Recently uploaded

Recently uploaded (20)

The SAWA Corpus - A parallel Corpus English - Swahili