The document summarizes a presentation given by David Golden on using MongoDB and Perl together. It discusses how MongoDB and Perl have similar data modeling approaches using dynamic data structures. It also notes some challenges of each, such as missing features in MongoDB and quirks in Perl, but says that both have enthusiastic communities. The document advocates for trying out MongoDB and getting involved with its community.

1. Juggling Chainsaws
David Golden
Senior Engineer, MongoDB
YAPC::NA 2015

2. I lead the
MongoDB Perl
driver project

5. Do I need to explain
what MongoDB is?

7. NoSQL

8. Not NoSQL

9. Not NoSQL

10. Documents
Auto-sharding
Native replication
Pluggable storage engines
Aggregation framework queries
Comprehensive secondary indexes
Multiple geospatial indexes and text search
ACID guarantees available at the document level
Fault tolerance and disaster recovery through automated failover
Enterprise-version has extensive capabilities for authentication, authorization, auditing and encryption
Ops Manager and MMS provide continuous incremental backup, point-in-time recovery of replica sets and consistent snapshots of sharded clusters.

11. Documents
Auto-sharding
Native replication
Pluggable storage engines
Aggregation framework queries
Comprehensive secondary indexes
Multiple geospatial indexes and text search
ACID guarantees available at the document level
Fault tolerance and disaster recovery through automated failover
Enterprise-version has extensive capabilities for authentication, authorization, auditing and encryption
Ops Manager and MMS provide continuous incremental backup, point-in-time recovery of replica sets and consistent snapshots of sharded clusters.

12. "Troll" © S.L.M Roma https://flic.kr/p/4uRvNc (CC BY-NC-SA)

13. "chainsaws are fun" © Ryan Kathleen https://flic.kr/p/5zY75A (CC BY)

14. "London Juggler" © Leon Benjamin https://flic.kr/p/cmTzL (CC BY)

15. "London Juggler" © Leon Benjamin https://flic.kr/p/cmTzL (CC BY)

16. Perl and MongoDB are
surprisingly similar

17. ster·e·o·type
noun
a widely held but fixed and
oversimplified image or idea of a
particular person or thing

18. Trolls love stereotypes

19. Trolls
Perl and MongoDB
♥

20. Trolls
Perl and MongoDB
💩

21. Let's play
Guess the meme!

22. "___ is dead"

23. "Dead camel" © Nick Brooks https://flic.kr/p/ivZdP (CC BY-NC-SA)

24. "___ is web scale"

25. "MongoDB is web Scale" © gar1t http://www.mongodb-is-web-scale.com/

26. "___ is line noise"

27. $_='ev
al("seek040D
ATA,0, 0;");foreach(1..3)
{<DATA>;}my @camel1hump;my$camel;
my$Camel ;while( <DATA>){$_=sprintf("%-6
9s",$_);my@dromedary 1=split(//);if(defined($
_=<DATA>)){@camel1hum p=split(//);}while(@dromeda
ry1){my$camel1hump=0 ;my$CAMEL=3;if(defined($_=shif
t(@dromedary1 ))&&/S/){$camel1hump+=1<<$CAMEL;}
$CAMEL--;if(d efined($_=shift(@dromedary1))&&/S/){
$camel1hump+=1 <<$CAMEL;}$CAMEL--;if(defined($_=shift(
@camel1hump))&&/S/){$camel1hump+=1<<$CAMEL;}$CAMEL--;if(
defined($_=shift(@camel1hump))&&/S/){$camel1hump+=1<<$CAME
L;;}$camel.=(split(//,"040..m`{/J047134}L^7FX"))[$camel1h
ump];}$camel.="n";}@camel1hump=split(/n/,$camel);foreach(@
camel1hump){chomp;$Camel=$_;y/LJF7173175`047/061062063
064065066067070/;y/12345678/JL7F175173047`/;$_=reverse;
print"$_040$Cameln";}foreach(@camel1hump){chomp;$Camel=$_;y
/LJF7173175`047/12345678/;y/12345678/JL7F1751730 47`/;
$_=reverse;print"040$_$Cameln";}';;s/s*//g;;eval; eval
("seek040DATA,0,0;");undef$/;$_=<DATA>;s/s*//g;( );;s
;^.*_;;;map{eval"print"$_"";}/.{4}/g; __DATA__ 124
1 501450401651631450401571 460401 410
40143141 1551451 540401 51155 141
1471450 40151156 040141 16316 3
157143 15114116 41511 57156
040167 1511641 50040 1201
45162 15404015 1163 04014
10401 641621 41144 145
15514 1162 15304 0157
146 04011 7047 1221
4515 11541 54171 040
046 01210116 316
315 714315 114
116 4145163 054
040 11115614 3056
040 12516314514 4040
1671 511641 500 40160
145162 155151
"Camel JAPH" © Erudil http://www.cpan.org/misc/japh

28. "___ will lose your data"

31. "___ is read only"

32. "fresh ramen noodle" © Kropsoq http://goo.gl/mu2fIQ (CC BY-SA)

33. "__ is unsafe by default"

34. TRICK QUESTION!

35. &

36. ✓ Grief from haters

37. ✓ Similar data model

38. "A hash brown patty" © Mike.lifeguard http://goo.gl/2we5ye (CC BY-SA)

39. "buy it in bottles" © Pete https://flic.kr/p/qbvaRb (CC BY)

40. perldsc

41. Data Structures
Cookbok

42. HoH,AoH, HoA,AoA…

45. Perl programmers use
dynamic data structures
all the time!!!

46. MongoDB
♥
Data Structures

47. Licensed under Fair use via Wikipedia - https://en.wikipedia.org/wiki/File:TICK_COMIC_CON_EXTRAVAGANZA_1.jpg

48. {
name => 'The Tick',
battlecry => 'Spoon!',
birthday => '1973-07-16',
relations => {
friends => [
'Arthur',
'Die Fledermaus',
'American Maid',
],
foes => [
'The Terror',
'Thrakkorzog',
],
}

49. Sort heroes by
first friend's name?

50. {
name => 'The Tick',
battlecry => 'Spoon!',
birthday => '1973-07-16',
relations => {
friends => [
'Arthur',
'Die Fledermaus',
'American Maid',
],
foes => [
'The Terror',
'Thrakkorzog',
],
}

51. # Perl using Schwartzian Transform
my @sorted =
map { $_->[0] }
sort { $a->[1] cmp $b->[1] }
map { [$_, $_->{relations}{friends}[0] };

52. # MongoDB using query with sort clause
my @sorted = $heroes->find(
{}, { sort => [ 'relations.friends.0' => 1 ] }
)->all;

53. # Perl using Schwartzian Transform
my @sorted =
map { $_->[0] }
sort { $a->[1] cmp $b->[1] }
map { [$_, $_->{relations}{friends}[0] };
# MongoDB using query with sort clause
my @sorted = $heroes->find(
{}, { sort => [ 'relations.friends.0' => 1 ] }
)->all;

54. ✓ Missing things others
take for granted

55. No function signatures

56. No read committed

57. No concurrency

58. No transactions

59. No (real) OO

60. No joins

61. No booleans

62. No stored procedures

63. ✓ Experienced users
work around flaws

64. Non-idempotent writes

65. Strings for errors

66. Consensus read

67. Version numbers

68. Version numbers

69. Query "language"

70. Ambiguous scalar type

71. 16MB doc limit

72. IO layers

73. Rollback on failover

74. ✓ Vibrant, enthusiatic
communities

75. MUGs
Perl Mongers

76. Conferences
Mailing Lists
IRC

77. ✓ Similar philosophies

78. Manipulexity
Whipuptitude

79. Manipulexity
Manipulation of complex things
— Larry Wall

80. Whipuptitude
Aptitude for whipping things up
— Larry Wall

81. Tools for getting
the job done

82. Swiss-Army knife?

83. Swiss-Army chainsaw!!!

84. Henry Spencer described the Perl scripting
language as a “Swiss-Army chainsaw”, intending
to convey his evaluation of the language as
exceedingly powerful but ugly and noisy and
prone to belch noxious fumes.
— The Jargon File

85. This had two results: (1) Perl fans adopted the
epithet as a badge of pride, and (2) it entered
more general usage to describe software that is
highly versatile but distressingly inelegant.
— The Jargon File

86. Highly versatile but
distressingly inelegant?

87. YES

88. Great at a few things

89. Good enough
for many things

90. And if one is good,
wouldn't two be better?

91. +

92. "Camel warning sign UAE" © Katzenmeier http://commons.wikimedia.org/wiki/File:Camel_warning_sign_UAE.jpg (PD)

93. CPAN Meta file
indexing

94. META.json

95. {
"abstract" : "File path utility",
"author" : [
"David Golden <dagolden@cpan.org>"
],
"name" : "Path-Tiny",
"prereqs" : {
"runtime" : {
"requires" : {
"Carp" : "0",
"Cwd" : "0",
"Digest" : "1.03",
"Digest::SHA" : "5.45",
...
},
},
...
},
"provides" : {
"Path::Tiny" : {
"file" : "lib/Path/Tiny.pm",
"version" : "0.068"
},
...
},
"release_status" : "stable",
...
"x_contributors" : [
"Alex Efros <powerman@powerman.name>",
...
],
...
}

96. Thought experiment:
Rebuild CPAN?

97. Rebuilding CPAN?
• Tarball storage
• Tarball processing
• Worker logs
• Index lookup
• Text search

98. # store a file
open $fh, "<", $tarball_path;
$gridfs = $db->get_gridfs("tarballs");
$id = $gridfs->put($fh, $metadata);
# get a file
$bytes = $gridfs->get($id)->slurp;
Storage: GridFS

99. # in supervisor
my $queue = MongoDBx::Queue->new(...);
$queue->add_task({ tarball_id => $id });
# in worker
while ( my $task = $queue->reserve_task )
{
# ... process tarball ...
$queue->remove_task( $task );
}
Processing: MongoDBx::Queue

100. $db->run_command([
create => "pause_log",
capped => true,
max => 1000,
]);
$log->find(
{}, { cursorType => 'tailable' }
);
Logging: capped collection

101. $packages->find(
{
mod => "Foo",
ver => {
'$gte' => $v_min,
'$lte' => $v_max,
},
}
);
Index lookup: query language

102. $packages->find(
{
mod => "Foo::Bar",
ver => {
'$gte' => $v_min,
'$lte' => $v_max,
},
}
);
Index lookup: query language

103. $meta->find(
{
'_authorized.Foo' => true
'release_status' => 'stable',
}
);
# sort through versions client side
# with version.pm
Index lookup (take 2)

104. $meta->indexes->create_one([
abstract: "text",
keywords: "text",
]);
$meta->find( {
'$text' => {
'$search' => "dist zilla plugin"
}
});
Text search: text indexes

105. Some other handy tools
• Geographic indexing and search
• TTL indexes (auto-expiration)

106. "The Long Road" © Corey Leopold https://flic.kr/p/6AX7aq (CC BY)

107. Coming soon:
MongoDB v1.0.0 Beta 1

108. Coming soon:
MongoDB v1.0.0 Beta 1
Right after
this talk!

109. Coming soon:
MongoDB v1.0.0 Beta 1
Right after
this talk!
Before
Lunch

110. Coming soon:
MongoDB v1.0.0 Beta 1
Right after
this talk!
Before
LunchDuring
YAPC

111. Coming soon:
MongoDB v1.0.0 Beta 1
Right after
this talk!
Before
LunchDuring
YAPC
Right
now?

112. • Better server discovery, monitoring, failover
• Immutable config (and no more globals!)
• New CRUD and Index APIs
• Consistent error handling
• Progress towards a pure-Perl option
• BSON round-trippability

113. "Dub Dub Dub" © Owen B https://flic.kr/p/8jGEnz (CC BY-NC)

114. What I ask of you...

115. Try it out!

116. Or, try it out again!

117. Get involved!

118. • Download MongoDB
• Try the beta driver
• Find a MUG near you
• Follow my blog (dagolden.com)
• Follow me on twitter (@xdg)
• ++ the driver on MetaCPAN
• Ask questions

119. Questions?
david@mongodb.com