The web in a box - a next generation web framework for the Perl programming language

IRC log for #mojo, 2014-04-06

| Channels | #mojo index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:18 camelo joined #mojo
00:33 thowe joined #mojo
00:34 dvinciguerra joined #mojo
01:31 klapperl joined #mojo
02:52 robinsmidsrod joined #mojo
03:02 sri hmmmm... for splitting up bulk operations into 16mb blocks i'm experimenting with pre-encoding bson documents... this stuff is actually quite cool
03:04 sri my $raw = bson_raw bson_encode {bar => 'baz'};
03:06 sri is_deeply bson_decode(bson_encode {foo => $raw}), {foo => {bar => 'baz'}};
03:52 dj_goku_ joined #mojo
04:28 dotandimet joined #mojo
06:25 Gedge_ joined #mojo
06:38 Vandal joined #mojo
06:52 jack joined #mojo
07:57 dod joined #mojo
08:06 denis_boyun joined #mojo
08:34 dotan joined #mojo
08:48 russum1 joined #mojo
08:51 russum joined #mojo
08:54 russum1 joined #mojo
09:01 cfedde joined #mojo
09:05 basiliscos joined #mojo
09:45 malikai joined #mojo
09:46 malikai threads::shared sucks!
10:02 malikai threads::semaphore sucks worse!
10:06 cfedde joined #mojo
10:18 sh4 joined #mojo
10:20 denis_boyun joined #mojo
10:38 rem_lex| joined #mojo
11:01 d4rkie joined #mojo
11:04 batman #mojo:
11:05 batman ooops
11:15 sh4|2 joined #mojo
11:16 d4rkie joined #mojo
11:26 mire joined #mojo
11:45 nikita joined #mojo
12:01 sujithm joined #mojo
12:08 russum joined #mojo
12:14 russum1 joined #mojo
12:54 sri any thoughts on adding ->Useqq(1) to Mojo::Util::dumper?
12:56 good_news_everyone joined #mojo
12:56 good_news_everyone [mojo] kraih pushed 1 new commit to master: http://git.io/DT5X7A
12:56 good_news_everyone mojo/master 232bed6 Sebastian Riedel: allow dumper to use double quotes or representing string values
12:56 good_news_everyone left #mojo
12:58 sri because this is what i come across debugging bulk operations :) http://pastie.org/8998182
12:59 sri Useqq actually helps a lot there
13:00 sri btw. i've got all blocking bulk operations working now
13:00 sri exception handling required some rethinking, since multiple operations may fail at the same time for unordered bulk operations
13:01 sri replys like this need to be handled http://pastie.org/8998188
13:03 sri hardest part was splitting up bulk operations when they are too big (over 16mb)
13:17 dj_goku_ joined #mojo
13:50 gryphon joined #mojo
14:24 mire joined #mojo
14:49 jberger sri++
14:49 jberger bulk operations sound like a great thing for Mandel
15:26 jack_ joined #mojo
15:32 btyler joined #mojo
15:39 cpan_mojo Mojolicious-Plugin-TagHelpers-Pagination 0.01 by Nils Diewald - http://metacpan.org/release/AKRON/Mojolicious-Plugin-TagHelpers-Pagination-0.01
15:55 cpan_mojo Mojolicious-Plugin-Util-RandomString 0.05 by Nils Diewald - http://metacpan.org/release/AKRON/Mojolicious-Plugin-Util-RandomString-0.05
16:08 alnewkirk joined #mojo
16:08 jberger sri: I'm upgrading Galileo to use secrets, I should have done it months ago :o
16:09 jberger I would like to include some functionality to all the administrator to rotate the secrets, but I can't think up with a reasonable way to do so across all the hypnotoad workers
16:09 sh4 joined #mojo
16:11 jberger or, since the secrets are in the config file, do they simply update the config and hot-restart
16:11 jberger ?
16:11 jberger I guess that works
16:12 jberger they just can't do it from the web admin interface
16:30 jberger Ok. released
16:53 Akron joined #mojo
16:57 Akron jberger: I already thought about a rolling secrets plugin with a separated secret file that roles automatically after a given time. In case the time is long enough there shouldn't be a problem with old workers.
16:59 Akron Just a tiny idea for improving Mojo::URL (I dunno - maybe I didn't think this through): Support URL strings in ->to_abs and ->base. I am always doing Mojo::URL->new($path)->to_abs(Mojo::URL->new($base)) to get absolute URLs when crawling websites.
17:18 spuelrich joined #mojo
17:28 sujithm joined #mojo
17:48 sri and i've got non-blocking bulk operations working too \o/
17:48 sri http://pastie.org/8998659 # they sure are fun
17:50 sri http://pastie.org/8998661 # and bulk operations above the 16mb limit also just work (split up automatically into multiple operations)
17:51 sri http://pastie.org/8998665 # not sure yet how i like the result format
17:55 jberger sri += 2
17:55 jberger cool!
17:57 jberger oh, hmmmm
17:58 jberger I just realized
17:58 jberger all the bulk operations probably have to be in the same collection right/
17:58 jberger ?
17:58 sri they do
17:58 jberger that is still very cool, and useful, but doesn't help Mandel like I was hoping
17:59 sri it's more about performance
18:00 sri you can send 16mb of inserts or updates and if you set the bulk operation to unordered have them performed concurrently
18:00 sri not sure how well mongodb 2.6 uses that yet, but it eleminates a lot of latency
18:01 sri s/e/i/
18:01 sri inserts, updates and deletes are also 3 separate commands the bulk operations have to be mapped to
18:02 sri http://docs.mongodb.org/master/reference/command/insert/#dbcmd.insert
18:02 sri http://docs.mongodb.org/master/reference/command/update/#dbcmd.update
18:03 Eke- joined #mojo
18:03 sri you could actually call those commands yourself with $db->command(bson_doc insert => 'some_collection', documents => [...])
18:03 sri :)
18:04 * jberger reads
18:05 sri write commands might be a first step though... wouldn't be surprised if the next step was a new storage engine with ACID transactions
18:05 hummeleBop joined #mojo
18:05 jberger that is really what Mandel needs
18:06 sri i rarely really need transactions
18:06 sri atomicity is overrated
18:06 * jberger ponders
18:06 sri in minion for example i use overly specific update operations to avoid conflicts
18:07 sri https://github.com/kraih/minion/blob/master/lib/Minion/Job.pm#L42
18:09 buu joined #mojo
18:10 marty joined #mojo
18:11 jberger it would be neat if we could get Mango added to this list: http://docs.mongodb.org/ecosystem/drivers/community-supported-drivers/
18:12 jberger actually that is a doc on github
18:12 sri neat
18:12 jberger should we add it sri?
18:12 sri sure
18:13 jberger shoot, I have to step out
18:13 jberger if you don't do it, I will when I get back
18:13 sri i'll finish the bulk api tests first :)
18:20 Eke- joined #mojo
18:34 rem_lex joined #mojo
18:43 sri and committed \o/ https://github.com/kraih/mango/commit/55acbd29f7edaf2fc1e51d7e4bafef028a1ac61d
19:13 russum joined #mojo
20:04 denis_boyun joined #mojo
20:06 meshl joined #mojo
20:12 marcus joined #mojo
20:24 russum joined #mojo
20:43 meshl joined #mojo
21:04 meshl joined #mojo
21:39 russum1 joined #mojo
22:37 d4rkie joined #mojo
23:13 jack joined #mojo
23:24 jack joined #mojo
23:53 disputin joined #mojo

| Channels | #mojo index | Today | | Search | Google Search | Plain-Text | summary