Camelia, the Perl 6 bug

IRC log for #metacpan, 2013-07-31

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:23 shmuel joined #metacpan
01:25 klapperl_ joined #metacpan
01:51 mateu i'm curious how metacpan has tuned its elasticsearch configuration, particularly memory related settings
02:22 oalders mateu: https://github.com/CPAN-API/metacpan-pu​ppet/tree/master/modules/elasticsearch
02:22 dipsy [ metacpan-puppet/modules/elasticsearch at master · CPAN-API/metacpan-puppet · GitHub ]
02:32 mateu oalders: thank you, am I parsing correctly that you only set ES_MAX_MEM to 64MB?
02:32 oalders hmm… that can't be right
02:35 mateu # Maximum Java Heap Size (in MB) \ wrapper.java.maxmemory=%ES_MAX_MEM%
02:36 oalders mateu: manifests/nodes/bm-n2.pp
02:36 oalders that's our production node
02:36 oalders elasticsearch { "0.20.2": memory  => 18000 }
02:36 mateu also 18000 MB, or 18G gotcha, thanks
02:37 oalders yeah, that makes more sense :)
02:37 mateu s/also//, yes makes more sense - thanks a ton
02:37 mateu i'm running into oom stuff and thought you guys may have dealt with this before
02:38 oalders for sure. the production machine has 32245 mb of RAM
02:38 oalders so, we've got some headroom
02:38 oalders but it's very easy to run out of memory
02:39 mateu that's helpful to know as well, provides a heap/total ratio
02:41 mateu it looks like your using mlockall as well
02:41 mateu that caused me some jvm exits
02:43 mateu oalders: are you using just one node in production?
02:43 oalders mateu: one node
02:43 mateu wow, that's impressive
02:43 oalders is it?
02:43 dipsy is it fuck
02:44 mateu at least to me it is ;)
02:44 oalders :)
02:44 oalders we only have one machine in the data centre we're hosted in
02:44 mateu but then I'm struggling finding the sweet spot on configuration, thanks for your help
02:45 oalders i'm no expert on this stuff, but at least i know where to find the config :)
03:25 preflex_ joined #metacpan
03:33 metacpan joined #metacpan
03:33 metacpan [metacpan-web01] oalders created omega/release-changes (+3 new commits): http://git.io/fphzWw
03:33 metacpan metacpan-web/omega/release-changes 638b1bb Andreas Marienborg: Add last release changes on release page...
03:33 metacpan metacpan-web/omega/release-changes dd566ef Andreas Marienborg: Add dep to cpanfile as well
03:33 metacpan metacpan-web/omega/release-changes 79e2efd Andreas Marienborg: Only warn of parse failure in debug mode
03:33 metacpan left #metacpan
03:33 dipsy [ Comparing 638b1bbf4221^...79e2efd3409f · CPAN-API/metacpan-web · GitHub ]
03:45 oalders new version of common::sense was released today and that's failing to install on travis
03:48 omega ahh, I see
03:53 rwstauner yeah, that's what i've noticed so far as well
03:53 rwstauner another lump of crap
03:53 rwstauner and it looks like the old ones have been backpanned already
03:53 metacpan joined #metacpan
03:54 metacpan [metacpan-web01] oalders pushed 1 new commit to omega/release-changes: http://git.io/TId-yg
03:54 metacpan metacpan-web/omega/release-changes e00bd9e Olaf Alders: common::sense 3.71 breaks the Travis build.
03:54 metacpan left #metacpan
03:54 dipsy [ common::sense 3.71 breaks the Travis build. · e00bd9e · CPAN-API/metacpan-web · GitHub ]
03:54 rwstauner i don't really know why it breaks, though
03:54 oalders 3.6 should still be around
03:54 oalders i have to go to s.c.o for this stuff ;)
03:54 rwstauner yeah, which apparently had some issue on 5.16
03:54 rwstauner yeah i did
03:55 oalders is there a backpanned version that's better?
03:55 rwstauner not sure
03:55 rwstauner i only read the changelog
03:55 oalders what brought this dep? did we have it before?
03:55 rwstauner too much crap
03:55 rwstauner JSON::XS being the biggest one
03:55 oalders heh
03:55 oalders ah
03:55 rwstauner and a number of AnyEvent modules
03:55 rwstauner the new one *does* install on my local pc
03:56 rwstauner but i get a stupid warning that it won't actually be used
03:56 rwstauner b/c the older version is installed earlier in @INC
03:56 oalders that's bizarre
03:56 rwstauner so it says i should install with 'make UNINST=1' or whatever
03:56 rwstauner but it does install, so i'm not sure why the other mods think it fails
03:56 oalders at least Travis starts clean
03:57 rwstauner yeah
03:57 omega am I the only one unable to find common::sense on metacpan?
03:57 rwstauner i was going to try to do a query to see what dists depend on what version
03:57 rwstauner omega: just you and everyone else
03:57 rwstauner there have been at least 3 gh issues for it
03:58 omega I see
03:58 omega :)
03:58 oalders so, my change didn't fix anything
03:58 oalders still tried to install 3.71
03:58 rwstauner an angry person might say "the dist is too stupid and crappy for any of us to take the time to parse it"
03:58 rwstauner but another person might put it another way
03:59 rwstauner back to my query... i need to see if there's an example, b/c filtering by a specific version of a dep requires a nested query or something like that
04:02 rwstauner apparently 3.6 is the one that gets picked up on my machine
04:03 metacpan joined #metacpan
04:03 metacpan [metacpan-web01] oalders pushed 1 new commit to omega/release-changes: http://git.io/teWSSg
04:03 metacpan metacpan-web/omega/release-changes 90ef701 Olaf Alders: Brute force common-sense-3.6
04:03 metacpan left #metacpan
04:03 dipsy [ Brute force common-sense-3.6 · 90ef701 · CPAN-API/metacpan-web · GitHub ]
04:04 oalders your mirror is maybe a bit behind?
04:04 rwstauner oalders: no, i mean b/c the installer is broken
04:04 oalders ah
04:04 rwstauner he changed it to install into an arch-specific path
04:04 rwstauner so the old version stays around
04:04 oalders that's so helpful
04:05 rwstauner pisses me off
04:06 oalders :)
04:06 metacpan joined #metacpan
04:06 metacpan [metacpan-web01] oalders pushed 1 new commit to omega/release-changes: http://git.io/w8TPhw
04:06 metacpan metacpan-web/omega/release-changes 63b3cf9 Olaf Alders: Try to install common::sense first.
04:06 metacpan left #metacpan
04:06 dipsy [ Try to install common::sense first. · 63b3cf9 · CPAN-API/metacpan-web · GitHub ]
04:06 oalders this is actually becoming a bit of a pain
04:08 rwstauner indeed
04:08 grantm perhaps someone should fork JSON::XS to JSON::XSSane and remove the common::sense dependency
04:08 rwstauner grantm: i was thinking the same thing
04:09 rwstauner sadly AnyEvent is a bigger problem
04:09 grantm :-(
04:09 rwstauner though that module has it's own baggage
04:09 rwstauner yes, cpan without MLEHMANN would be a better place
04:10 rwstauner so, it gets better
04:10 grantm to be fair, JSON::XS hugely advanced the state of JSON in Perl
04:10 rwstauner i pm-uninstall 'ed it
04:10 rwstauner and upon reinstall the tests fail
04:10 rwstauner so now i have no version
04:11 rwstauner my perlbrews are about to send a butt-load of FAIL reports
04:11 rwstauner grantm: that's the sad thing... there's definite technical merit in Marc's work... he must be a fairly smart guy
04:11 rwstauner but he's a super-asshole
04:11 rwstauner and does a lot of stupid things
04:13 * rwstauner is tempted to install more perls so i can send more FAIL reports
04:13 haarg grantm: JSON::MaybeXS
04:14 oalders build still fails
04:14 rwstauner JSON does choose b/t XS and PP
04:14 oalders whoever pushes to master next will break the build on that branch
04:15 rwstauner the good news is that he's still actively releasing, so maybe he'll fix it
04:15 rwstauner oalders: we could try a url for 3.5
04:16 rwstauner since we know where we can find a backpan mirror ;-)
04:16 oalders heh
04:16 rwstauner and we could even jam it in to the travis install step (rather than the deps) if we need to
04:16 oalders yeah, that's what i was thinking
04:16 oalders that's the safe way
04:19 metacpan joined #metacpan
04:19 metacpan [metacpan-web01] oalders pushed 1 new commit to omega/release-changes: http://git.io/qoNg1w
04:19 metacpan metacpan-web/omega/release-changes 6da4b4f Olaf Alders: Install common::sense in before_install phase.
04:19 metacpan left #metacpan
04:19 dipsy [ Install common::sense in before_install phase. · 6da4b4f · CPAN-API/metacpan-web · GitHub ]
04:20 haarg taking a look at the the new common::sense, he moved it to the arch dir
04:20 haarg but that's entirely correct
04:20 haarg the problem is that it just installs to a busted location
04:20 haarg not sure why
04:21 haarg i'm guessing because EUMM is a pile of dicks
04:24 haarg at first glance it's due to EUMM and how it handles old style dists with everything in the root dir
04:27 metacpan joined #metacpan
04:27 metacpan [metacpan-web01] oalders force-pushed omega/release-changes from 6da4b4f to 72e2c42: http://git.io/5T6-Bg
04:27 metacpan metacpan-web/omega/release-changes 72e2c42 Olaf Alders: Install common::sense in before_install phase.
04:27 metacpan left #metacpan
04:27 dipsy [ Commits · CPAN-API/metacpan-web · GitHub ]
04:32 hanekomu_ joined #metacpan
04:33 Khisanth joined #metacpan
04:36 metacpan joined #metacpan
04:36 metacpan [metacpan-web01] oalders force-pushed omega/release-changes from 72e2c42 to 4a20a89: http://git.io/5T6-Bg
04:36 metacpan metacpan-web/omega/release-changes 4a20a89 Olaf Alders: Install common::sense in before_install phase.
04:36 metacpan left #metacpan
04:36 dipsy [ Commits · CPAN-API/metacpan-web · GitHub ]
04:43 oalders it's actually getting to the test suite this time
04:44 oalders 5 green lights
04:44 oalders and with that i shall retire for the evening
04:46 omega good night :)
04:49 metacpan joined #metacpan
04:49 metacpan [metacpan-web01] oalders pushed 1 new commit to master: http://git.io/ICIiPQ
04:49 metacpan metacpan-web/master 69f6d46 Olaf Alders: Merge pull request #889 from omega/omega/release-changes...
04:49 metacpan left #metacpan
04:49 dipsy [ Merge pull request #889 from omega/omega/release-changes · 69f6d46 · CPAN-API/metacpan-web · GitHub ]
04:50 metacpan joined #metacpan
04:50 metacpan [metacpan-web01] oalders pushed 1 new commit to master: http://git.io/mPWwYw
04:50 metacpan metacpan-web/master ea40360 Olaf Alders: Install common::sense in before_install phase.
04:50 metacpan left #metacpan
04:51 dipsy [ Install common::sense in before_install phase. · ea40360 · CPAN-API/metacpan-web · GitHub ]
04:51 oalders omega++
04:51 oalders i won't deploy that just now as i actually do want to go to bed
04:51 oalders but i just tested it and it looks great
04:52 rwstauner oalders++
04:52 rwstauner bed++
04:52 oalders rwstauner++ haarg++ bed++
04:53 hanekomu joined #metacpan
04:57 ether_ joined #metacpan
04:58 omega \o/
05:18 shmuel joined #metacpan
06:29 Mike-PerlRecruiter_ joined #metacpan
08:53 alnewkirk joined #metacpan
09:34 daxim joined #metacpan
11:51 shmuel joined #metacpan
13:22 talexb Mmm .. common::sense.
14:33 oalders as it slowly begins to break other things, people will keep opening new tickets about how they can't find it on metacpan
14:34 oalders looks like this release is messing up searches for cpanm https://metacpan.org/release/pantheon
14:34 dipsy [ pantheon-0.10 - A suite of cluster administration platforms - metacpan.org ]
14:36 rwstauner lovely
14:37 oalders the issue with specifying a specific version of common::sense is problematic. if the install tool is using MetaCPAN, it won't get any API results for that module
14:38 rwstauner yeah i thought about that last night
14:38 oalders we may need to break down and actually index that thing
14:39 rwstauner yeah we should
14:39 rwstauner but as you know, it just pisses me off
14:39 rwstauner 😬
14:39 oalders :D
14:39 rwstauner i know there are other dists out there that do the .pm.PL thing
14:40 rwstauner but they must all be less popular
14:40 rwstauner i'd also love to properly index perl releases so we have all the docs
14:40 oalders what's the issue with perl releases?
14:45 rwstauner just that they have to be built
14:45 rwstauner i believe some of the documentation is generated during the build process
14:46 rwstauner so we have to actually ./Configure -de && make or something like that
14:46 rwstauner and then index the built dir
14:46 oalders ah
14:47 oalders don't think we have an open issue for that
14:53 rwstauner yeah we do
14:53 rwstauner i don't know the number, but i'm sure we do
14:54 oalders ok :)
15:04 * rwstauner ESP is fading
15:04 * rwstauner feeling weak
15:18 * talexb suggests coffee.
15:19 daxim the lips acquire stains, the stains become a warning
16:34 tianon joined #metacpan
17:17 bowtie_ joined #metacpan
18:26 Mike-PerlRecruiter_ joined #metacpan
19:53 ranguard was someone going to look at creating sitemaps for metacpan?
19:54 * ranguard remembers discussing it ages ago
19:58 Skunix joined #metacpan
19:59 oalders ranguard: i don't remember any volunteers
19:59 oalders this is part of the SEO master plan?
20:22 bowtie_ silly Q it may be, but I noticed today that some of my cpan modules have been tagged as favourite, how do I ask who did the tagging please
20:31 oalders bowtie: https://github.com/CPAN-API/metacpan-e​xamples/blob/master/scripts/endpoints/​favorite/6-list-plussers-by-module.pl
20:31 dipsy [ metacpan-examples/scripts/endpoints/f​avorite/6-list-plussers-by-module.pl at master · CPAN-API/metacpan-examples · GitHub ]
20:32 oalders you'll only get names of PAUSE authors. if the user is not an author, you won't know who they are
20:48 bowtie_ oalders: thanks for that
20:48 oalders :)
20:49 oalders that should be incorporated into the site soonish
20:49 * oalders says hopefully
20:51 bowtie_ oalders: any chance you can add some options here: https://metacpan.org/favorite
20:52 oalders bowtie: which options?
20:52 bowtie_ https://metacpan.org/favorite/leaderboard and https://metacpan.org/favorite/recent
20:53 dipsy [ ++ Leaderboard - metacpan.org ] [ Recent ++ Activity - metacpan.org ]
20:53 oalders ah, you're saying we should actually use /favorite as an URL?
20:53 bowtie_ oalders: yes please
20:54 oalders that's entirely reasonable :)
20:54 oalders bowtie: could you open an issue for this on metacpan-web ?
20:55 bowtie_ oalders: will do :)
20:55 oalders bowtie++
20:59 bowtie_ oalders: done: https://github.com/CPAN-API​/metacpan-examples/issues/4
20:59 dipsy [ can you use /favorite as an URL · Issue #4 · CPAN-API/metacpan-examples · GitHub ]
20:59 oalders bowtie: thanks!
20:59 bowtie_ oalders: np
23:53 talexb rwstauner++ Quick work!

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary