Camelia, the Perl 6 bug

IRC log for #metacpan, 2013-09-19

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:15 klapperl joined #metacpan
03:03 mauke_ joined #metacpan
03:05 preflex_ joined #metacpan
06:24 neilb joined #metacpan
07:16 neilb joined #metacpan
07:35 daxim joined #metacpan
07:44 neilb joined #metacpan
07:59 daxim joined #metacpan
07:59 preflex joined #metacpan
07:59 mauke joined #metacpan
07:59 klapperl joined #metacpan
07:59 tianon joined #metacpan
07:59 talexb joined #metacpan
07:59 ranguard joined #metacpan
07:59 dipsy joined #metacpan
07:59 jwang joined #metacpan
07:59 kentaro joined #metacpan
07:59 alnewkirk joined #metacpan
07:59 ether joined #metacpan
07:59 daemon joined #metacpan
07:59 ilmari_ joined #metacpan
07:59 dolmen joined #metacpan
07:59 SineSwiper_ joined #metacpan
07:59 ribasushi joined #metacpan
07:59 avar joined #metacpan
07:59 kentnl joined #metacpan
07:59 lestrrat joined #metacpan
07:59 rwstauner joined #metacpan
07:59 omega joined #metacpan
07:59 bowtie joined #metacpan
07:59 mattp joined #metacpan
07:59 GumbyNET7 joined #metacpan
07:59 Khisanth joined #metacpan
07:59 GumbyNET5 joined #metacpan
07:59 idn joined #metacpan
07:59 BinGOs joined #metacpan
07:59 burnersk joined #metacpan
07:59 mo joined #metacpan
07:59 shibayu36 joined #metacpan
07:59 plu joined #metacpan
07:59 grantm joined #metacpan
07:59 genehack joined #metacpan
07:59 trs joined #metacpan
07:59 castaway joined #metacpan
07:59 migo joined #metacpan
07:59 ivan joined #metacpan
07:59 dpetrov joined #metacpan
07:59 phaylon joined #metacpan
07:59 wreis joined #metacpan
07:59 bricas joined #metacpan
07:59 Mithaldu joined #metacpan
07:59 nuba joined #metacpan
07:59 punytan_ joined #metacpan
07:59 mst joined #metacpan
07:59 garu joined #metacpan
07:59 oalders joined #metacpan
07:59 andrefs joined #metacpan
07:59 osfameron joined #metacpan
07:59 berekuk joined #metacpan
07:59 mdk joined #metacpan
07:59 tokuhirom joined #metacpan
07:59 haarg joined #metacpan
08:20 genehack joined #metacpan
08:50 bowtie_ joined #metacpan
09:14 dpetrov_ joined #metacpan
09:19 dpetrov_ joined #metacpan
09:51 dpetrov_ joined #metacpan
13:43 marcus_ joined #metacpan
13:57 rwstauner left #metacpan
13:58 rwstauner joined #metacpan
14:19 oalders talexb: have you had a chance to look over the changes i made to your branch?
15:19 talexb oalders, Yes .. and I made other changes and put them in my own branch .. been waiting for a chance to talk with you.
15:19 oalders talexb: ok. let me know when you want to go over that
15:20 talexb Sure .. I just need five minutes to get a few things cleared up first.
18:12 neilb joined #metacpan
18:18 talexb oalders, Well, that was a long five minutes .. sorry, I ha an emergency crop up.
18:28 talexb oalders, I pushed to a new branch here: https://github.com/talexb/metacpan-​web/tree/oalders/talexb/addSitemap and adde comments here: https://github.com/CPAN-API/metacpan-web/pull/924
18:28 dipsy [ talexb/metacpan-web · GitHub ] [ Generate sitemap for metacpan.org website by talexb · Pull Request #924 · CPAN-API/metacpan-web · GitHub ]
18:29 talexb Mapping '-' to '::' is trivial -- I was more concerned about the bad urls, as per my comment.
18:42 oalders talexb: where can i find your latest commits? they don't seem to be on that pull request
18:43 talexb Should be the first link .. https://github.com/talexb/metacpan-​web/tree/oalders/talexb/addSitemap
18:43 dipsy [ talexb/metacpan-web · GitHub ]
18:44 talexb I didn't add to your branch -- I assumed I wouldn't be able to write to it.
18:44 oalders yeah :)
18:44 talexb I'm guessing there's some cruft in the database, which is rpdocuing URLs that appear to be malformed.
18:45 oalders so, the issue is that you're taking distribution names and mapping them to module names
18:45 talexb I didn't want to be all "Not My Job" about it -- I'd prefer that my script priduces good results right off the bat.
18:45 oalders :)
18:45 oalders what you really want to do is just get a list of all the modules and then create the urls from that list
18:45 oalders because a distribution has_many modules
18:46 talexb Hmm .. I thought I'd made that change, but let me look at the code again.
18:46 oalders so, the current implementation will have some bad URLs and some missing URLs as well
18:46 oalders release and author site maps should be fine
18:46 talexb OK, I think I see what you'er saying.
18:47 talexb Let me get this sorted out now.
18:47 oalders i pointed you at an example of how to search for modules in my last comment -- the iCPAN code
18:48 oalders having said all of that, the fact that you're getting distribution names that are actually numbers points to some other problem that we might need to look out
18:48 oalders *look at
18:49 oalders but outside the scope of this
18:49 oalders (not something you need to worry about)
18:49 talexb OK.
18:51 oalders let me know if you have any issues getting the query to run.  it's a bit more complicated than the others
18:55 talexb OK, thanks.
18:57 ranguard talexb && oalders ++ # doing stuff :)
18:57 oalders :)
18:57 oalders talexb is doing all of the hard work
18:58 ranguard sure, don't worry that was a 80/20 'doing stuff' :)
18:59 oalders :D
19:05 talexb Pfffft. Yeah, I'm making all of the mistakes .. :/
19:45 talexb oalders, Hmm. Not knowing any better, I copied the filter wholesale in my script, but ElasticSearch::Param is complaining about the query operator 'not' ..
19:48 talexb https://gist.github.com/ta​lexb/bfe5913e3164692e63d8
19:48 dipsy [ Unsuccessful run of generate_sitemap.pl ]
20:02 oalders talexb: ok, thanks.  i'll have a closer look this evening.  haven't used queryb before
20:03 oalders talexb: https://metacpan.org/module/ElasticSea​rch::SearchBuilder#filter--not_filter
20:03 dipsy [ ElasticSearch::SearchBuilder - A Perlish compact query language for ElasticSearch - metacpan.org - Perl programming language ]
20:05 oalders looks like you can change the not nested in the filter to a -not_filter
20:05 talexb I tried that .. but let me verify.
20:06 talexb Yup -- -not fails with the same error.
20:16 oalders -not or -not_filter?
20:16 talexb Just -not .. as per the docs ..
20:16 talexb But I can try combining not and filter ..
20:19 talexb And that gives me 'Unknown query operator 'filter' at /usr/local/perlbrew/perls/perl-5.16.2/lib/sit​e_perl/5.16.2/ElasticSearch/RequestParser.pm line 591.'
20:20 oalders talexb: can you post some code that i can run?
20:21 talexb Sure .. hang on.
20:24 talexb https://github.com/talexb/metacpan-​web/tree/oalders/talexb/addSitemap is my latest.
20:24 dipsy [ talexb/metacpan-web · GitHub ]
20:24 talexb The filter clause in bin/genearte_sitemap.pl is what I copied from iCPAN.pm, the link that you suggested.
20:31 oalders ok. will fire up VM
20:38 talexb I'm going to go freshen mine up -- they're a couple of days old.
20:50 oalders i don't think much happened since then :)
20:52 talexb Only four changes .. Catalyst-Plugin-Session-0.38 (upgraded from 0.37), CPAN-Meta-2.132620 (upgraded from 2.132510), MooseX-Types-0.38 (upgraded from 0.37), and Plack-Middleware-ServerStatus-Lite-0.33 (upgraded from 0.32).
20:52 talexb Nothing dramatic.
20:54 talexb Just tried generate_sitemap again, got the same error. Phew.
21:12 oalders talexb: there are a couple of problems
21:12 talexb OK ..
21:12 oalders first off, you're passing the filter to queryb
21:12 oalders i think you want filterb
21:12 oalders secondly, that ES query doesn't translate (AFAIK) directly to the SearchBuilder syntax
21:13 oalders my issue with SearchBuilder is that you have to learn yet another DSL
21:13 talexb Ohhh .
21:14 oalders i would say this is probably a lot simpler just using ElasticSearch.pm to build the filter
21:14 oalders you almost never want a query
21:14 oalders you generally want catchall query and then you apply a filter to it
21:14 talexb So I'd need to change queryb to filterb when I'm building the search_parameters?
21:15 talexb Just for this file?
21:15 oalders well, i don't think you can pass an actually filter to queryb
21:15 oalders *actual
21:15 oalders and the other "filter" you were passing is i think just being evaluated as query rather than a filter
21:16 oalders what i can do is add an proper script to metacpan-examples to illustrate this
21:16 oalders so, i'd just hold off on this for a bit unless you really want to learn ES
21:16 oalders in which case i won't stand in your way, but i think a proper example will make it clear
21:17 talexb I'll hold off -- I have stuff planned for tonight, then tomorrow have a phone interview that I want to prepare for.
21:17 oalders sure
21:17 oalders if you're interested in query vs filter, there's  quick explanation here http://www.slideshare.net/clintongormley/terms-of​-endearment-the-elasticsearch-query-dsl-explained
21:17 dipsy urgh. long url. Try http://tinyurl.com/3dfj6sr
21:17 dipsy [ Terms of endearment - the ElasticSearch Query DSL explained ]
21:22 talexb OK, thank, I'll read that. And I'll catch up with you tomorrow afternoon perhaps ..

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary