Perl 6 - the future is here, just unevenly distributed

IRC log for #metacpan, 2014-03-10

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:43 punter joined #metacpan
01:45 trs punter: email noc@metacpan.org
01:45 punter thanks
01:48 rwstauner punter: "path" is the path of the file inside the archive (tar), like "lib/Foo.pm" or "README".  The api also returns directories, so a path of "" should technically mean "the root directory of the archive"
01:48 punter thanks
01:49 punter I made a search for path => "", and it didn't just return the root directories, but files that had actual names...
01:49 punter so it's a bit of a mystery
01:49 punter I don't care about this, for my project. Just mentioning it, just in case you do.
01:50 punter (rwstauner)
01:53 * rwstauner shrugs
01:54 punter joined #metacpan
01:56 trs punter: your query for an empty path doesn't return ones with a path for me on a quick test
01:57 punter it returns files with names, though
01:57 punter that's the mystery
01:57 punter I thought the path contains the name
01:57 punter I'll check again
01:58 trs the path is relative to the release directory.
01:58 trs as rwstauner said
01:58 trs so when release directories themselves get returned, there's no path.
01:58 trs but they have a name.
01:59 trs out of curiosity, why do you need to hit the api every minute?
01:59 punter ok thanks
01:59 punter emm... I don't have to really. I'm just checking for new modules. If it's too much, I'll make it every 15 minutes.
01:59 punter Is 15 minutes ok?
02:00 punter My plan is to create RSS items for new releases containing the diffs in the Changes file
02:03 trs generally folks who want to monitor new releases do so using http://friendfeed.com/cpan -- http://friendfeed.com/cpan/ff4d5fd1/about-this-bot-readme which powers http://twitter.com/cpan_new
02:03 dipsy [ CPAN - FriendFeed ] [ About this bot (README) - CPAN - FriendFeed ] [ CPAN New Modules (cpan_new) on Twitter ]
02:04 trs I don't know if 1min is too much or not for metacpan, I wouldn't think so unless you're doing expensive queries.
02:05 punter trs: check this out: not directories (i.e. plain files) that have path=empty string: http://explorer.metacpan.org/?url=%2Ffile%2F_search&content={%0D%0A++++++++%22query%22%3A+{%0D%0A++++++++++++%22match_all%22%3A+{}%0D%0A++++++++}%2C%0D%0A++++++++%22size%22%3A+10%2C%0D%0A++++++++%22fields%22%3A+[%22path%22%2C+%22name%22%2C+%22directory%22]%2C%0D%0A++++++++%22filter%22%3A+{%0D%0A++++++++++++%22and%22%3A+[%0D%0A++++++++++++++++{%22term%22
02:05 punter %3A+{%22path%22%3A+%22%22}+}%2C%0D%0A++++++++++++++++{%22term%22%3A+{%22directory%22%3A+false}+}%0D%0A++++++++++++]%0D%0A++++++++}%0D%0A}
02:06 dipsy urgh. long url. Try http://tinyurl.com/n7rwkfw
02:06 dipsy [ MetaCPANExplorer ]
02:06 punter sorry
02:06 punter anyway, trs, the example is in the doc page of the API: https://github.com/CPAN-API/cpan-api/wiki/API-docs
02:06 dipsy [ API docs · CPAN-API/cpan-api Wiki · GitHub ]
02:07 punter better: https://github.com/CPAN-API/cpan-api/wiki/API-docs#wiki-get-a-list-of-all-files-where-the-directory-is-false-and-the-path-is-blank
02:07 dipsy [ API docs · CPAN-API/cpan-api Wiki · GitHub ]
02:07 neilb joined #metacpan
02:07 punter I'll check out friendfeed
02:08 trs punter: not sure why that is, but there's only 149 matches. I suspect mumble legacy something mumble.
02:09 trs or, "those files aren't from a tarball"
02:09 punter yes
02:09 trs i.e. cpan cruft
02:09 klapperl joined #metacpan
02:10 trs do feel free to use metacpan for this, I was just pointing you towards another resource which may be more of the "real time streamy" that you want.
02:12 punter thanks
02:18 omega it would rock if you could add the Changes diff to the actuall API though :P
02:45 ether_ joined #metacpan
02:49 oalders punter: you could also watch the recent feed https://metacpan.org/feed/recent?f=
02:49 dipsy [ Recent CPAN uploads - MetaCPAN ]
02:49 punter Yes, I'll do that.
02:49 rkmithun joined #metacpan
02:54 kentnl on that note, does ES have a firehose mode? ie: you just define a query, and then you get a long-term HTTP connection that just streams matching elements when they enter the server?
02:56 oalders kentnl: not sure if rivers qualify? http://www.elasticsearch.org/guide/en/elasticsearch/rivers/current/
02:56 dipsy [ Rivers ]
03:15 omega isn't rivers the other way? or did I miss-understand those docs and/or kentnl's request?
03:18 trs I believe rivers are the other way
03:29 genehack getting a 504 gateway timeout on metacpan.org right now ...
03:30 oalders load average: 26.96, 19.97, 10.41
03:32 genehack yeah, stuff just finally loaded, it's just slooooooow
03:33 oalders i restarted www. load is coming down slowly
03:34 genehack oalders++ # thanks
03:34 oalders :)
03:34 genehack i had to fall back to search.cpan.org for a second!
03:34 genehack O_O
03:36 oalders hrm, that restart didn't fix it
03:43 oalders seems better now
03:43 oalders when you fall back to search.cpan.org it's a real blast from the past
03:47 nbezzala joined #metacpan
03:49 cooper joined #metacpan
04:14 * omega can't fall back, since my firefox rewrites s.c.o to metacpan :P
04:14 omega would be quite endless loop
04:16 kentnl that would become a "fail back"
05:58 ether joined #metacpan
06:39 [Sno] joined #metacpan
08:42 padma joined #metacpan
08:51 dpetrov_ joined #metacpan
09:48 neilb joined #metacpan
10:03 neilb Hi, MetaCPAN shows inline when a module has pod errors. Does that fact get stored anywhere that is queryable via the API?
10:24 tobyink I think this message is generated by Pod::Simple. I don't think MetaCPAN does anything special with it; just passes is through.
10:27 tobyink Hmm... ok, it does do something special.
10:35 tobyink It just seems to be added to the XHTML when that's generated though; not stored anywhere special. See https://github.com/CPAN-API/cpan-api/blob/master/lib/MetaCPAN/Pod/XHTML.pm.
10:35 dipsy [ cpan-api/lib/MetaCPAN/Pod/XHTML.pm at master · CPAN-API/cpan-api · GitHub ]
10:48 neilb tobyink: ta
13:22 padma left #metacpan
14:00 vinian joined #metacpan
14:50 talina_ joined #metacpan
15:14 rashi joined #metacpan
15:22 prammer joined #metacpan
15:40 oiami joined #metacpan
16:14 oiami left #metacpan
17:37 nbezzala joined #metacpan
17:46 [Sno] joined #metacpan
17:50 neilb joined #metacpan
18:04 nbezzala joined #metacpan
18:33 punter joined #metacpan
18:34 punter oalders, what's the point of "?f=" in https://metacpan.org/feed/recent?f=
18:34 dipsy [ Recent CPAN uploads - MetaCPAN ]
19:24 punter Question: Once I've gotten the "path" of a file from the API, what's the URL to get that file from the web?
19:25 trs api.metacpan.org/v0/file/AUTHOR/RELEASE/PATH
19:26 trs or do you mean the source?
19:26 punter I mean the raw
19:26 punter What's the source?
19:26 trs http://api.metacpan.org/v0/source/ALEXMV/RT-Extension-MandatoryOnTransition-0.06/lib/RT/Extension/MandatoryOnTransition.pm
19:26 dipsy urgh. long url. Try http://tinyurl.com/og95mzu
19:26 trs source, i.e. source code.
19:26 trs source == raw
19:26 punter ok
19:28 trs punter: btw, are you familiar with the /v0/changes endpoint?
19:28 punter no
19:28 punter b.t.w. I made my script to bother the API only when the RSS of recent has changed
19:28 punter so not every minute
19:29 trs punter: look at http://api.metacpan.org/v0/changes/TSIBLEY/App-cpangrep-0.06 for example.
19:29 punter I'm looking at it
19:30 punter oh, it found that the file is called Changes
19:30 punter automatically
19:30 trs or ChangeLog, etc.
19:30 punter plus I get the entire content!
19:30 trs it's what powers the "Changes" link and the Changelog section at the bottom of any release page
19:30 trs see https://metacpan.org/release/TSIBLEY/App-cpangrep-0.06
19:30 dipsy [ App-cpangrep-0.06 - Grep CPAN from the command-line using grep.cpan.me - metacpan.org ]
19:31 punter But I have to know the author's name
19:31 punter That's (I think) an extra API request
19:31 punter unless release knows it
19:31 trs http://api.metacpan.org/v0/changes/App-cpangrep
19:31 punter it probablty does
19:31 trs you need to know the dist name or full release name (AUTHOR/DIST-VERSION)
19:32 trs but you should have what you need from the tarball name
19:32 trs if you're processing a stream of those
19:33 punter I'll check if "full release name" is given by /v0/release/_search
19:33 trs as omega mentioned earlier, it'd be awesome if you added the "difference since release" to the /changes/ endpoint or as another endpoint for others using metacpan to use
19:34 trs punter: it is.
19:34 trs you may need to concatenate fields.
19:34 punter ok I can do that :)
19:34 trs I'm surprised you don't have the full release name already though
19:34 trs it's the only way to uniquely identify a release.
19:35 punter Yes, that's right
19:35 punter I'll be back in 12 mins (food)
19:47 rashi joined #metacpan
19:51 punter I think I have all the pieces to the puzzle now. Going back to building.
20:02 punter What are the possible values of the maturity field? I don't want to deal with development releases. Is this what "maturity" describes?
20:02 punter (in "release" objects)
20:04 punter Ok, I'll only process "released" maturity-level releases
20:05 trs the values are released and developer
20:06 trs I found this out by inspecting the results of this query: http://tsibley.net/paste/2014-03-10f_bS4j_C
20:09 punter facets !
20:09 punter ok
20:17 rashi joined #metacpan
20:37 user_8665 joined #metacpan
20:38 punter How does the changes API react when the release asked for doesn't have a changes-file?
20:38 punter would anyone happen to know such a release?
20:49 ether punter: http://cpants.cpanauthors.org/kwalitee/has_changelog
20:49 dipsy [ CPANTS - Kwalitee - has_changelog ]
20:55 trs punter: the api returns an HTTP 404 and {"code":404, "message": "Not found"}
20:56 punter thanx
22:00 user_8665 joined #metacpan
22:11 neilb rwstauner: you there?
22:18 ether unless he's having an existential crisis, he's bound to be *somewhere*
23:23 mport joined #metacpan
23:26 mport left #metacpan
23:29 mport joined #metacpan
23:58 neilb he could be a 'bot...

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary