| Time |
S |
Nick |
Message |
| 01:28 |
|
oalders |
castaway: if you're still having issues, you could point us to your fork of metacpan-web on github and we could troubleshoot from there |
| 01:50 |
|
|
scott joined #metacpan |
| 06:19 |
|
|
Khisanth joined #metacpan |
| 06:33 |
|
|
jwang joined #metacpan |
| 07:01 |
|
|
nperez joined #metacpan |
| 07:17 |
|
castaway |
haven't yet, just noted the suggestion |
| 07:17 |
|
castaway |
will try it while sat in clinton's talk ;) |
| 09:19 |
|
castaway |
hm, no worky, or I dont understand the result :( |
| 09:57 |
|
|
dpetrov_ joined #metacpan |
| 10:03 |
|
|
clintongormley joined #metacpan |
| 11:14 |
|
|
clintongormley joined #metacpan |
| 11:24 |
|
|
clintongormley joined #metacpan |
| 13:06 |
|
|
SineSwiper joined #metacpan |
| 13:29 |
|
|
SineSwiper1 joined #metacpan |
| 13:40 |
|
|
mstratman joined #metacpan |
| 13:46 |
|
omf_ |
https://www.metacpan.org/module/Devel::NYTProf is currently generating a 'No pod could be found' error |
| 13:46 |
|
dipsy |
[ Devel::NYTProf - Powerful fast feature-rich perl source code profiler - metacpan.org ] |
| 13:46 |
|
apeiron |
further, https://www.metacpan.org/sourc[…]/Devel/NYTProf.pm is 404 |
| 13:48 |
|
|
clintongormley joined #metacpan |
| 14:41 |
|
castaway |
d'oh, I silly |
| 14:41 |
|
castaway |
pulled metacpan::api to try out stuff, then noticed what daft thing I was doing |
| 14:43 |
|
oalders |
omf_, apeiron: fixed |
| 14:43 |
|
apeiron |
oalders++ |
| 14:43 |
|
apeiron |
what was the issue? |
| 14:43 |
|
oalders |
most of the files in the archive weren't extracted in the source directory |
| 14:44 |
|
oalders |
so i deleted it from the tmp directory and re-indexed |
| 14:44 |
|
oalders |
we occasionally have to purge that folder |
| 14:44 |
|
oalders |
and it's possible that something is getting unarchived while the delete is taking place |
| 14:45 |
|
oalders |
not sure if that's what happened here |
| 14:45 |
|
oalders |
castaway: what was the daft thing? |
| 14:48 |
|
|
clintongormley joined #metacpan |
| 14:53 |
|
apeiron |
oalders, hmm, weird. sounds like it could do with some kind of transactional file manager :) |
| 14:55 |
|
oalders |
apeiron: yeah, or we only delete dists of a certain age from the temp folder :) |
| 14:55 |
|
* apeiron |
nods |
| 15:04 |
|
|
clintongormley joined #metacpan |
| 15:12 |
|
|
SineSwiper joined #metacpan |
| 15:12 |
|
castaway |
oalders: { query => .. filter => .. } != { query => { ... filter => .. } } |
| 15:13 |
|
oalders |
castaway: that's correct. they do look very similar, though :) |
| 15:13 |
|
castaway |
quite |
| 15:18 |
|
|
SineSwiper joined #metacpan |
| 15:18 |
|
castaway |
aha, useful looking output |
| 15:18 |
|
castaway |
theerrors from incorrect syntax are a bit unpretty ;) |
| 16:05 |
|
|
theory joined #metacpan |
| 16:49 |
|
|
theory_ joined #metacpan |
| 17:00 |
|
oalders |
yeah, the errors can be a bit cryptic :) |
| 17:07 |
|
|
SineSwiper joined #metacpan |
| 17:36 |
|
castaway |
hmm now trying to figure out what a favourite is exactly.. how to read MetacPAN::Document::Favorite ? |
| 18:24 |
|
castaway |
http://desert-island.me.uk/~ca[…]8-21-20-20-26.jpg |
| 18:24 |
|
dipsy |
[ jpeg (1280 x 800) ] |
| 18:30 |
|
castaway |
https://github.com/castaway/me[…]/author-favorites |
| 18:31 |
|
dipsy |
[ castaway/metacpan-web at castaway/author-favorites · GitHub ] |
| 18:32 |
|
apeiron |
So following on from earlier, and just on my own, I've been thinking about transactional file operations |
| 18:32 |
|
castaway |
gosh thinking |
| 18:32 |
|
|
ether_ joined #metacpan |
| 18:32 |
|
apeiron |
I don't think we can do atomic multifile ops |
| 18:33 |
|
apeiron |
But copying files into a scratch directory and mv'ing them over might be one approach |
| 18:38 |
|
oalders |
apeiron: right. the issue really at this point is that we keep running out of disk space |
| 18:38 |
|
apeiron |
ooh |
| 18:38 |
|
oalders |
and someone goes in and blows away the tmp directory in a hurry |
| 18:38 |
|
apeiron |
which monitoring tool are you using? |
| 18:38 |
|
oalders |
i believe it's monit for those alerts |
| 18:38 |
|
apeiron |
alert louder :) |
| 18:41 |
|
oalders |
:) |
| 18:42 |
|
oalders |
castaway++ |
| 18:42 |
|
oalders |
that's a badly needed feature |
| 18:45 |
|
oalders |
and actually surprisingly few lines of code :) |
| 19:53 |
|
|
clintongormley joined #metacpan |
| 20:42 |
|
apeiron |
Looks like https://metacpan.org/module/Thrift has the same "no pod" issue |
| 20:42 |
|
dipsy |
[ Search the CPAN - metacpan.org ] |
| 20:51 |
|
oalders |
apeiron: http://search.cpan.org/search?[…]y=thrift&mode=all |
| 20:51 |
|
dipsy |
[ The CPAN Search Site - search.cpan.org ] |
| 20:51 |
|
oalders |
oops. https://metacpan.org/source/GS[…]lib/Thrift.pm#L21 |
| 20:51 |
|
dipsy |
[ lib/Thrift.pm - metacpan.org ] |
| 20:52 |
|
oalders |
was doing some comparison |
| 20:52 |
|
oalders |
i don't actually see any pod there |
| 20:52 |
|
apeiron |
hm, whoops |
| 20:52 |
|
apeiron |
bad link elsewhere, then :) |
| 20:53 |
|
apeiron |
(not metacpan's fault) |
| 21:37 |
|
castaway |
oalders: but lots and lots of figuring out :( |
| 21:41 |
|
castaway |
(and all this passing like ships in the night ;) |
| 21:44 |
|
* castaway |
wonders how to document the whole of the API.. |
| 21:54 |
|
|
meraxes joined #metacpan |
| 22:14 |
|
|
meraxes joined #metacpan |
| 22:27 |
|
grantm |
castaway: have you seen https://github.com/CPAN-API/cp[…]iki/Beta-API-docs ? |
| 22:27 |
|
dipsy |
[ Beta API docs · CPAN-API/cpan-api Wiki · GitHub ] |
| 22:28 |
|
castaway |
grantm: yes... |
| 22:28 |
|
castaway |
and then i fixed an example which was wrong... |
| 22:28 |
|
castaway |
and I still dont know what is available ;) |
| 22:28 |
|
grantm |
that gave me what I needed for building mapofcpan.org |
| 22:28 |
|
grantm |
what are you missing? |
| 22:30 |
|
castaway |
the kind of query/terms post syntax i actually used in my patch |
| 22:31 |
|
grantm |
so your issue is more about ElasticSearch query language rather than metacpan specifically ? |
| 22:32 |
|
castaway |
partially, and not knowing if those docs are comprhensive |
| 22:33 |
|
grantm |
I think you can assume they're not :-) |
| 22:33 |
|
grantm |
which is why I'm trying to tease out what you're looking for |
| 22:34 |
|
apeiron |
there are elasticsearch docs? |
| 22:34 |
|
grantm |
lots |
| 22:34 |
|
apeiron |
that actually tell you how the query language is structured? :) |
| 22:34 |
|
grantm |
http://www.elasticsearch.org/g[…]erence/query-dsl/ |
| 22:34 |
|
dipsy |
[ elasticsearch - guide - Query DSL ] |
| 22:35 |
|
castaway |
grantm: Im after "what is everything the api can do" |
| 22:35 |
|
castaway |
not a specific thing |
| 22:35 |
|
castaway |
yeah applied the sort from the dsl pages, failed to have it work, used perl instead ;) |
| 22:36 |
|
castaway |
apeiron: let me know if you find em ;) |
| 22:36 |
|
apeiron |
heh, indeed |
| 22:36 |
|
apeiron |
every time I go looking I end up disappointed |
| 22:36 |
|
apeiron |
they're all self-referential |
| 22:36 |
|
grantm |
the docs are mostly comprehensive about what end-points are available |
| 22:36 |
|
grantm |
what you can do with the API is a bit more of an open-ended question that depends on your mastery of ES queries |
| 22:37 |
|
grantm |
I found the examples and the explorer to be very useful but there's no doubt improvements could be made |
| 22:37 |
|
castaway |
grantm: the doc doesnt seem useful from pov of using ES, as mapping the GET reqs onto POST queries is not a SMOP |
| 22:38 |
|
grantm |
the GET requests are fairly limited |
| 22:38 |
|
castaway |
coming from not knowing the backend in the slightest, I hoped ::Document::Favorite would have some docs on it fields etc.. |
| 22:40 |
|
castaway |
Im failing to explain.. but I took 3 days of trying to get that short piece of code working.. |
| 22:40 |
|
castaway |
cos of not having a start doc, or a pointer to where to look .. |
| 22:41 |
|
grantm |
taking that as a specific example, I'm not sure there even is a rich array of fields available for favorites |
| 22:41 |
|
grantm |
it's pretty much just a record that a particular distro was ++'d at a particular time |
| 22:42 |
|
grantm |
and the identity of the person who ++'d is anonymized (?) |
| 22:43 |
|
grantm |
I also wasted a number of days trying to do things with GET requests that ultimately weren't too hard with a POST |
| 22:43 |
|
castaway |
no its not |
| 22:44 |
|
castaway |
so where do the author, release fields come from ? |
| 22:45 |
|
castaway |
s'too late in the day for this.. |
| 22:45 |
|
grantm |
it's not even lunch time yet! |
| 22:46 |
|
castaway |
1am here |
| 22:48 |
|
grantm |
when someone ++s a release, a 'favorite' record is created with fields identifying the distribution, the release (i.e. the particular version of the distribution) and the author (i.e. the PAUSE account of the person who uploaded that version of that distribution) |
| 23:10 |
|
|
SineSwiper joined #metacpan |