Perl 6 - the future is here, just unevenly distributed

IRC log for #metacpan, 2015-04-20

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:59 Ptolemarch joined #metacpan
01:31 klapperl joined #metacpan
01:44 dolmen joined #metacpan
02:28 metacpan joined #metacpan
02:28 metacpan [cpan-api] oalders pushed 2 new commits to stage/lw-mc-03: http://git.io/vfekr
02:28 metacpan cpan-api/stage/lw-mc-03 6a09fa9 Olaf Alders: Adds Git::Helpers to cpanfile.
02:28 metacpan cpan-api/stage/lw-mc-03 886ec5d Olaf Alders: Use Git::Helpers rather than Git::Sub directly when building test config.
02:28 metacpan left #metacpan
02:37 ChoiKyuSang joined #metacpan
02:48 Ptolemarch joined #metacpan
03:58 kentnl ranguard: will fastly be able to handle stream requests? caching those is the biggest problem
04:37 Ptolemarch joined #metacpan
05:15 melo joined #metacpan
06:25 Ptolemarch joined #metacpan
06:41 oiami joined #metacpan
07:36 dp_ joined #metacpan
07:39 melo joined #metacpan
07:54 ranguard kentnl: to be honest not sure, first step will just be using Fastly to speed up routing, actually caching content with them will require a lot of work on our side (e.g. when to PURGE the cache, it's all easy through Fastly API, but knowning what to purge will be a big project)
08:06 edward6 joined #metacpan
08:10 kentnl ranguard: the additonal problem is the URIs sent out by URI.pm aren't consistent, the argument order is randomized as it gets stored temporarily in a hash and then serialized without sorting first.
08:11 kentnl and because URI parameter order semantically means something from time to time, naive caching frameworks can't simply assume them to be equal if their sorted-order is consistent.
08:12 alh_ joined #metacpan
08:12 neilb joined #metacpan
08:13 ranguard we could do $clever_stuff in fastly config for that it's VCL with a few extra bits
08:14 Ptolemarch joined #metacpan
08:16 ranguard kentnl: the 'stream' are they actually multiple GET requests or ... ? I know nothing about it
08:16 dolmen joined #metacpan
08:28 ksurent joined #metacpan
08:36 kentnl stream requests create an initial request which returns a unique ID and returns N results per subsequent request.
08:36 kentnl and then sends a "Destroy this one" when the last result is received.
08:37 ranguard kentnl: do you know what the underlying protocol is?
08:37 kentnl or something like that. All I know is if you try to fetch the middle of it without the front, you get bad results.
08:37 kentnl HTTP
08:38 * ranguard would guess it's possible - but need to look into it, but after we've got basic caching working
08:38 kentnl "scrolling" is the word I meant to use.
08:39 kentnl http://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-scroll.html
08:40 ranguard just looking at: https://metacpan.org/source/DRTECH/Search-Elasticsearch-1.19/lib/Search/Elasticsearch/Scroll.pm
08:41 kentnl I have managed to do some horrible hacks before that approximates getting caching working for scrolled searches. But its not pretty
08:44 ranguard oh, I see 'scroll_id' is some unique key, which I'm guess keeps the 'possition' of the scroll server side
08:44 ranguard ick
08:49 kentnl Yeah. :/
08:49 kentnl My discovery that is if you were to do any caching, you have to cache the *whole thing*
08:49 kentnl and by the time you start doing that, you may as well have a full local object mirror
08:53 kentnl I think I basically ended up just having a CHI instance locally that wrapped around any ES/MCPAN::API calls I was going to do and serialize-and-sort the query itself to use as a cache key and then just return whatever that way.
08:54 kentnl ( Though I really would prefer to just get a scroll of object id's instead of the full objects, because an object itself should be cachable indefinately instead of needing some magic timeout stuff )
08:55 neilb joined #metacpan
08:57 * ranguard gets it
08:58 ranguard though of course you can limit which parts of an object are actually returned
08:59 kentnl That you can. It doesn't help much though, because when you're in development you run the query multiple times before you realise what fields you really need ( and pay the price every time )
08:59 * ranguard nods
09:29 ksurent left #metacpan
10:03 Ptolemarch joined #metacpan
10:08 punter joined #metacpan
11:52 Ptolemarch joined #metacpan
12:24 oiami joined #metacpan
12:31 oiami joined #metacpan
12:54 oiami joined #metacpan
13:09 vroom joined #metacpan
13:41 Ptolemarch joined #metacpan
13:54 vroom joined #metacpan
14:25 melo joined #metacpan
14:29 ksurent joined #metacpan
14:36 Ptolemarch joined #metacpan
15:19 lifeofguenter joined #metacpan
16:06 trs joined #metacpan
17:00 lifeofguenter joined #metacpan
17:04 neilb joined #metacpan
17:19 punter joined #metacpan
17:41 oiami joined #metacpan
18:01 lifeofguenter joined #metacpan
18:01 lifeofguenter joined #metacpan
18:02 lifeofguenter joined #metacpan
18:02 lifeofguenter joined #metacpan
18:10 _dolmen_ joined #metacpan
18:14 RenatoCRON joined #metacpan
18:56 ilbot2 joined #metacpan
18:56 Topic for #metacpan is now http://status.panopta.com/metacpan | Next version of API - have your say: https://github.com/CPAN-API/cpan-api/issues/361 | Have you installed your MetaCPAN VM? https://github.com/CPAN-API/metacpan-developer | Chat logs available at http://irclog.perlgeek.de/metacpan/ | Can't find your module on MetaCPAN? https://metacpan.org/about/missing_modules
19:00 punytan_ joined #metacpan
19:05 berekuk joined #metacpan
19:06 dustinm joined #metacpan
19:07 mattp joined #metacpan
19:11 rsrchboy joined #metacpan
19:11 leont joined #metacpan
19:13 Mike__B joined #metacpan
19:14 ilmari joined #metacpan
19:14 mtj joined #metacpan
19:15 ingy joined #metacpan
19:15 dolmen joined #metacpan
19:15 trs_ joined #metacpan
19:16 hernan604 joined #metacpan
19:21 trs joined #metacpan
19:23 omengue joined #metacpan
19:23 mtj joined #metacpan
19:23 castaway joined #metacpan
19:23 GumbyNET5 joined #metacpan
19:25 ingy joined #metacpan
19:26 hernan604 joined #metacpan
19:26 mst joined #metacpan
19:29 TBSliver joined #metacpan
19:30 Ptolemarch joined #metacpan
19:32 dpetrov joined #metacpan
19:33 ilmari joined #metacpan
19:33 GumbyNET5 joined #metacpan
19:33 castaway joined #metacpan
19:33 mtj joined #metacpan
19:33 omengue joined #metacpan
19:33 mst_ joined #metacpan
19:34 mst joined #metacpan
19:42 RenatoCRON joined #metacpan
20:16 lifeofguenter joined #metacpan
20:27 Ptolemarch joined #metacpan
20:46 alh_ joined #metacpan
21:09 melo joined #metacpan
21:10 Ptolemarch joined #metacpan
21:12 SineSwiper joined #metacpan
21:15 _dolmen_ joined #metacpan
21:35 Ptolemarch joined #metacpan
22:31 punter joined #metacpan
22:47 ChoiKyuSang joined #metacpan
22:52 vroom joined #metacpan
23:13 vroom joined #metacpan
23:18 neilb_ joined #metacpan
23:43 vroom joined #metacpan

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary