Perl 6 - the future is here, just unevenly distributed

IRC log for #metacpan, 2015-06-09

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 ether there was a report posted a few days ago with some pretty graphs
00:06 oalders mattp_: nothing public, but if you want to set something up to export the nginx logs that would be fine
01:29 klapperl_ joined #metacpan
03:12 bin_005 joined #metacpan
05:56 ranguard mattp_: it would actually be the fastly (cdn) logs you want, they can be syslog streamed or saved to S3 etc etc, and custom formatted
05:59 ranguard https://docs.fastly.com/guides/log-streaming/
06:13 oiami joined #metacpan
06:18 oiami joined #metacpan
06:37 neilb joined #metacpan
07:07 chansen joined #metacpan
07:14 dp_ joined #metacpan
07:41 jnap joined #metacpan
08:02 neilb joined #metacpan
08:06 ranguard if you are interested in helping we could stream this into ElasticSearch and build an API to query... or something, I'm happy to help, but would want help
08:06 ranguard my self!
08:44 bin_005 joined #metacpan
09:16 diego_k joined #metacpan
09:50 bin_005 joined #metacpan
10:35 neilb joined #metacpan
10:37 ksurent joined #metacpan
10:41 alh joined #metacpan
10:46 oiami joined #metacpan
10:55 oiami1 joined #metacpan
11:02 oiami joined #metacpan
11:04 ranguard woot - link to metacpan.org from ft.com: http://capgemini.ft.com/authors/Leo-Lapworth-a-2602_s_146bee35a6509219e4b9449cd4a4933f.html :)
11:06 ranguard oalders: http://capgemini.ft.com/customer-experience/mobile-experience-must-be-rich-and-rapid_a-39-1315.html <- you wanted to see the waffle piece :)
11:06 ilmari mm, waffles
11:16 mattp_ ranguard: oalders: cool. will need to put more thought into it but ill let you know
11:20 ranguard mattp_: I did this a few days ago: https://metacpan.org/about/stats - but that's just calling the CDN totals api
12:56 oalders ranguard: nice! i was half expecting to see a picture of a sheep :)
12:58 oalders i don't think we'd _have_ to use fastly for the logs.  the nginx logs seem pretty helpful, but using fastly would provide an api, i guess
12:58 oalders it's mostly filtering out the bots
12:59 oalders mattp_ is talking about finding the most popular modules
12:59 oalders but we could also find what the most popular searches are
13:08 ranguard oalders: umm, if fastly has something in cache, then it doesn't hit our server, so you wouldn't see it, so yes, we do have to use fastly logs
13:11 oalders ah, right
13:12 oalders that would explain why the logs are full of bots
13:15 ranguard metacpan.org doesn't have much caching.. yet, cpan.metacpan.org does have quite a bit
13:16 vanstyn_ joined #metacpan
13:18 haarg eventually we'll get the cache invalidation set up, which should allow us to cache things for a lot longer while fixing browsers showing old content
13:18 ranguard the other nice thing is we can give people the data, but just give them very specific fields, or even paths so, "$date $path" for /search
13:18 ranguard haarg: yea, I'm trying to head that way in baby steps :)
13:18 haarg yeah
13:19 haarg moving the user specific stuff to js was part of that work
13:20 ranguard yea, now we have a few standard methods for adding 'surrogate keys' (which we can later use to 'purge'), so we'd set the 'dist-name' and 'pause-id' for example, then when we index anything, we purge both that dist and it's author
13:20 haarg yep
13:21 * ranguard is also trying to work out the best way to use the stale-if-error header as well, then fastly will serve old content if our server is down for any reason, even if the cache time has expired
13:23 ranguard (assuming they have it in cache obviously) :)
14:51 mtj joined #metacpan
15:19 punter joined #metacpan
16:03 vanstyn joined #metacpan
16:57 neilb joined #metacpan
17:01 neilb_ joined #metacpan
18:18 rpmcmurphy joined #metacpan
18:29 Peter joined #metacpan
18:59 bin_005 joined #metacpan
21:00 khisanth_ joined #metacpan
21:48 khisanth__ joined #metacpan
22:01 khisanth_ joined #metacpan

| Channels | #metacpan index | Today | | Search | Google Search | Plain-Text | summary