Camelia, the Perl 6 bug

IRC log for #ilbot, 2013-05-21

| Channels | #ilbot index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:52 FROGGS_ joined #ilbot
03:11 codex moritz: would you consider it "semi-stable" - the nextgen branch?
03:11 codex (if so, interested in deploy it clean)
03:11 codex deploying*
04:41 moritz codex: not yet
06:12 FROGGS_ joined #ilbot
17:04 FROGGS joined #ilbot
19:48 moritz ilbot (branch nextgen) now has an optional rate limit that only applies to dynamically generated pages
20:00 pdurbin why?
20:37 moritz because some crawlers made my server grind to a halt
20:39 moritz the logs at irclog.perlgeek.de have 34k different pages (channel + day)
20:39 moritz and some crawlers try to get them all, with about 5 requests per second
20:40 moritz and as soon as the rate is higher than the DB can handle, the load increases and the system becomes sloggish
21:17 pdurbin hmm, interesting. thanks

| Channels | #ilbot index | Today | | Search | Google Search | Plain-Text | summary