Perl 6 - the future is here, just unevenly distributed

IRC log for #perl6-lwp-gsoc, 2014-06-09

| Channels | #perl6-lwp-gsoc index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:26 FROGGS_ joined #perl6-lwp-gsoc
08:18 sergot o/
08:18 sergot FROGGS: did you review http-useragent? :)
08:18 sergot :simple
08:18 FROGGS sergot: not yet, but will to this morning
08:19 sergot This week I'll be working on {en,de}coding stuff and trying to use cookies in UA
08:24 FROGGS nice!
08:25 sergot Can't wait, I was thinking a lot about this during last weekend, I have some ideas and I find this project very interesting, still. :)
08:27 FROGGS yeah, it is very intersting, because there are many things that need to work in order to just download a file :o)
08:27 sergot true :)
08:34 FROGGS[mobile] joined #perl6-lwp-gsoc
08:50 FROGGS[mobile]2 joined #perl6-lwp-gsoc
09:48 FROGGS there seems to be a precomp issue...
09:48 FROGGS ==> Testing HTTP::UserAgent
09:48 FROGGS t/01-simple.t .. All 2 subtests passed
09:48 FROGGS t/02-common.t .. All 2 subtests passed
09:58 FROGGS this also fails: perl6-m -Ilib  bin/http-download http://www.cpan.org/MIRRORED.BY
09:58 FROGGS $request.Str in UserAgent.pm6 line 34 is:
09:58 FROGGS GET /MIRRORED.BY/ HTTP/1.1
09:58 FROGGS Host: www.cpan.org
09:58 FROGGS that trailing slash is wrong
10:06 FROGGS _clear-url in UserAgent.pm6 is to blame
10:07 FROGGS when I comment out the second line I get the MORRORED.BY as index.html
10:07 FROGGS but the chunk headers are still in that file
10:08 FROGGS but otherwise the file is intact, like encoding wise... and all newlines are preserved
10:08 FROGGS sergot++
10:10 FROGGS this on the other hand:
10:10 FROGGS perl6-m -Ilib bin/http-download http://dl.ambiweb.de/mirrors/ftp.cpan.org/authors/p6dists.json.gz
10:10 FROGGS GET /mirrors/ftp.cpan.org/authors/p6dists.json.gz HTTP/1.1
10:10 FROGGS Host: dl.ambiweb.de
10:10 FROGGS gives me:
10:10 FROGGS ===SORRY!===
10:10 FROGGS Malformed UTF-8
10:11 FROGGS (which is kinda expected)
10:11 sergot oh
10:12 sergot clear-url should be corrected for sure
10:13 sergot FROGGS: It should doesn't treat that file as UTF one, how to do this?
10:13 sergot wait...
10:14 sergot "It shouldn't" * ... I had something other in mind.
10:14 sergot It's probably time to eat then. &
10:15 FROGGS sergot: my guess it that you have to parse the header first, before making assumptions about the encoding
10:16 FROGGS but I know that this is difficult, because you already have more than the header in the buffer at the time you made the assumptions
10:54 sergot I'd do this this week.
11:03 FROGGS joined #perl6-lwp-gsoc
11:35 FROGGS joined #perl6-lwp-gsoc
13:53 sergot FROGGS: weird thing.
13:53 FROGGS yeah :o)
13:54 sergot I can say $s, but i can't say $s.perl
13:54 sergot :D
13:54 sergot UserAgent.pm6:40
13:54 sergot ~40
13:55 sergot FROGGS: any ideas?
13:55 FROGGS what does $.perl give you instead?
13:55 FROGGS err, $s.perl
13:56 sergot It hangs on
13:56 sergot gives nothing
13:56 FROGGS hmmmm
13:57 sergot What do you receive doing: perl6-m -Ilib  bin/http-dump http://www.cpan.org/MIRRORED.BY ?
13:58 FROGGS I get this after about 20s: https://gist.github.com/FROGGS/08c6f7df0630634b1e15
13:59 sergot hmm, I should wait then
13:59 FROGGS though it is weird that it takes that long
13:59 sergot true
14:00 sergot real    0m29.593s
14:00 sergot I'm clueless
14:08 sergot FROGGS: any ideas? :)
14:09 FROGGS <FROGGS> m: say "$?FILE:$?LINE {nqp::time_n() - BEGIN nqp::time_n}";
14:09 FROGGS <camelia> rakudo-moar 28d672: OUTPUT«/tmp/CKZn6DANXm:1 0.0656704902648926␤»
14:09 FROGGS sergot: you could add this line to spots in the code, to locate what is so slow there
14:12 sergot ok, thanks!
14:12 sergot FROGGS++
14:14 sergot FROGGS: it's parsing Response that is so slow
14:14 sergot But I'll check this
14:15 FROGGS wow
14:17 sergot .perl is slow too then
14:27 dalek http-useragent: 5fffde4 | sergot++ | / (2 files):
14:27 dalek http-useragent: adding / removed
14:27 dalek http-useragent:
14:27 dalek http-useragent: it should be done by handling redirections
14:27 dalek http-useragent: review: https://github.com/sergot/http-useragent/commit/5fffde44a0
14:55 sergot redirections are coming!
14:55 dalek http-useragent: 7b14fd3 | sergot++ | / (2 files):
14:55 dalek http-useragent: simple redirections, prototype
14:55 dalek http-useragent: review: https://github.com/sergot/http-useragent/commit/7b14fd325e
14:56 sergot It even works. ;)
14:56 dalek http-useragent: cc56481 | sergot++ | en:
14:56 dalek http-useragent: cleaning
14:56 dalek http-useragent: review: https://github.com/sergot/http-useragent/commit/cc56481060
15:00 FROGGS sergot++
16:40 FROGGS joined #perl6-lwp-gsoc
18:07 sergot feel free to test :)
19:19 FROGGS[mobile] joined #perl6-lwp-gsoc
19:56 FROGGS joined #perl6-lwp-gsoc

| Channels | #perl6-lwp-gsoc index | Today | | Search | Google Search | Plain-Text | summary