Camelia, the Perl 6 bug

IRC log for #darcs, 2013-05-07

| Channels | #darcs index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:09 carter joined #darcs
01:09 intripoon_ joined #darcs
01:48 favonia joined #darcs
01:57 edwardk joined #darcs
02:30 carter joined #darcs
03:18 gh_ joined #darcs
03:44 preflex_ joined #darcs
03:45 gh_ joined #darcs
04:10 carter joined #darcs
04:19 edwardk joined #darcs
04:24 mizu_no_oto joined #darcs
06:26 edwardk joined #darcs
07:05 lelit joined #darcs
07:35 amgarchIn9 joined #darcs
07:58 donri joined #darcs
09:04 raichoo joined #darcs
12:26 kmels_ joined #darcs
12:46 amgarchIn9 joined #darcs
13:05 mizu_no_oto joined #darcs
13:19 mizu_no_oto joined #darcs
13:25 uniquenick joined #darcs
13:37 mizu_no_oto joined #darcs
13:47 gh_ joined #darcs
14:21 whaletechno joined #darcs
14:23 mizu_no_oto joined #darcs
14:26 gh_ joined #darcs
15:12 iago joined #darcs
15:44 javier_rooster joined #darcs
16:14 favonia joined #darcs
16:49 gh__ joined #darcs
16:59 marmoute joined #darcs
17:17 gh_ joined #darcs
17:23 favonia joined #darcs
17:29 gh__ joined #darcs
17:53 mizu_no_oto joined #darcs
18:04 javier_rooster joined #darcs
18:17 amgarchIn9 joined #darcs
18:23 raichoo joined #darcs
18:34 gh_ joined #darcs
19:44 vh4x0r joined #darcs
19:45 carter joined #darcs
20:24 javier_rooster joined #darcs
20:24 kyagrd joined #darcs
20:25 kyagrd Hello, I'm trying to make a new repository on hug.darcs.net and trying to push existing repo.
20:25 kyagrd and having some problems.
20:26 kyagrd It says that kyagrd@hub.darcs.net:MyRepoName is not a repository :(
20:26 kyagrd darcs failed:  Not a repository: kyagrd@hub.darcs.net:MyRepoName ((scp) failed to fetch: kyagrd@hub.darcs.net:PiHko//_darcs/inventory)
20:26 kyagrd is the error msg
20:32 Heffalump you made it via the web interface first?
20:32 Heffalump also, does ssh kyagrd@hub.darcs.net work?
20:32 Heffalump at least to get as far as saying you can't have an interactive shell
20:32 kyagrd Oh, there should be a pubkey.
20:33 kyagrd I didn't set the pubkey maybe that is the reason?
20:33 Heffalump hmm, looks like hub may have a problem
20:33 Heffalump sm?
20:33 Heffalump that wouldn't help
20:33 kyagrd I get the message "Permission denied (publickey)"
20:33 kyagrd when I try ssh-ing
20:34 Heffalump sm: no, never mind
20:34 Heffalump kyagrd: ok, that's your problem
20:34 kyagrd So, setting a pubkey is the right way to go?
20:34 Heffalump kyagrd: yep
20:35 Heffalump sm: sorry for the random invocation, nothing to see here :-)
20:35 kyagrd Heffalump: thanks for the help I'll try
20:40 mizu_no_oto joined #darcs
20:45 carter joined #darcs
20:46 kyagrd wow darcs is using 70% of my desktop memory lol
20:50 Heffalump I'm sure it's putting it to good use.
20:50 edwardk joined #darcs
20:51 kyagrd I just killed it. I converted a old repository (last patch was 2009) into darcs-2 format and then tried to push it and darcs is just lost
20:51 kyagrd maybe I should optimize it first
20:52 Heffalump how many patches does it have?
20:53 Heffalump pushing a few at a time (say 100) sometimes has better results
20:53 kyagrd it has several hundred.
20:53 kyagrd yeah I should do it in peices
21:02 kyagrd I think now it really is a probem of hub :(
21:02 kyagrd aiting for lock /home/darcsden/users/kyagrd/PiHko/_darcs/lock
21:02 kyagrd W is missing above
21:02 Heffalump ah :-( - that's becase of the previous aborted one
21:03 kyagrd oh is there a way to fix it?
21:03 Heffalump I think sm might have implemented something that deletes them after a while, if not you need to wait for him to do it manually.
21:03 Heffalump in the meantime you could make a repo with a new name, push to that, and then rename them both later
21:04 kyagrd thnks again for the suggestion
21:11 kyagrd hmm somehow apply failed again. I' try another reop and see if it fails again in the same place
21:14 Heffalump was there an error?
21:16 kyagrd yes it is not about the number of patches
21:16 kyagrd at one certain patch it starts to eat up memory and then just takes forever and something goes strange :(
21:17 Heffalump things to check - (1) are you able to push the patch to an empty local repository (2) is 'darcs check' happy on your repo
21:17 kyagrd arcs: out of memory (requested 241172480 bytes)
21:17 kyagrd darcs check okay
21:18 kyagrd havn't tried to push into local empy repo yet
21:21 tunixman left #darcs
21:22 kyagrd I am trying local and at the very problematic patch it ate up some memory (about 30%) and with full CPU run for a while it passed through
21:23 Heffalump what's in the patch? (darcs changes --verbose | less or darcs changes -i then press 'v' will let you look at it)
21:24 kyagrd It's actually a korean translation of Hutton's textbook. (A lot of weired things: UTF8 chars of Korean text)
21:24 Heffalump any conflicts, or large binaries?
21:25 Heffalump or just a large diff
21:25 kyagrd let me check the patch wait a min
21:29 kyagrd Oh, a bunch if BMP image file commits
21:30 kyagrd in the problematic patch
21:31 sm hello
21:31 Heffalump ah, hi :-)
21:32 Heffalump sounds like kyagrd has a patch that's big enough to blow up darcs apply on hub. Any ideas?
21:32 sm how big are the files in total, in the problem patch, kyagrd ?
21:33 kyagrd less than 100Mbytes but definitely more than 30Mbtyes
21:34 sm that sounds like the kind of patch that might exceed hub's available ram.. especially if you are having trouble even pushing it to a local repo
21:34 sm if you want try again, pushing just that single patch to hub, I'll watch it and confirm what's happening
21:35 kyagrd didn't have trouble but did ate up 30% of memory while its run
21:35 sm oh, so it did push ok ?
21:35 kyagrd in local repo it was okay
21:35 kyagrd but failed to push into hub
21:36 kyagrd sm, so should I make another empty repo in hub and try pushing that single patch?
21:37 sm kyagrd: if you have time, yes please
21:37 sm hold the push for a sec, just finding the logs
21:38 kyagrd I'll push to kyagrd@hub.darcs.net:testBigBinPatch whenever you are ready
21:40 sm kyagrd: ok fire at will
21:41 kyagrd pushing
21:44 kyagrd hmm pushing that single patch was successful
21:44 kyagrd but it failed when doing it after other patches
21:45 Heffalump I wonder if you can now pull between the repos on hub. pull is generally more efficient than apply.
21:45 sm kyagrd: are you sure it succeeded ? I'm not quite sure yet
21:46 kyagrd My console says push successful
21:46 sm I confirm that hub can't currently handle a patch of that size, in general :-/
21:47 Heffalump :-(
21:47 sm darcshub ssh process grew to 400M resident, then spawned darcs apply which grew to 600+M resident, the vps swapped for a while, then both processes died or exited
21:47 Heffalump how much RAM does the vps have?
21:48 sm 1G, though linode have promised to double that soon for the same price
21:48 sm and it's running other stuff, but darcs hub gets most of the ram
21:49 sm kyagrd: and a lock file was left behind in your repo, so things were not entirely successful
21:50 Heffalump is there any way to get hub to pull instead?
21:50 kyagrd Oh, I did another push of another patch that was quite big maybe it was because of that
21:50 sm Heffalump: eh.. not currently, IIRC that's disabled because it also used too much memory
21:50 kyagrd I'll just not try using hub for this repo :)
21:51 sm (in some cases)
21:52 gh_ joined #darcs
21:55 sm kyagrd: can you share the name of the problem patch ?
21:57 kyagrd it's name is startimg
21:57 sm that one seems not big at all, just 30K
21:58 kyagrd oh that's why there is a bigger one
21:58 sm it adds a bunch of small images, changes a few text files, and seems not to involve conflicts
21:58 sm conflictors
21:58 kyagrd yesmbeforedinner
21:59 sm ok, and that one hasn't made it to your hub I believe
21:59 sm you won't see it in changes in the web ui
22:04 kyagrd I'll just delete the repos on hub
22:04 kyagrd don't think it is a good idea to have repos of a lot of binaries in hub
22:05 Heffalump it ought to be fine, just darcs sucks somewhat with large patches :-(
22:05 sm yeah
22:05 sm thanks for the testing
22:06 sm I'm not sure what to do about it, except a larger vps will help some, large patches are rare and the memory is only used briefly
22:06 kyagrd what I believe is that darcs should deal with binaries somehow more efficiently
22:06 Heffalump how is hub generally doing load-wise?
22:07 Heffalump kyagrd: yep, that's the key issue here
22:07 Heffalump darcs sucks with large patches and it sucks with binaries
22:07 kyagrd patch from text does not generally get that big (unless its some sort of a database dump)
22:08 sm Heffalump: fine, as far as I can tell .. disk and ram and cpu usage are acceptable, and it's usually fast enough when I visit (sometimes a few seconds to warm up on first visit)
22:09 sm if it keeps growing it may need its own vps at some point
22:22 kyagrd are darcsden and patchtag still active?
22:22 kyagrd haven't used them in a while
22:23 sm they're still working, and maintained to some extent. It would be interesting to see if they handle your repo
22:37 kyagrd well darcsden even fail at the startimg patch with many small images
22:38 sm HA!
22:38 sm oops did I say that out loud ? sorry :)
22:39 sm now patch-tag!
22:39 gh_ joined #darcs
22:42 gh_ gsoc slots are published
22:43 gh_ haskell.org has 11, which I believe are the 9 edwardk asked for haskell.org + 2 for darcs
22:43 sm yay
22:44 gh_ :)
23:09 mizu_no_oto joined #darcs
23:26 dolio joined #darcs

| Channels | #darcs index | Today | | Search | Google Search | Plain-Text | summary