Perl 6 - the future is here, just unevenly distributed

IRC log for #webwork, 2014-07-30

| Channels | #webwork index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:14 mgage joined #webwork
05:57 Brando753 joined #webwork
12:24 mgage joined #webwork
14:15 mgage_ joined #webwork
14:20 shdw_work joined #webwork
15:56 aubreyja joined #webwork
15:56 aubreyja joined #webwork
16:34 goehle joined #webwork
17:18 mgage joined #webwork
17:18 goehle hey mgage
17:19 mgage hi geogg
17:19 mgage geoff
17:19 goehle anything need to be done before Portland.  I'm helping Peter get the history feature for ww3 going
17:20 aubreyja Hi geoff - I fixed the Mail::Sender waiting tee/readline/buffer problem.  But not the other out of sync q/a's on some platforms.  Unfortch, stbufd specifically says it doens't work with tee...
17:20 mgage probably — but I’m not on top of this at all.  I see that you and peter have been getting a lot done. Thanks for that.
17:21 goehle hey aubreyja
17:21 goehle thats too bad
17:21 goehle you could turn tee on for prereqs
17:21 goehle then turn it off for ww_install
17:21 goehle its not ideal but it would capture more
17:21 goehle fixing it for Mail::Sender is the important one though
17:21 goehle also, how are you dealing with Mail::Sender for your unattended install (I couldn't find a way to auto yes that since it seems to be a custom config script for the package)
17:22 mgage I’ve been working on WW_Vagrant and using aubreyja’s ww_install, and also getting the archived copies of the moodle question type out of mothballs.  — the latter has been quite a project — it took several days just to find the most current version
17:22 mgage (I’ve also got  a thesis defense to attend tomorrow which I have to read up on :-)
17:22 aubreyja PERL_MM_DEFAULT = 1 before source install_prerequisites.sh does it.
17:22 goehle ok, good to know :)
17:22 goehle nice
17:23 aubreyja I just ran through a complete install on Debian 7.2 with --nointeractive and it worked
17:23 goehle nice
17:23 goehle I was just gearing up for a Fedora test
17:23 goehle do you want me to test no-interactive
17:23 goehle which branch was that again?
17:23 mgage when I did the preinstall the mysql still required that I enter the root password as I recal
17:24 mgage the branch is options
17:24 aubreyja mgage - yes, I need to add that - but it's just what David was doing.  But that only works for debian/ubuntu. For fedora/rh I need to find a way to run mysql_secure_installation unattendated, or I guess just do it with mysql commands
17:25 aubreyja The rest of the week I'm going to finish up the prereqs refactor work.  Geoff - does what I was doing make sense/look good to you?
17:25 mgage it worked fine actually — one or two requests at the beginning are pretty easy to handle
17:25 aubreyja sure, but --nointeractive should be no interactive :)
17:25 goehle It does, although it might need to be split up even more, by distro not just yum/apt
17:26 aubreyja ah, prerequisites.pl accounts for distro and version by basically subclassing the main distro hashes
17:26 mgage my biggest request is that you rethink the options and defaults on whether to get a fresh copy of webwork2, pg and libraries
17:26 aubreyja Yeah, I can do that - maybe add a --nodownload /path/to/code option?
17:27 goehle ok.  AT some point I still think its a good idea to try and get distro specific stuff into their own files.  It feels a little gross to have to modify core code to fix a distro because you have to then (in theory) test all the other distros
17:27 aubreyja Yeah, I agree with that
17:28 mgage for the vagrant use case just make nodownload the default option when you ask the download question — at the moment nodownload is not an option at all if webwork already exists.
17:29 aubreyja right - it's not an option yet.  The other option is that once the script realizes that /opt/webwork exists, I could make the default option to use the code that's there already.
17:29 goehle I liked the idea of having a distro file with 1) A prerequisites Hash 2) A ww_install hash and 3) some (optional) functions which are run pre-prerequisites, between prereq and ww_install, and after ww_install to do any custom/wierd stuff
17:29 mgage that’s what I would suggest (and it certainly works for the vagrant use case ) — we might have to see if that is the best default or not
17:30 goehle could you set it up so that it uses git to update/change
17:30 goehle so for example it adds the repo if necc, changes branches, if necc, and uses git pull
17:31 mgage that is how it’s usually set up at the moment.
17:31 goehle that way it does a git update which is much faster than redownloading everything
17:32 aubreyja Yes, in principle - I didn't do that originally because what I did is simpler, but in the gradual evolution to perfection maybe it's time to start doing that
17:32 mgage at the moment the pulls for webwork2, pg and libraries are split out in the vagrant files so they are done before you even start up vagrant. — that speeds things up if you don’t need to update those files — which is usually the case for development
17:33 aubreyja Right - for vagrant we need to not get the code, but maybe check for updates. For new installs we need to check for code, check for updates, offer to update
17:33 goehle it seems like it solves the problem of having something already there in a nice way since it won't change anything if its up to date and will udpate if it isn't
17:34 mgage it adds a few more steps — but it also means that you have more control over which steps are taken and that speeds things up — as jason says it can evolve towards more automation once we understand which automation is reliably convenient.
17:34 goehle automation should be second, installing is not something you need to do over and over and over
17:34 mgage that’s right.
17:35 goehle aubreyja, did I explain about Test::XML?
17:35 mgage just check before you update because sometimes you are not up to the latest version for a good reason (at least for development branches)
17:35 aubreyja Yes, put this on the list for next week. Shouldn't be too hard to get right. The only question really is whether we should use commands or one of the perl Git interfaces (of which I'm not sure which is best)
17:36 aubreyja (Yes, I'll put this on the list for next week)
17:36 aubreyja No geohle, what's up with that?
17:36 goehle if you use cpan to install Pod::WSDL on CentOS it fails because Test::XML doesn't install correctly
17:36 goehle I can't get Test::XML to test correctly at all so I changed the prereqs to install Test::XML with -f
17:36 aubreyja hmm, that must be new in centos 7
17:37 goehle that was something that happened in CentOS 6
17:37 goehle but it was wierd and slippery
17:37 aubreyja ok, we don't need Test::XML - it's just for tests?
17:37 goehle right, its just for testing Pod::WSDL
17:37 goehle so if you can get that from a package, for example, you can remove all the Test::XML stuff
17:37 aubreyja ok soudns good
17:38 goehle another wrinkle is that I think the force install confuses the dependency checker
17:38 goehle so there were packages (like HTML::Template) that weren't getting installed because of missing dependancies
17:38 goehle I never really figured out what exactly what was going on
17:38 aubreyja ok maybe we try doing -f Pod::WSDL last then
17:39 goehle right, that seems like the way to go (unless something else uses Test::XML, which it might)
17:39 aubreyja right
17:39 aubreyja I'll have a look - is there an issue for this on github?
17:41 goehle https://github.com/aubreyja/ww_install/issues/68
17:41 goehle THis is the initial issue
17:41 goehle but I've been wreseling with it for a while
17:42 aubreyja ok, thanks
17:42 goehle np,  I checked that it does work on CentOS 7 (but not 6 anymore because of the -j issue) a few days ago, but it could very well pop up again
17:45 shdw_work joined #webwork
18:03 goehle hey aubreyja
18:03 aubreyja hey
18:04 goehle another thing I discovered but didn't have time to deal with was that the apache restart doesn't seem to detect failed restarts in Fedora or CentOs 7 because of the way systemctl works
18:04 goehle Or at least the script was proceeeding when apache did fail to restart
18:04 aubreyja hmm, that's too bad. It must leave an exit code somewhere right?
18:04 goehle it must
18:05 aubreyja I'll see if I can track that down.  The whole systemctl stuff seems...uh...like an unnecessary layer in places
18:06 goehle yeah, its annoying because journalctl doesn't actually show the apache errors
18:06 goehle I ended up having to actually run httpd manually to see the apache output
18:06 aubreyja didn't know about journalctl.  Yeah, maybe that's the way to go
18:14 goehle well systemctl show status doesn't work either
18:14 goehle the apache error log might have it
18:18 aubreyja hey goehle - I'm going to add back in the logging and then try to fix any remaining issues on debian (where it seems to have the most effect)
18:18 mgage aubreyja:  — anyone else had trouble with unarchiving courses on a site created with ww_install?  — I can do it from the command line but I can’t untar things from the admin page
18:18 goehle I can test real quick
18:18 goehle I just finished an install
18:18 aubreyja not that I know of
18:19 aubreyja on a vagrant install, are permissions set before the script runs?  Maybe the vagrant permissions are wrong (or getting messed up)
18:19 mgage kk — mine was ubuntu — the failed command (reported on the webpage — worked from the command line with suitable permission adjustment — but even setting everything obvious to 777 didn’t allow it to run from the command line
18:20 aubreyja who owns the courses/ dir in the vagrant install?
18:20 mgage vagrant will set permissions — but I’m that could be the problem since I’m not confident that I’m using it properly
18:20 mgage the webserver — judging from top  www-data
18:20 goehle I just checked on a fresh Fedora install and it worked
18:21 goehle I was able to archive/delete/unarchive/login
18:21 mgage does the “server user get set in site.conf during install ?
18:21 mgage kk — I’ll report back when I have more info
18:21 aubreyja my script sets wwadmin as owner.
18:21 aubreyja yes, it should get set from the apache24Layouts hash
18:22 mgage that could be the problem then because top was showing www-data as the operator of the httpd instances
18:22 goehle which branch do you have the logging fixed on
18:22 aubreyja I'm updating it right now in ww3
18:22 aubreyja I'll let you know when I commit it (in a minute)
18:23 goehle kk
18:23 aubreyja goehle - I dno't remember why I did things like LOG->autoflush(1) and STDOUT->flush().  Do you remember why you removed them?
18:24 goehle That was part of trying to fix the buffer issues (before I figured out it was tee that was doing it).  Those set the perl io buffer to be zero.  I removed some of my experiments but may have left those
18:24 goehle or removed them
18:24 goehle or something
18:36 aubreyja ok goehle, ww3. I think it's just the one exec line in install_webwork.sh that needed to be uncommented
18:37 goehle ?
18:37 aubreyja to get the log going again
18:37 aubreyja with tee
18:37 aubreyja after fixing Mail::Sender's errant question
18:37 goehle ok, I'll give it a shot with CentOS
18:37 goehle have you pulled master back into ww3 in a while?
18:38 goehle that might be a good idea first
18:38 aubreyja no, I haven't - merge master into ww3 or ww3 into master?
18:38 goehle master into ww3
18:39 goehle all of the changes I made to get CentOS going were in master
18:39 goehle (I pulled ww3 into master when I did the 2.9 release)
18:40 aubreyja kk, will do, haven't yet, but feel free to if you want to test centos
18:40 goehle well centos will probably break if you don
18:40 goehle dont
18:40 goehle because of the Test::XML stuff
18:40 goehle I can test fedora which seemed to work
18:41 aubreyja ah, I'm testing debian right now. I'll pull in master to ww3 and push it up
18:51 goehle wait what am I testing again
18:51 goehle non interactive install
18:51 goehle or the log file?
18:54 goehle nm
18:56 aubreyja well, the log file is back, but so are the mismatched question timings on debian...
18:56 goehle did you turn tee off?
18:56 goehle after the prereq run
18:57 aubreyja no, how do I turn tee off?
19:02 aubreyja master is merged into ww3 and pushed up to github.
19:07 goehle http://unix.stackexchange.com/questions/80988/how-to-stop-redirection-in-bash
19:08 goehle looks like you can save the original pipes and then restore them
19:08 goehle like I said, this means that ww_install needs to do all of its logging 'manually' using the LOG filehandle
19:11 aubreyja cool - I'l work on this.
19:14 goehle np.  Fedora also has problems with the perl io
22:40 mgage joined #webwork
23:37 mgage joined #webwork

| Channels | #webwork index | Today | | Search | Google Search | Plain-Text | summary