Perl 6 - the future is here, just unevenly distributed

IRC log for #puppet-openstack, 2016-02-22

| Channels | #puppet-openstack index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:10 ducttape_ joined #puppet-openstack
00:16 fedexo joined #puppet-openstack
00:19 fedexo joined #puppet-openstack
00:22 furlongm joined #puppet-openstack
01:02 yolanda joined #puppet-openstack
01:04 ducttape_ joined #puppet-openstack
01:04 fedexo joined #puppet-openstack
01:09 markvoelker joined #puppet-openstack
01:19 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
01:57 ducttape_ joined #puppet-openstack
02:46 openstackgerrit Emilien Macchi proposed openstack/puppet-nova: rbd: make sure libvirt is run before get-or-set virsh secret  https://review.openstack.org/282044
02:46 yolanda joined #puppet-openstack
02:46 ducttape_ joined #puppet-openstack
02:48 ilbot3 joined #puppet-openstack
02:48 Topic for #puppet-openstack is now Puppet OpenStack modules - https://wiki.openstack.org/wiki/Puppet
02:50 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: repos: bump rdo to latest commit  https://review.openstack.org/282939
03:01 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: deploy Cinder and Nova with RBD backend  https://review.openstack.org/281624
03:09 markvoelker joined #puppet-openstack
03:14 ducttape_ joined #puppet-openstack
03:27 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
04:15 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
04:29 yolanda joined #puppet-openstack
04:42 baker joined #puppet-openstack
05:10 markvoelker joined #puppet-openstack
05:46 baker joined #puppet-openstack
06:11 jaosorior joined #puppet-openstack
07:11 markvoelker joined #puppet-openstack
07:32 hjensas joined #puppet-openstack
07:46 jtomasek joined #puppet-openstack
08:13 dgurtner joined #puppet-openstack
08:13 dgurtner joined #puppet-openstack
08:26 jpena joined #puppet-openstack
08:37 jistr joined #puppet-openstack
08:53 leanderthal joined #puppet-openstack
09:01 paramite joined #puppet-openstack
09:12 markvoelker joined #puppet-openstack
09:17 mkarpin joined #puppet-openstack
09:44 derekh joined #puppet-openstack
10:07 16WAACWSS joined #puppet-openstack
10:40 chem joined #puppet-openstack
10:52 fvollero joined #puppet-openstack
10:54 yottatsa joined #puppet-openstack
11:12 markvoelker joined #puppet-openstack
11:29 davideagle joined #puppet-openstack
11:37 gfidente joined #puppet-openstack
11:41 zigo joined #puppet-openstack
11:42 patrickeast joined #puppet-openstack
11:44 holser_ joined #puppet-openstack
11:45 mgagne joined #puppet-openstack
11:46 saneax joined #puppet-openstack
11:47 ken_barber joined #puppet-openstack
11:50 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
11:54 alee joined #puppet-openstack
12:27 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
12:29 davideagle joined #puppet-openstack
12:43 markvoelker joined #puppet-openstack
12:45 EmilienM good morning
12:50 jaosorior joined #puppet-openstack
12:51 jaosorior joined #puppet-openstack
12:55 iurygregory joined #puppet-openstack
12:56 colonwq EmilienM, Good morning
13:06 cdelatte joined #puppet-openstack
13:10 dprince joined #puppet-openstack
13:12 ducttape_ joined #puppet-openstack
13:14 openstackgerrit Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Override X-Forwarded-Proto header  https://review.openstack.org/283074
13:27 openstackgerrit Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Override X-Forwarded-Proto header  https://review.openstack.org/283074
13:27 delattec joined #puppet-openstack
13:29 markvoelker joined #puppet-openstack
13:49 johnmilton joined #puppet-openstack
13:53 v1k0d3n joined #puppet-openstack
14:02 richm joined #puppet-openstack
14:07 jistr joined #puppet-openstack
14:12 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: repos: bump rdo to latest commit  https://review.openstack.org/282939
14:17 openstackgerrit joined #puppet-openstack
14:23 openstackgerrit Lukas Bezdicka proposed openstack/puppet-nova: Supports IPv6 in vnc proxy.  https://review.openstack.org/281346
14:28 bdossant joined #puppet-openstack
14:36 alee joined #puppet-openstack
14:42 xarses joined #puppet-openstack
14:44 bdossant_ joined #puppet-openstack
14:45 rain joined #puppet-openstack
14:58 bdossant joined #puppet-openstack
15:00 ducttape_ joined #puppet-openstack
15:00 ducttape_ joined #puppet-openstack
15:15 gfidente joined #puppet-openstack
15:18 dfisher joined #puppet-openstack
15:19 ayoung joined #puppet-openstack
15:23 dhollinger joined #puppet-openstack
15:23 baker joined #puppet-openstack
15:27 bdossant joined #puppet-openstack
15:36 mdorman joined #puppet-openstack
15:38 xarses joined #puppet-openstack
15:44 openstackgerrit Lukas Bezdicka proposed openstack/puppet-nova: Supports IPv6 in vnc proxy.  https://review.openstack.org/281346
15:50 mfisch should we be adding copyright notices to every file we touch?
15:50 mfisch I see enovance has copyright on most files in the keystone module
15:50 mfisch or Dan
15:52 EmilienM mfisch: I think we should try to follow http://docs.openstack.org/developer/hacking/#openstack-licensing
15:52 EmilienM for newly created files
15:52 EmilienM there is more about it here: https://wiki.openstack.org/wiki/LegalIssuesFAQ#Copyright_Headers
15:53 fedexo joined #puppet-openstack
15:53 mfisch thats license not copyright isnt it?
15:53 mfisch that page doesnt cover copyright
15:53 mfisch even if the code is GPL you can hold the copyright on it
15:54 mfisch I dont really care but if I work on a file that enovance has a blanket claim on, I feel like I should be adding my name too
15:54 mfisch I care in that someone else is claiming the whole file I guess, I'd like to either nobody claim anything or do it right
15:54 * social annoys with https://review.openstack.org/#/c/267212/
15:55 social also https://review.openstack.org/#/c/281991
15:55 * mfisch doesnt review ooo
15:55 mfisch unfortunately I have 0 knowledge
15:56 dgurtner joined #puppet-openstack
15:56 dgurtner joined #puppet-openstack
16:14 yolanda joined #puppet-openstack
16:15 openstackgerrit Emilien Macchi proposed openstack/puppet-nova: rbd: make sure libvirt is run before get-or-set virsh secret  https://review.openstack.org/282044
16:29 ericksonsantos joined #puppet-openstack
16:53 haplo37 joined #puppet-openstack
16:59 cwolferh joined #puppet-openstack
16:59 dprince joined #puppet-openstack
17:13 gfidente holser_, you around?
17:13 rahulait joined #puppet-openstack
17:18 mwhahaha gfidente: he's out on vacation for the next 2 weeks i thnk
17:18 gfidente oh that's bad news, I left a reply to his comment here: https://review.openstack.org/#/c/276141/35
17:18 dgurtner joined #puppet-openstack
17:18 dgurtner joined #puppet-openstack
17:19 gfidente mwhahaha, you have any interest in checking that too?
17:19 mwhahaha yea sure i'll check it out
17:20 gfidente thanks'
17:35 openstackgerrit Emilien Macchi proposed openstack/puppet-nova: rbd: make sure libvirt is run before get-or-set virsh secret  https://review.openstack.org/282044
17:35 gfidente mwhahaha, ack, thanks
17:35 gfidente -ex should still go away as it doesn't apply to || and &&
17:52 mwhahaha yea probably
17:57 cwolferh joined #puppet-openstack
18:05 angdraug joined #puppet-openstack
18:07 dprince joined #puppet-openstack
18:08 ducttape_ joined #puppet-openstack
18:13 dmsimard EmilienM: do you have a fix for https://review.openstack.org/#/c/280385/ ?
18:13 dmsimard I looked if I could help quickly but I don't really know how to resolve the issues at first glance
18:42 EmilienM dmsimard: /me back from lunch, looking now
18:42 EmilienM dmsimard: yes, like I said on the ML, puppet-keystone beaker jobs are broken
18:42 EmilienM we are working on it
18:42 EmilienM it's because we are now relying on openrc file
18:42 dmsimard ok np, I don't follow openstack-dev much :p
18:45 bkero #puppet-openstack is high traffic enough :)
19:00 mfisch dmsimard: you can subscribe to specific tags, for example [puppet]
19:00 mfisch would recommend
19:01 dmsimard mfisch: with mail filters, you mean ?
19:01 EmilienM yeah, I only follow 3 tags, not that hard
19:01 EmilienM dmsimard: yes
19:02 dmsimard Yeah, I guess
19:02 mfisch no
19:02 mfisch not filters
19:02 mfisch its in your subscription
19:02 dmsimard Really ? Need to check that out.
19:02 mfisch let me find a link
19:03 bkero Oh that's pretty cool
19:03 mfisch this explains why nobody ever replies to Emilien
19:03 * bkero just uses procmail, like a stubborn person
19:03 mfisch go here and subscribe: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
19:03 EmilienM lol
19:03 mfisch it will present you a list og topics
19:03 EmilienM thank you mfisch now I'm crying.
19:03 mfisch this should actually be a meeting topic tomorrow
19:03 EmilienM :'( nobody is reading my e-mails
19:04 mfisch I thought crinkle taught everyone this
19:04 dmsimard oh wow
19:04 mfisch I think it should be a requirement for being core EmilienM
19:04 mfisch to subscribe to this tag
19:04 dmsimard mfisch: remind me to get you a beer next time I see you
19:04 mfisch yes!
19:04 mfisch I like beer
19:04 EmilienM mfisch: I tend to agree
19:05 mfisch I added it to the meeting
19:05 bkero The tag is [EmilienM-ignore]?
19:05 EmilienM cool thanks
19:05 mfisch I do agree that os-dev without these tags is too much trafffic
19:06 EmilienM I don't use mailman subscribtion, I use email filtering
19:06 mfisch bkero: I have the no quebec filter in place
19:06 bkero Haha
19:06 EmilienM /kick bkero
19:06 bkero :'(
19:06 mfisch EmilienM: one way or the other people can handle it, we're all smart people
19:06 EmilienM mfisch: I hope
19:07 mfisch more offensive: calling a frenchman quebecois or a quebecois a frenchman?
19:07 EmilienM ask dmsimard
19:07 mfisch calling either an American is probably the worst
19:08 mfisch speaking of which, dmsimard have you seen this?  http://cbiftrumpwins.com/#intro
19:08 dmsimard what's a frenchman ?
19:09 dmsimard oh god ok
19:09 mfisch lol
19:09 mfisch I found a beach front house there I can afford
19:09 mfisch but looks cold as hell
19:09 dmsimard mfisch: I think either of those are offensive :p
19:09 bkero Is that like some beach-front property in northern Alaska?
19:10 mfisch Cape Breton island
19:10 mfisch basically the last stop before England if you look east from Canada
19:24 EmilienM mwhahaha: just a remark, not really bad feedback but I noticed puppet-cinder unit tests take much more time with the new fact refacto, since it tests multiple operatingsystem values
19:25 mwhahaha yea
19:25 mwhahaha so unless we have some rhel vs centos specific items we may not want to include both
19:26 EmilienM right
19:26 EmilienM imho centos == redhat
19:26 mwhahaha because basically we've increased the number of times we run the tests by a factor of 4 i think
19:26 EmilienM in term of puppet testing
19:26 EmilienM yeah
19:26 mwhahaha because we also do fedora
19:26 mwhahaha x2
19:26 mwhahaha so rhel, centos, debian, ubuntu, fedora x2
19:26 EmilienM debian & ubuntu have some specific bits, so I understand
19:27 EmilienM but AFIK centos == redhat
19:27 EmilienM though fedora has some specific bits AFIK
19:27 mwhahaha do we need both fedoras?
19:27 EmilienM so maybe we can merge redhat/fedora
19:27 EmilienM err
19:27 mwhahaha 20 & 21?
19:27 EmilienM so maybe we can merge redhat/centos
19:27 EmilienM I don't know well about versions -- dmsimard do you?
19:27 mwhahaha https://github.com/openstack/puppet-openstack_spec_helper/blob/master/lib/puppet-openstack_spec_helper/defaults.rb
19:28 mwhahaha so we also do 2x debian with 7 and 8
19:28 EmilienM imho, from mitaka we should stop 7
19:28 EmilienM but zigo can confirm
19:29 mwhahaha so i think we would be ok with centos7, fedora 22, ubuntu 14.04 and debian 8
19:29 mwhahaha that gives a good variety
19:29 EmilienM +1
19:29 mwhahaha it's mostly just logic checks anyway
19:29 mwhahaha and if we introduce something specific we can just do a one off
19:29 mwhahaha rather than test them all
19:30 mwhahaha with the restructuring of all the tests it makes it much easier to add yet another OS combination to test with because of all the shared examples
19:30 EmilienM right, I like what you did
19:32 mwhahaha i'll propose a reduced set of OSs in a bit
19:33 EmilienM I like it, I'll +2
19:36 openstackgerrit Emilien Macchi proposed openstack/puppet-cinder: volume: add volume_clear options  https://review.openstack.org/283220
19:37 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: deploy Cinder and Nova with RBD backend  https://review.openstack.org/281624
19:40 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: deploy Cinder and Nova with RBD backend  https://review.openstack.org/281624
19:42 yolanda joined #puppet-openstack
19:44 ducttape_ joined #puppet-openstack
19:45 crinkle EmilienM: i tried to write https://review.openstack.org/#/c/282832/ to fix keystone integration tests but it looks like trove is broken?
19:45 EmilienM crinkle: actually it's not trove itself
19:45 EmilienM crinkle: RDO bumped MariaDB from 5.5 to 10
19:45 EmilienM crinkle: that broke trove
19:45 dmsimard EmilienM: Merging redhat and centos could have weird implications between RHEL and CentOS - I'm not familiar with RHEL so I don't know
19:45 EmilienM crinkle: someone from trove is working on it
19:45 crinkle EmilienM: ok
19:46 EmilienM crinkle: in the meantime RDO downgraded mariadb
19:46 dmsimard Are we talking $::osfamily or $::operatingsystem ?
19:46 EmilienM crinkle: do 'recheck' and it should be fine now. Let me know if not
19:46 EmilienM dmsimard: we're talking about unit testing
19:48 crinkle EmilienM: there's also something weird going on with scenario002 on https://review.openstack.org/#/c/282833/ , trying to look into it but i have no idea what the issue is yet
19:49 EmilienM crinkle: let me loo
19:49 EmilienM look*
19:49 EmilienM crinkle: looks like a random issue
19:50 EmilienM apache did not start
19:50 crinkle EmilienM: yeah but it's the same issue twice in a row
19:50 crinkle i can recheck again and see if it'll do it a third time
19:51 EmilienM oh wait you actually fixed our beaker jobs
19:51 crinkle hopefully :)
19:51 EmilienM omg I'll send you cookies wherever you are
19:52 EmilienM let me look the ubuntu issue with keystone it sounds weird
19:54 dmsimard oh, "open sourceress" .. never seen that one before
19:58 crinkle EmilienM: oh you have a patch that removes that test, i can abandon mine since it's breaking weirdly anyway
19:58 EmilienM crinkle: no
19:58 EmilienM crinkle: I'll rebase mine of top of yours
19:58 EmilienM mine is really failing
19:59 EmilienM your patch should pass
19:59 EmilienM I think?
19:59 crinkle ¯\_(ツ)_/¯
19:59 crinkle we'll see how this recheck goes
19:59 EmilienM let's see if the recheck helped
19:59 crinkle :)
20:04 chem crinkle: nice.  I was looking into the problem and the default_domain_spec.rb is .. non-working.  There are several problems here: openrc is updated too early the admin user don't match the openrc one, the user is crated in the default domain as keyston is restartd too late.
20:04 chem EmilienM: ^
20:05 EmilienM we might need to add some ordering rules for openrc file
20:05 chem crinkle: EmilienM if this fix, fixes the CI go for it. I will take back from there tomorrow.
20:14 baker joined #puppet-openstack
20:19 openstackgerrit Alex Schultz proposed openstack/puppet-openstack_spec_helper: Reduce number of OS combinations for tests  https://review.openstack.org/283244
20:19 openstackgerrit Emilien Macchi proposed openstack/puppet-keystone: Update default paste_config on Red Hat systems  https://review.openstack.org/280385
20:20 rlaurika joined #puppet-openstack
20:20 partner joined #puppet-openstack
20:20 foxhunt_away joined #puppet-openstack
20:20 mattymo joined #puppet-openstack
20:21 b3nt_pin joined #puppet-openstack
20:21 timrc joined #puppet-openstack
20:21 cfloare joined #puppet-openstack
20:21 _nick joined #puppet-openstack
20:21 EmilienM mwhahaha: can you look https://review.openstack.org/#/c/282832/ please ,
20:21 bkero joined #puppet-openstack
20:22 itsuugo joined #puppet-openstack
20:22 EmilienM crinkle: the ubuntu error does not seem to happen anymore : https://jenkins01.openstack.org/job/gate-puppet-openstack-integration-scenario002-tempest-dsvm-trusty/210/console
20:23 bkero joined #puppet-openstack
20:24 finchd joined #puppet-openstack
20:25 jgrassler joined #puppet-openstack
20:37 EmilienM mwhahaha, mfisch: if you don't mind to +A https://review.openstack.org/#/c/282833/
20:37 mfisch looking
20:38 mwhahaha done
20:38 mfisch me too
20:38 EmilienM thx guys
20:38 EmilienM our CI should be good  now
20:41 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: keystone: stop configuring paste_config  https://review.openstack.org/283248
20:48 openstackgerrit joined #puppet-openstack
20:48 EmilienM clayton, mfisch: I need your attention on https://review.openstack.org/#/c/282044 -- in case you care about nova/rbd
20:51 clayton heh, that code has been fixed literally about 8-10 times
20:52 EmilienM clayton: yeah, but this time, it's being gated in our CI
20:52 clayton are you actually seeing circular deps in CI?
20:52 EmilienM clayton: I'm working on scenario001 to run Glance/Cinder/Nova using RBD backend
20:52 EmilienM clayton: in my tests, yes
20:53 clayton puppet-nova doesn't really do any libvirt configuration does it?
20:54 EmilienM I think it does, in nova::migration::libvirt
20:54 EmilienM let me check
20:54 clayton ok, that's probably why it has the dep on config being finished then
20:54 EmilienM except it does not use nova_config, it use file_line in /etc/libvirt/libvirtd.conf
20:54 clayton yeah, that's why it's that way
20:55 EmilienM ok so should we keep the dep?
20:55 clayton ok, looking at that file, this looks ok to me
20:55 clayton no, I think it's safe without it
20:55 EmilienM my goal is to deploy a compute in a single puppet run when running ceph backend
20:56 EmilienM and https://review.openstack.org/281624 is testing it
20:57 clayton looks good to me
20:57 clayton good catch
20:57 EmilienM so scenario001 will run ceph and deploy glance/nova/cinder/gnocchi using RBD backend
20:58 EmilienM and scenario002 will deploy swift and deploy glance using RBD backend (but not done yet)
20:58 clayton maybe we don't run into that because we dont' run ceph on the same nodes as compute
20:58 clayton very cool
21:02 openstackgerrit Giulio Fidente proposed openstack/puppet-ceph: Disable udev rules in ::osd for releases <= Hammer  https://review.openstack.org/276141
21:06 openstackgerrit Merged openstack/puppet-openstack-integration: Use "default" domain in auth credentials  https://review.openstack.org/282832
21:08 davideagle_ joined #puppet-openstack
21:11 dgurtner joined #puppet-openstack
21:11 dgurtner joined #puppet-openstack
21:12 ayoung joined #puppet-openstack
21:14 abramley left #puppet-openstack
21:14 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Add support for civetweb  https://review.openstack.org/254548
21:15 openstackgerrit Merged openstack/puppet-nova: Use uppercase 'S' in OpenStack  https://review.openstack.org/276117
21:25 saneax_AFK joined #puppet-openstack
21:28 beddari joined #puppet-openstack
21:29 EmilienM crinkle: I was wondering, if for the first mitaka beta tag I had to patch something in our modules / repos
21:29 EmilienM or just push the tag
21:30 EmilienM since this is just a beta tag, in OpenStack, I think a git tag is enough
21:31 crinkle EmilienM: i think as long as you're not planning to publish it on the puppet forge then a git tag is enough
21:31 EmilienM ok cool
21:40 crinkle chem: I was looking at the keystone::roles::admin class and I'm confused how to create the admin user/tenant in a default domain that isn't called "default", which I think is contributing to problems in that default_domain_spec.rb
21:41 chem crinkle: it has to be changed to a define, quite a lot of refactoring
21:42 crinkle yuck :(
21:42 chem crinkle: I'm off now, you can let message here, and I will backtrack tomorrow (my) morning
21:42 bdossant joined #puppet-openstack
21:43 crinkle chem: I'm in a midcycle this week so not really working on it, just wanted to mention it since you brought it up earlier
21:43 EmilienM I think I started to move it in a define
21:43 EmilienM and I abandonned it
21:43 * EmilienM is looking for the patch
21:44 EmilienM https://review.openstack.org/#/c/199676/
21:44 EmilienM chem: ^
21:44 EmilienM crinkle -1'ed it :-P "I still don't really understand the purpose of this change"
21:45 crinkle I think my thinking was "why would there be more than one admin user" and I still sort of think that
21:45 EmilienM yeah
21:46 crinkle if there was a way to pass the default domain from init.pp into keystone::roles::admin that would address the current problem at hand i think
21:46 severion joined #puppet-openstack
21:46 crinkle because there is still just one admin user being created but it's being created in the wrong domain
21:47 openstackgerrit Matt Fischer proposed openstack/puppet-keystone: Deprecate python.pp and fix client tags  https://review.openstack.org/282065
21:47 openstackgerrit Matt Fischer proposed openstack/puppet-keystone: Deprecate python.pp and fix client tags  https://review.openstack.org/282065
21:47 dmsimard first time I see that python.pp class
21:48 EmilienM yeah, we still have some "legacy" code
21:53 alee joined #puppet-openstack
21:54 EmilienM mwhahaha, crinkle: oops https://bugs.launchpad.net/puppet-glance/+bug/1548515
21:54 openstack Launchpad bug 1548515 in puppet-glance "glance acceptance failing after removal of keystone auth token" [Undecided,New]
21:54 mwhahaha at least i think it's related to the auth token stuff, not completely sure
21:56 EmilienM I think it is
22:07 EmilienM mtreinish: still have the timeout, with volume_clear=none
22:08 EmilienM apparently, the volume is still busy: http://logs.openstack.org/24/281624/9/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-centos7/9e29774/logs/cinder/volume.txt.gz#_2016-02-22_21_46_55_989
22:15 mfisch ayoung: you cursed me
22:15 mfisch now I have the openstack client issue in my staging env
22:15 mfisch someone made a project that it does not like
22:15 ayoung mfisch, quite poswsible.  I curse a lot of people.
22:15 mfisch Debug: Puppet::Provider::Openstack: Non-fatal error: 'Execution of '/usr/bin/openstack role list --quiet --format csv' returned 1: 'NoneType' object is not iterable (HTTP 400) (Request-ID: req-28b60b49-19e4-4c97-bc5b-86a982c78987)'. Retrying for 29 more seconds
22:15 EmilienM lol
22:15 mfisch I get that on all calls now
22:15 ayoung mfisch, you shure that was how it happened, and not do to an update of some package?
22:16 mfisch that would be a good guess but our deploy was this morning, this started last night
22:16 mfisch osc works fine by hand
22:16 mfisch so its a ruby parsing something or other
22:17 ayoung mfisch, from the sme machine?
22:17 ayoung mfisch, I was seeing it running osc from the CLI
22:17 ayoung not from ruby
22:17 mfisch all machines in our cluster it happened at once
22:17 ayoung cluster is only half the word
22:18 mfisch I actually exported the CSV into excel to see if there was weird tuff
22:18 mfisch and its ok
22:19 ayoung I thought we identified it as a cliff version problem
22:19 mfisch it works fine by hand
22:19 mfisch just ruby's parsing thats broken
22:19 mfisch its time for puts!
22:19 ayoung I think you lie
22:19 mfisch [STAGING] root@dnvrco02-keystone-001:/var/log# /usr/bin/openstack project list --quiet --format csv --long | more
22:19 mfisch "ID","Name","Domain ID","Description","Enabled"
22:19 mfisch "006864576a8949e6b0c27335ec8cc5e5","mfisch","default","",True
22:20 mwhahaha it's role list that's it errored on
22:20 mwhahaha not project list
22:20 * mwhahaha points up
22:20 mfisch it errors on user list, project list and role list
22:20 ayoung $ . ./overcloudv3.rc
22:20 ayoung [heat-admin@overcloud-controller-0 ~]$ openstack server list
22:20 ayoung list index out of range
22:20 mfisch Execution of '/usr/bin/openstack project list --quiet --format csv --long' returned 1: 'NoneType' object is not iterable (
22:20 mfisch Execution of '/usr/bin/openstack user list --quiet --format csv --long' returned 1: 'NoneType' object is not iterable (HTTP 400)
22:20 ayoung ah...different error
22:20 mwhahaha http 400 points to a keystone error
22:21 mwhahaha not a ruby issue
22:21 mwhahaha plugs NoneType is python jank ;)
22:21 ayoung yep
22:21 mwhahaha s/plugs/plus
22:21 mfisch mwhahaha: you'd think that but I have nothing in logs
22:21 mwhahaha 400's don't end up in logs
22:21 mwhahaha YAY
22:21 ayoung mfisch, its the response from Keystone that the client is barfing on
22:21 ayoung run with --debutg
22:21 ayoung debug
22:22 mwhahaha no a 400 is a bad client request
22:22 mwhahaha so it's getting rejected (silently of course)
22:22 ayoung mwhahaha, but it won't show up as an error
22:22 mfisch this was simpler in the eventlet days
22:23 ayoung mfisch, right.  Sure.
22:24 mfisch easier to debug I mean
22:26 ayoung mfisch, nah, same
22:26 mfisch puppet just restarted apache on me
22:26 mfisch ^%$%^
22:26 ayoung if you really need to debug inside keystone: http://adam.younglogic.com/2015/02/debugging-openstack-with-rpdb/
22:31 openstackgerrit Merged openstack/puppet-zaqar: Add acceptance spec for zaqar with mongo.  https://review.openstack.org/279351
22:32 mfisch issue is in our middleware
22:32 * mfisch still shakes fist
22:35 ayoung mfisch, glad I could help
22:35 ayoung Did I help?
22:35 ayoung Meh, I'll take credit anyway
22:37 mfisch yep
22:37 mfisch as usual
22:38 ron___ joined #puppet-openstack
22:42 ducttape_ joined #puppet-openstack
22:51 openstackgerrit Merged openstack/puppet-keystone: Remove func test for disable_admin_token_auth  https://review.openstack.org/282833
22:57 EmilienM mwhahaha, richm, mfisch: if you around, please look https://review.openstack.org/#/c/280385/
23:13 alee joined #puppet-openstack
23:19 rahulait joined #puppet-openstack
23:20 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: nova: specify glance url proto  https://review.openstack.org/283300
23:22 openstackgerrit Emilien Macchi proposed openstack/puppet-nova: init: specify glance url proto by default  https://review.openstack.org/283301
23:27 cdelatte joined #puppet-openstack
23:35 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: deploy Cinder and Nova with RBD backend  https://review.openstack.org/281624
23:46 openstackgerrit Matt Fischer proposed openstack/puppet-keystone: stop managing files that the package makes  https://review.openstack.org/283308
23:49 davideagle_ joined #puppet-openstack
23:51 rahulait joined #puppet-openstack
23:53 openstackgerrit Merged openstack/puppet-nova: rbd: make sure libvirt is run before get-or-set virsh secret  https://review.openstack.org/282044
23:56 openstackgerrit Merged openstack/puppet-keystone: Update default paste_config on Red Hat systems  https://review.openstack.org/280385

| Channels | #puppet-openstack index | Today | | Search | Google Search | Plain-Text | summary