Perl 6 - the future is here, just unevenly distributed

IRC log for #puppet-openstack, 2017-01-25

| Channels | #puppet-openstack index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:03 tdasilva joined #puppet-openstack
00:39 EmilienM pradk: you still around?
00:39 EmilienM I found a bug preventing puppet Ci to promote
00:39 EmilienM https://github.com/openstack/panko/commit/3538f46fa958376a0a65cbfa5dfc54500f252b5e
00:39 EmilienM http://paste.openstack.org/show/amTBxNGalBEwtFgvU798/
00:39 EmilienM I think we missed something in panko
00:41 EmilienM not sure it's this commit though
00:49 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: DNM: debug why promotion fails  https://review.openstack.org/424915
00:57 EmilienM so vinsh is doing ironic now
00:57 vinsh Planing on a customer beta offering of it in the next month.
00:58 EmilienM fancy words :D
00:58 vinsh Now, I just need to get it to work.
00:58 vinsh :-0
00:58 EmilienM use tripleo !
00:58 vinsh 0_o
00:58 vinsh i'm using puppet-ironic bro
00:58 vinsh all the cool kids do
00:59 EmilienM puppet-ironic is for skilled people
00:59 vinsh mmmhmm
00:59 EmilienM I hope you know what you're doing
00:59 EmilienM because this module is so powerful
00:59 EmilienM you know what's funny?
00:59 vinsh ???
00:59 vinsh tacos?
00:59 EmilienM I wrote its first version in a plane
00:59 vinsh NO WONDER
01:00 EmilienM https://github.com/openstack/puppet-ironic/commit/5071905110893e770e5991c8e7a0ed6cfec2e2bf
01:00 EmilienM Nov 25, 2013
01:00 EmilienM I was in a plane, and I didn't know what to do
01:00 vinsh so you thought "i'll write the ironic module"
01:01 EmilienM of course, nobody did before
01:19 ducttape_ joined #puppet-openstack
01:21 morazi joined #puppet-openstack
01:34 pradk EmilienM, hmm i guess we recently added the tempest plugin for panko.. the trace you pasted doesnt say anything about pako test.. is there more to the trace?
01:34 EmilienM pradk: I'm trying to reproduce it
01:34 EmilienM but my guess says it's panko
01:34 pradk could be
01:34 EmilienM pradk: in any case, we are missing the python-panko-tests
01:34 EmilienM that we have for other services
01:34 pradk tempest tests dint exists until very recently
01:34 EmilienM is there any WIP to build this package?
01:34 pradk yea we need to package those
01:34 pradk i'll look into it
01:35 EmilienM ok
01:35 mwhahaha pradk: http://logs.openstack.org/21/419121/8/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/e5e4ccf/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_00_01_11_000
01:36 pradk we do have tests subpackage hrm
01:36 mwhahaha looks like package problems with gnocchi on the upgrade again
01:37 pradk packages are fine.. its the repodata i think
01:37 mwhahaha boo
01:37 pradk mwhahaha, we seem to ahve some caching problem perhaps ?
01:37 mwhahaha sure it's not a sem-ver thing again?
01:37 pradk yum clean all before kicking off might help
01:37 mwhahaha we do that in the upgrade
01:37 pradk mwhahaha, we did bump the sem ver for gnocchi
01:38 pradk but not sure if the promotion happened
01:38 EmilienM no
01:38 EmilienM https://dashboards.rdoproject.org/rdo-dev
01:38 EmilienM we are very late
01:38 mwhahaha :( well at least it's not failing on cell v2 anymore :D
01:40 mwhahaha hmm maybe we do need a yum clean all cause i didn't hit that locally
01:40 mwhahaha also it didn't run cell v2 cause of package problems
01:42 pradk EmilienM, so we do have python-panko-tests in cbs
01:42 pradk i just checked our builds
01:43 pradk so that good now, we might have to update poi to enable panko and use these
01:47 EmilienM yeah
01:47 EmilienM nice
01:47 EmilienM ok let me do it
01:47 EmilienM it's in puppet tempest actually
01:49 EmilienM pradk: we miss that https://github.com/rdo-packages/aodh-distgit/blob/rpm-master/openstack-aodh.spec#L257-L260
01:49 EmilienM I'm doing it for panko
01:50 pradk EmilienM, k should i add the tempest change or are you?
01:50 EmilienM i'm
01:50 pradk ok
01:50 pradk in puppet-tempest i mean
01:50 EmilienM yeah
01:50 pradk kk
01:50 EmilienM I'll
01:52 pradk EmilienM, https://review.rdoproject.org/r/4494 thats for the egg
01:53 EmilienM pradk: you put aodh
01:53 EmilienM I'll abandon mine
01:53 pradk yea lets go with yours
01:53 EmilienM pradk: ah ok
01:53 EmilienM ok now doing tempest
01:54 EmilienM let me do it!
01:57 openstackgerrit Emilien Macchi proposed openstack/puppet-tempest: Add Panko support  https://review.openstack.org/424929
01:57 EmilienM pradk: ^
01:57 pradk cool
01:58 EmilienM I need to enable it in poi now
01:59 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: enable tempest plugin for Panko  https://review.openstack.org/424930
02:02 EmilienM damn I did it wrong
02:03 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: enable tempest plugin for Panko  https://review.openstack.org/424930
02:08 pradk afk for a bit
02:10 EmilienM mwhahaha: ubuntu jobs are back lol
02:10 ducttape_ joined #puppet-openstack
02:10 EmilienM WHAT DID YOU DO
02:10 EmilienM only scenario003 is failing now
02:11 mwhahaha designate
02:11 mwhahaha they fixed os-vif
02:11 EmilienM finally
02:11 mwhahaha they  missed the dep for nova-compute
02:11 EmilienM what to do with designate?
02:11 mwhahaha probably nothing, we don't run it on centos
02:11 mwhahaha cause you know, it's broken
02:12 mwhahaha going to look at it tomorrow, it's non-idempotent because of mdns
02:12 mwhahaha i thought we ran into that on centos but i don't remember completely
02:13 EmilienM mhh
02:13 EmilienM we'll run it again on centos when we have promotion
02:15 mwhahaha http://logs.openstack.org/48/422248/15/check/gate-puppet-openstack-integration-4-scenario003-tempest-ubuntu-xenial-nv/684b4df/logs/syslog.txt.gz#_Jan_24_23_48_19
02:15 mwhahaha looks like bad code or somethin
02:15 mwhahaha maybe i'll just disable it on ubuntu
02:17 openstackgerrit Alex Schultz proposed openstack/puppet-openstack-integration: Disable designate on Ubuntu  https://review.openstack.org/424936
02:18 EmilienM mwhahaha: approving
02:20 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack_extras: Bump default release to Ocata  https://review.openstack.org/424938
02:28 mwhahaha well upgrade seems to be going, hasn't failed yet
02:28 mwhahaha i'm not at home so i can't check the ipv6 host
02:35 mwhahaha boo failed
02:37 mwhahaha ok it's aodh now
02:37 mwhahaha when pradk comes back, http://logs.openstack.org/21/419121/9/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/7809c6e/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_02_28_32_000
02:43 pradk joined #puppet-openstack
02:46 mwhahaha pradk, http://logs.openstack.org/21/419121/9/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/7809c6e/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_02_28_32_000
02:48 ilbot3 joined #puppet-openstack
02:48 Topic for #puppet-openstack is now CI status: green - Puppet OpenStack modules http://docs.openstack.org/developer/puppet-openstack-guide/
02:50 pradk mwhahaha, seems like dbsync dint run
02:50 pradk i dint realize we were still loading it via ceilo db .. i'll work on a patch to change that now
02:59 openstackgerrit Merged openstack/puppet-cinder: Update scaleio cinder driver params  https://review.openstack.org/424333
03:23 nmathew joined #puppet-openstack
03:33 udesale joined #puppet-openstack
03:42 vinsh joined #puppet-openstack
04:17 skramaja joined #puppet-openstack
04:24 ducttape_ joined #puppet-openstack
05:17 udesale__ joined #puppet-openstack
05:19 udesale joined #puppet-openstack
05:46 ducttape_ joined #puppet-openstack
05:49 tlbr joined #puppet-openstack
05:51 dgurtner joined #puppet-openstack
05:51 dgurtner joined #puppet-openstack
05:53 PagliaccisCloud joined #puppet-openstack
06:05 zhongshengling joined #puppet-openstack
06:14 PagliaccisCloud joined #puppet-openstack
06:16 jaganathan joined #puppet-openstack
06:20 jpena|off joined #puppet-openstack
06:56 udesale__ joined #puppet-openstack
07:09 nmathew- joined #puppet-openstack
07:12 nmathew joined #puppet-openstack
07:17 ducttape_ joined #puppet-openstack
07:17 dgurtner joined #puppet-openstack
07:17 dgurtner joined #puppet-openstack
07:33 nmathew- joined #puppet-openstack
07:34 tesseract joined #puppet-openstack
07:50 yprokule joined #puppet-openstack
08:18 rasca joined #puppet-openstack
08:19 shardy joined #puppet-openstack
08:23 openstackgerrit Anton Chevychalov proposed openstack/puppet-barbican: Added retries for db_sync  https://review.openstack.org/407072
08:29 dgurtner joined #puppet-openstack
08:29 dgurtner joined #puppet-openstack
08:48 ducttape_ joined #puppet-openstack
08:55 jpich joined #puppet-openstack
09:06 tlbr joined #puppet-openstack
09:25 openstackgerrit Mykyta Karpin proposed openstack/puppet-ironic: Add ironic::drivers::interfaces class  https://review.openstack.org/329775
09:27 hjensas joined #puppet-openstack
09:37 openstackgerrit Chandan Kumar proposed openstack/puppet-tempest: Added manifests to install tempest from rpm package  https://review.openstack.org/425085
09:47 derekh joined #puppet-openstack
09:49 openstackgerrit Ricardo Noriega proposed openstack/puppet-neutron: Add support for BGPVPN plugin  https://review.openstack.org/422051
09:57 salmankhan joined #puppet-openstack
09:57 morazi joined #puppet-openstack
10:18 skramaja joined #puppet-openstack
10:19 nmathew joined #puppet-openstack
10:24 nmathew- joined #puppet-openstack
10:38 tlbr joined #puppet-openstack
10:40 gfidente joined #puppet-openstack
10:40 gfidente joined #puppet-openstack
10:47 openstackgerrit joined #puppet-openstack
10:47 openstackgerrit Chandan Kumar proposed openstack/puppet-tempest: Added manifests to install tempest from rpm package  https://review.openstack.org/425085
10:59 tlbr joined #puppet-openstack
11:23 dgurtner joined #puppet-openstack
11:23 dgurtner joined #puppet-openstack
11:28 chem joined #puppet-openstack
11:33 paramite_ joined #puppet-openstack
11:33 paramite joined #puppet-openstack
11:37 hjensas joined #puppet-openstack
11:44 chem joined #puppet-openstack
11:49 ducttape_ joined #puppet-openstack
12:05 owalsh-afk joined #puppet-openstack
12:05 EmilienM hello
12:10 cdelatte joined #puppet-openstack
12:20 dgurtner joined #puppet-openstack
12:33 rmart04 joined #puppet-openstack
12:40 pradk joined #puppet-openstack
12:48 openstackstatus NOTICE: Gerrit is going to be restarted due to slow performance
12:48 nmathew- joined #puppet-openstack
12:48 ducttape_ joined #puppet-openstack
12:50 mkarpin Hi EmilienM, maybe you heard something about these tripleo ci failures - http://logs.openstack.org/45/422545/1/check/gate-tripleo-ci-centos-7-nonha-multinode/a5f33c1/console.html#_2017-01-25_09_09_43_466100
12:50 mkarpin looks like they happen permanently
12:50 EmilienM mkarpin: on stable/newton?
12:50 mkarpin yes
12:50 EmilienM ok
12:51 EmilienM let me check
12:51 openstackstatus NOTICE: Gerrit has been successfully restarted
12:51 EmilienM oh wait, right now, tripleo ci jobs on newton are red
12:51 EmilienM I'm working on it and they should be green in a very few
12:51 EmilienM the patch is in gate
12:51 mkarpin EmilienM thank you
12:54 openstackgerrit Chandan Kumar proposed openstack/puppet-tempest: Added manifests to install tempest from rpm package  https://review.openstack.org/425085
12:55 chandankumar EmilienM: I have added the patch to use tempest rpm in puppet-tempest
12:55 chandankumar https://review.openstack.org/#/c/425085/
12:55 chandankumar please have a look when you are free,
12:58 EmilienM chandankumar: ok, thx
13:01 EmilienM chandankumar: done
13:04 iurygregory joined #puppet-openstack
13:06 ansmith joined #puppet-openstack
13:08 iurygregory good morning
13:12 PagliaccisCloud joined #puppet-openstack
13:24 dgurtner joined #puppet-openstack
13:24 dgurtner joined #puppet-openstack
13:33 udesale joined #puppet-openstack
13:40 fultonj joined #puppet-openstack
13:41 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Update to reduce puppet errors.  https://review.openstack.org/424869
13:56 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: DNM: debug why promotion fails  https://review.openstack.org/424915
14:06 ducttape_ joined #puppet-openstack
14:20 ansmith joined #puppet-openstack
14:21 dprince joined #puppet-openstack
14:28 jperry joined #puppet-openstack
14:37 PagliaccisCloud joined #puppet-openstack
14:45 agrebennikov__ joined #puppet-openstack
15:00 bklei joined #puppet-openstack
15:00 udesale joined #puppet-openstack
15:08 ducttape_ joined #puppet-openstack
15:09 PagliaccisCloud joined #puppet-openstack
15:10 salmankhan joined #puppet-openstack
15:10 jaosorior joined #puppet-openstack
15:17 dfisher joined #puppet-openstack
15:27 rajinir joined #puppet-openstack
15:30 openstackgerrit Merged openstack/puppet-monasca: Add ability to specify whitelist of metrics to retain in admin project  https://review.openstack.org/424864
15:30 PagliaccisCloud joined #puppet-openstack
15:31 vinsh joined #puppet-openstack
15:31 openstackgerrit Giulio Fidente proposed openstack/puppet-ceph: Ensure the CephX client keys are provisioned by the mirror profile  https://review.openstack.org/425237
15:32 markvoelker joined #puppet-openstack
15:32 acormier joined #puppet-openstack
15:36 pradk joined #puppet-openstack
15:36 PagliaccisCloud joined #puppet-openstack
15:42 pradk EmilienM, mwhahaha, need your input on this https://review.openstack.org/#/c/424127/ . So ideally starting ocata we dont want to skip gnocchi resource types when ceilo upgrade runs. But if we dont pass this flag, puppet ordering wont work as it expects the keystone to be up and credentials to be set.
15:42 pradk the change i made above removes the default from puppet-ceilo
15:43 pradk but for it to continue working we have to pass in extra-param to db::sync class
15:43 pradk which means we ahve to update POI, tripleo and whatever else is using puppet-ceilo as is today
15:44 pradk fixing the auth issue seems to be a complex ordering problem, i'm not sure if its wise to do it in ocata
15:44 pradk the drawback of not doing is we have to rerun ceilo-upgrade again post converge so the gnocchi resource types are there
15:44 pradk so wdyt?
15:45 hjensas joined #puppet-openstack
15:45 hjensas joined #puppet-openstack
15:45 pradk if either of you have ideas on fixing the ordering problem, then thats the best course imo
15:46 pradk that way we remove this option completely and let ceilo-upgrade connect to gnocchi and create resources as expected
15:46 PagliaccisCloud joined #puppet-openstack
15:46 mwhahaha This kind of service cross dependency is bad. I'll take a look later today
15:47 pradk yea i agree, but unfortunately thats the card we're dealt with here
15:50 PagliaccisCloud joined #puppet-openstack
15:52 owalsh_ joined #puppet-openstack
15:57 xarses joined #puppet-openstack
15:57 mwhahaha pradk: so what's the dependency order? gnocchi just has to be up before ceilometer?
15:57 mwhahaha then ceilometer has to have the auth configuration to talk to gnocchi for the upgrade to work?
15:58 _ducttape_ joined #puppet-openstack
15:59 pradk mwhahaha, remember the auth issue where agent::auth was not getting called as part of the config::end
15:59 dmsimard mwhahaha, EmilienM: I guess the stable/ocata branch of p-o-i only comes after the modules have been branched and that's fairly late in the cycle, right ?
16:00 mwhahaha dmsimard: correct
16:00 bklei_ joined #puppet-openstack
16:00 mwhahaha pradk: yea i need to look more into that because i'm not sure what was happening. i'm just trying to understand what the overall service flow needs to be so we can properly define it in puppet
16:01 dgurtner joined #puppet-openstack
16:16 owalsh joined #puppet-openstack
16:17 markvoelker joined #puppet-openstack
16:18 markvoelker_ joined #puppet-openstack
16:19 dgurtner joined #puppet-openstack
16:19 dgurtner joined #puppet-openstack
16:23 ducttape_ joined #puppet-openstack
16:38 openstackgerrit Chandan Kumar proposed openstack/puppet-tempest: Added manifests to install tempest from rpm package  https://review.openstack.org/425085
16:38 openstackgerrit Merged openstack/puppet-openstack-integration: Disable designate on Ubuntu  https://review.openstack.org/424936
16:42 openstackgerrit Pavel Gluschak (scsnow) proposed openstack/puppet-cinder: Added support of vstorage cinder backend  https://review.openstack.org/419012
16:48 owalsh_ joined #puppet-openstack
16:51 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack_extras: Bump default release to Ocata  https://review.openstack.org/424938
16:51 PagliaccisCloud joined #puppet-openstack
16:51 owalsh_ joined #puppet-openstack
16:58 acormier_ joined #puppet-openstack
16:59 markvoelker joined #puppet-openstack
17:07 owalsh_ joined #puppet-openstack
17:08 openstackgerrit Rajini Ram proposed openstack/puppet-cinder: Update scaleio cinder driver params  https://review.openstack.org/425289
17:08 owalsh_ joined #puppet-openstack
17:09 dgurtner joined #puppet-openstack
17:09 dgurtner joined #puppet-openstack
17:15 pradk mwhahaha, yea so the overall service flow would expect keystone and gnocchi to be up and reachable.. so if either is down upgrade will fail for ceilo.
17:15 pradk which will complicate things quite a bit
17:16 pradk if we pass the skip-gnocchi flag all is well as it just does local db upgrade and finishes
17:16 pradk but caveat is that we have to re run afetr the cloud is up to get the gnocchi resource types
17:16 pradk so yea thats the gist
17:17 social joined #puppet-openstack
17:19 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: DNM: debug why promotion fails  https://review.openstack.org/424915
17:19 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: scenario001: enable tempest plugin for Panko  https://review.openstack.org/424930
17:19 openstackgerrit Emilien Macchi proposed openstack/puppet-openstack-integration: DNM: debug why promotion fails  https://review.openstack.org/424915
17:27 social joined #puppet-openstack
17:32 jaosorior joined #puppet-openstack
18:00 ansmith joined #puppet-openstack
18:08 owalsh-afk joined #puppet-openstack
18:26 vinsh dfisher: This busuba I brought back is pretty legit :)
18:26 * dfisher crosses arms
18:26 dfisher glad you enjoyed it :)
18:33 PagliaccisCloud joined #puppet-openstack
18:41 dfisher vinsh: what did you order?
18:41 dprince joined #puppet-openstack
18:42 vinsh dfisher: Pad prick Khing - medium spicy
18:42 vinsh and some green curry for the miss
18:43 dfisher good work.
19:05 PagliaccisCloud joined #puppet-openstack
19:13 hecliunyx joined #puppet-openstack
19:32 openstackgerrit Keith Schincke proposed openstack/puppet-ceph: Update to reduce puppet errors.  https://review.openstack.org/424869
19:49 dprince joined #puppet-openstack
20:09 PagliaccisCloud joined #puppet-openstack
20:09 hecliunyx joined #puppet-openstack
20:10 openstackgerrit Alex Schultz proposed openstack/puppet-openstack-integration: Revert "Disable designate on Ubuntu"  https://review.openstack.org/425380
20:12 jaosorior joined #puppet-openstack
20:14 openstackgerrit Alex Schultz proposed openstack/puppet-openstack-integration: Update ubuntu excludes for ocata-m2  https://review.openstack.org/422766
20:24 jaosorior joined #puppet-openstack
20:31 salmankhan joined #puppet-openstack
20:43 mwhahaha looks like https://review.openstack.org/#/c/422248/ and https://review.openstack.org/#/c/424329/ are ready
20:46 openstackgerrit Merged openstack/puppet-tempest: Add Panko support  https://review.openstack.org/424929
20:48 dprince joined #puppet-openstack
20:49 EmilienM so 2 updates
20:49 EmilienM http://logs.openstack.org/15/424915/4/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/34adf6b/console.html#_2017-01-25_19_09_35_114447
20:49 EmilienM we have panko tempest plugin, it works
20:49 EmilienM so we can land https://review.openstack.org/#/c/424930/
20:50 EmilienM second update, sounds like puppet CI promotion is blocked on 2 tempest tests for nova
20:50 EmilienM http://logs.openstack.org/15/424915/4/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/34adf6b/console.html#_2017-01-25_18_51_33_606683
20:50 openstackgerrit Merged openstack/puppet-cinder: Fix typo in README.md  https://review.openstack.org/424392
20:50 EmilienM good news, it's consistent across scenarios
20:50 mwhahaha k
20:50 ansmith joined #puppet-openstack
20:51 PagliaccisCloud joined #puppet-openstack
20:54 EmilienM iurygregory: can you reveiw https://review.openstack.org/#/c/422248/ please?
20:55 EmilienM iurygregory: same for https://review.openstack.org/#/c/424329/
20:55 EmilienM dprince: ^ if you around, we need your help
20:56 dprince EmilienM: looking
20:56 EmilienM thx
20:59 dprince EmilienM: seems like its about time to re-write Nova again from scratch
21:00 dprince EmilienM: a bit disappointed with much of the recent complexity around deployment and configuration in the project. Adding complexity for features that we really need? I dunno
21:00 openstackgerrit Alex Schultz proposed openstack/puppet-openstack-integration: Run nova cell v2 setup  https://review.openstack.org/425412
21:00 EmilienM dprince: we know all of this :(
21:01 PagliaccisCloud joined #puppet-openstack
21:01 EmilienM dprince: mwhahaha and owalsh have been burning on this thing for weeks I think
21:01 dprince EmilienM: right, but does Nova?
21:02 owalsh EmilienM: well, mwhahaha has done the vast majority of the work
21:02 mwhahaha no because of -^
21:02 mwhahaha we've voiced our issues since December when this first popped up, not sure if anyone took it to heart
21:03 dprince owalsh, mwhahaha: we need to get this right for containers too. See here https://review.openstack.org/#/c/420921/9/docker/services/nova-api.yaml
21:03 EmilienM dprince: let us promote first :-) the last 7 days have been terrible
21:04 dprince EmilienM: I wasn't suggesting we block for containers, Just wanted to mention it
21:04 mwhahaha dprince: yea it's been a learning curve on what setting up cells means
21:04 mwhahaha dprince: https://review.openstack.org/#/c/405241/15/puppet/services/nova-api.yaml@187 is basically what we needed
21:05 shardy_afk joined #puppet-openstack
21:05 EmilienM dprince: I think container work can beneficiate from this work for free
21:05 dprince EmilienM: free sounds good to me :)
21:05 mwhahaha free-ish :D
21:06 owalsh we don't care about Newton->Ocata upgrades for docker I guess so it's not so bad
21:06 dprince EmilienM: _+A on the patch. sadness on the complexity of all this but whatever I guess
21:08 EmilienM dprince: thanks man
21:09 dprince EmilienM, mwhahaha: oh hey. I blogged about this one. You might like it https://dprince.github.io/docker-puppet.html
21:09 dprince owalsh, mwhahaha: and nice work on the puppet-nova stuff BTW
21:10 dprince appreciate you all helping unblock things
21:10 EmilienM dprince: really cool
21:10 mwhahaha grrr so my local undercloud upgrade worked by the CI one failed
21:10 * mwhahaha goes looking
21:10 * mwhahaha also flips tables
21:10 dprince owalsh: late for you, I hope you are at least drinking beer now ;)
21:11 mwhahaha http://logs.openstack.org/21/419121/10/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/89f2941/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_20_37_48_000
21:11 mwhahaha at this point, hard liquor is the only acceptable thing :D
21:11 EmilienM lol
21:11 EmilienM Gin tonics!
21:11 owalsh dprince: not yet... but I'm tempted to get some
21:12 dprince EmilienM: save those gin tonics for the 'Cohiba Club Conti' man
21:12 EmilienM dprince: I miss this bar :(
21:12 EmilienM every night I try to reproduce their Gin Tonic recipe but I fail
21:12 mwhahaha owalsh: what happens in the gate if we don't actually have any hosts
21:12 dprince EmilienM: yes, Ludovico was my friend
21:13 owalsh mwhahaha: api db sync will fail until the nova patch lands
21:14 mwhahaha owalsh: hrm ok wonder why it worked locally but not in CI
21:16 owalsh mwhahaha: could be a timing issue, hosts will need to register with the placement api AFAIK
21:16 mwhahaha well the services won't be upa t that point
21:17 * owalsh flips table
21:17 owalsh mwhahaha: when the api db sync doesn't assert on this it should succeed... but...
21:17 mwhahaha hmm somethings weird, i'm not seeing the exec
21:18 mwhahaha EmilienM: if you notify a class, shouldn't the exist within the class be triggered?
21:19 EmilienM mwhahaha: "If a class or defined resource gets a refresh event, every resource it contains will also get a refresh event."
21:20 mwhahaha i don't see the exec actually running in the logs :/
21:20 EmilienM are they in refreshonly?
21:20 mwhahaha https://www.irccloud.com/pastebin/sJWbVQDG/
21:20 mwhahaha err
21:20 mwhahaha yea they are
21:20 EmilienM weird
21:20 mwhahaha https://review.openstack.org/#/c/424329/9/manifests/cell_v2/map_cell_and_hosts.pp
21:21 mwhahaha well time to try random anchors
21:21 EmilienM do you have the full catalog?
21:22 mwhahaha yea
21:23 mwhahaha it was run
21:23 mwhahaha the logs just don't show it since the class got the refresh i guess
21:24 mwhahaha and we don't run debug
21:26 owalsh mwhahaha: just check with dansmith - placement api doesn't matter. Phew, I was worried for a minute
21:26 xb_ joined #puppet-openstack
21:27 owalsh s/check/checked/
21:27 EmilienM owalsh: right, it will matter in Pike
21:27 EmilienM that's why I pushed to have it in Ocata
21:27 EmilienM and we now have it 100%
21:27 EmilienM both undercloud & overcloud
21:28 owalsh EmilienM: I was worried for a moment that the cell_v2 migration required the hosts to report the placement api before running the api db sync
21:28 mwhahaha shouldn't
21:28 mwhahaha but anyway it's hard to know what's going on, locally it was fine. ci not so much
21:29 mwhahaha so according to this, http://logs.openstack.org/21/419121/10/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/89f2941/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_20_36_15_000
21:29 mwhahaha the map_cell_and_hosts and map_isntances ran before the api db sync
21:29 mwhahaha which pukes because no host mappings were found
21:30 mwhahaha owalsh: http://logs.openstack.org/21/419121/10/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/89f2941/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-25_20_35_12_000 there's teh cell0 and default cell create, are we missing something else that needs to run before api sync?
21:30 mwhahaha owalsh: EmilienM could it be repos i used in my local testing versus gate?
21:30 owalsh mwhahaha: map_cell_and_hosts ran yea?
21:31 mwhahaha aledgedly, yes
21:31 mwhahaha these were the repos i used in my testing and i hand rolled my nova/instack puppet changes in
21:31 mwhahaha http://paste.openstack.org/show/596512/
21:32 EmilienM mwhahaha: packages?
21:33 owalsh mwhahaha: not missing anything AFAICT
21:34 mwhahaha http://paste.openstack.org/show/596513/
21:35 * owalsh-brb brb, 10-15mins
21:39 openstackgerrit Alex Schultz proposed openstack/puppet-openstack-integration: Update ubuntu excludes for ocata-m2  https://review.openstack.org/422766
21:40 jidar joined #puppet-openstack
22:04 owalsh mwhahaha: are the ironic nodes registered before the upgrade in that job? maybe I'm missing something but I don't see it in the logs
22:05 mwhahaha not necessarily
22:05 mwhahaha i don't know how the upgrade works
22:05 mwhahaha it might not do that
22:05 mwhahaha so it might go from 10->11 w/o doing that
22:05 owalsh ok, that would cause the api db sync to fail
22:06 mwhahaha well that's problemmatic, shouldn't that happen as part of the install?
22:06 owalsh tripleo.sh can do it... I just don't see it happening
22:07 owalsh when https://review.openstack.org/424243 lands we can upgrade with no computes
22:07 mwhahaha well then i wash my hands of it all then :D
22:07 mwhahaha though it seems like perhaps we should re-evaluate what our upgrade job does
22:08 mwhahaha it seems like we probably should have some computes before we upgrade
22:08 mwhahaha but that's probably a topic for #tripleo
22:09 _ducttape_ joined #puppet-openstack
22:19 owalsh mwhahaha: yea, no nodes for undercloud jobs AFAICT https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L258
22:19 mwhahaha well that'd be a problem i guess
22:19 mwhahaha that would explain why it worked locally
22:29 PagliaccisCloud joined #puppet-openstack
22:29 ducttape_ joined #puppet-openstack
22:46 owalsh_ joined #puppet-openstack
22:53 _ducttape_ joined #puppet-openstack
23:18 jperry joined #puppet-openstack
23:19 hecliunyx joined #puppet-openstack
23:23 PagliaccisCloud joined #puppet-openstack
23:25 ducttape_ joined #puppet-openstack
23:50 openstackgerrit Merged openstack/puppet-openstack-integration: scenario001: enable tempest plugin for Panko  https://review.openstack.org/424930

| Channels | #puppet-openstack index | Today | | Search | Google Search | Plain-Text | summary