Perl 6 - the future is here, just unevenly distributed

IRC log for #fuel-dev, 2014-05-22

| Channels | #fuel-dev index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:41 rmoe joined #fuel-dev
00:48 EeeBotu New bug #1321963 in fuel: "[QA] Run all system tests with changed default tenant/user/pass" [High, New] https://bugs.launchpad.net/bugs/1321963
01:06 xarses joined #fuel-dev
01:24 teran joined #fuel-dev
01:50 IlyaE joined #fuel-dev
01:53 IlyaE_ joined #fuel-dev
02:17 teran joined #fuel-dev
02:56 sanek12 joined #fuel-dev
02:57 rmoe_ joined #fuel-dev
02:58 Bomfunk_ joined #fuel-dev
02:58 christop1eraedo joined #fuel-dev
03:00 a_teem joined #fuel-dev
03:05 ykotko joined #fuel-dev
03:07 crshman_ joined #fuel-dev
03:07 a_teem joined #fuel-dev
03:18 teran joined #fuel-dev
04:19 teran joined #fuel-dev
04:56 dshulyak_ joined #fuel-dev
05:04 Ch00k joined #fuel-dev
05:18 IlyaE joined #fuel-dev
05:22 vkozhukalov joined #fuel-dev
05:36 salmon_ joined #fuel-dev
05:52 vkozhukalov joined #fuel-dev
06:21 teran joined #fuel-dev
06:23 teran_ joined #fuel-dev
06:25 sambork joined #fuel-dev
06:47 al_ex joined #fuel-dev
06:54 Ch00k joined #fuel-dev
07:04 artem_panchenko joined #fuel-dev
07:13 teran joined #fuel-dev
07:26 bogdando mihgen, no issues were found with new  amqp and kombu
07:26 mihgen bogdando: excellent
07:26 mihgen did you check nailgun too?
07:27 bogdando mihgen, I will update the rmq ha failover test I was using to check this as well
07:27 bogdando mihgen, no, I don't have a test case for nailgun
07:27 mihgen I believe Ryan verified DEB packages at least, so for the priority I would ask you to try to run nailgun with it
07:28 mihgen and if it is Ok, then we can merge / update mirror, and test HA cases, better on CentOS, after (as ubuntu was chosen by Ryan)
07:34 asledzinskiy joined #fuel-dev
07:57 EeeBotu New bug #1322073 in fuel: "Need to redefine network ext_net_data property" [Wishlist, New] https://bugs.launchpad.net/bugs/1322073
07:57 EeeBotu New bug #1322069 in fuel: "[devops] Target bugs with tag "backports-4.1.1" to 4.1.1 milestone" [Critical, New] https://bugs.launchpad.net/bugs/1322069
08:07 sambork joined #fuel-dev
08:09 akasatkin mihgen: https://bugs.launchpad.net/fuel/+bug/1320123 reproduced. Try ssh to 172.18.194.24:5577
08:14 bogdando at the https://etherpad.openstack.org/p/fuel-ha-testing-methods there is now a description for a single test case - rmq failover for compute
08:14 bogdando feel free to comment
08:14 bogdando I followed this one, while were testing a) not patched TCPKA, b) patched ones, c) updated kombu and amqp
08:16 bogdando the only thing it is not still so clear, the one we've discussed y-day at the meeting - should we, and how exactly, check for any hanged amqp messages in flows
08:17 bogdando I consider we should check only 1) AMQP reconnection attemps, 2) queue size, 3) zombie connections, 4) spawn results ...
08:21 bogdando sed s/consider/believe :)
08:23 vkozhukalov joined #fuel-dev
08:36 mihgen akasatkin: interesting, will try to
08:38 mihgen holser: looks like xenolog requires to fix https://review.openstack.org/#/c/94621/ ..
08:39 akasatkin joined #fuel-dev
08:39 mihgen bogdando: did you close bug with kombu update or where is it now?
08:39 holser mihgen, it requires refactoring, I am with you to check if == nil or whatsoever, but need to talk to xenolog
08:40 holser mihgen, though it works and can be merged
08:40 mihgen holser: or. I believe you would simply need to use "rescue" instead of "||"
08:40 holser mihgen, yeah
08:43 mihgen bogdando: before packages appear in our repos, we don't need to close a bug. Thanks for testing!  r0mikiam will sync mirrors
08:43 r0mikiam bogdando: please review request with packages (+1)
08:57 brain461 joined #fuel-dev
08:58 EeeBotu New bug #1322102 in fuel: "[OSTF] Sometimes Health Check returns false/positive error while checking connectivity via floating IP" [Undecided, New] https://bugs.launchpad.net/bugs/1322102
09:01 teran joined #fuel-dev
09:09 EeeBotu New bug #1322107 in fuel: "Inspect delete() usage precisely" [Low, Triaged] https://bugs.launchpad.net/bugs/1322107
09:11 bogdando mihgen, I close it by mistake, sorry
09:13 bogdando r0mikiam, done
09:17 ikalnitsky joined #fuel-dev
09:18 r0mikiam bogdando: https://gerrit.mirantis.com/#/c/15760/
09:20 mihgen bogdando: did you have a chance to verify that nailgun is ok with it?
09:20 mihgen r0mikiam: don't forget about two pull requests in fuel-web about it
09:21 r0mikiam mihgen: after sync mirrors
09:41 tnurlygayanov Hi there!
09:42 tnurlygayanov about the bug https://bugs.launchpad.net/fuel/+bug/1320245
09:42 tnurlygayanov so,  Alexander, this is not Sahara Bug with 'Check stack autoscaling' - this is Heat OSTF test. Please, upload the F17 image for OSTf Heat tests:
09:42 tnurlygayanov http://fedorapeople.org/groups/heat/prebuilt-jeos-images/F17-x86_64-cfntools.qcow2
09:42 tnurlygayanov looks like this bug was successfully fixed, status changed to Fix Commited.
09:45 e0ne joined #fuel-dev
09:45 mihgen akislitsky: looks like tnurlygayanov talks to you.. ^^
09:58 teran joined #fuel-dev
10:00 EeeBotu New bug #1322114 in fuel: "[devops] Document and train US team for system tests run recovery" [High, New] https://bugs.launchpad.net/bugs/1322114
10:00 EeeBotu New bug #1322110 in fuel: "Sahara tests to create, list, start, checks and delete cluster failed" [High, Confirmed] https://bugs.launchpad.net/bugs/1322110
10:02 bookwar left #fuel-dev
10:08 akislitsky mihgen, thanks, we had conversation in email
10:09 ogelbukh hi guys
10:09 ogelbukh i have a small question
10:10 ogelbukh is there a python-fuelclient lib of a sort that talks to fuel api ?
10:16 e0ne_ joined #fuel-dev
10:23 evgeniyl ogelbukh: maybe https://github.com/stackforge/fuel-web/tree/master/fuelclient will be useful for you
10:30 ogelbukh evgeniyl: thanks, looks like what i'm looking for
11:00 mihgen holser: xenolog folks so what's up with https://review.openstack.org/#/c/94621/3 ?
11:00 mihgen it is simple one to fix and merge already..
11:01 holser mihgen, I am waiting for merge
11:01 holser I am working on https://review.openstack.org/#/c/93883/14
11:09 EeeBotu New bug #1322127 in fuel: "Parameter notification_driver=cinder.openstack.common.notifier.rpc_notifier doesn't present on each node" [High, In Progress] https://bugs.launchpad.net/bugs/1322127
11:10 Ch00k joined #fuel-dev
11:13 e0ne joined #fuel-dev
11:23 tnurlygayanov https://bugs.launchpad.net/fuel/+bug/1320181 assigned to Fuel OSTF team, looks like this problem not in Murano or Sahara. This is traceback from Nova API
11:24 r0mikiam https://bugs.launchpad.net/fuel/+bug/1321451 on fuel mirror
11:33 Ch00k joined #fuel-dev
11:39 mihgen holser: what merge? it's -1ed with comments: https://review.openstack.org/#/c/94621/3
11:41 mihgen r0mikiam: what about https://bugs.launchpad.net/fuel/+bug/1317548 ?
11:42 r0mikiam mihgen: Fix Committed
11:43 Ch00k joined #fuel-dev
11:53 akasatkin joined #fuel-dev
11:54 salmon_ r0mikiam: is this fix available in build #217 ?
11:55 r0mikiam salmon_: yes
11:56 e0ne joined #fuel-dev
12:13 ikalnitsky_ joined #fuel-dev
12:15 ikalnitsky joined #fuel-dev
12:19 tnurlygayanov fix for Fuel system tests: https://review.openstack.org/#/c/94831/
12:21 mihgen holser: xenolog: aglarendil  - I've updated https://review.openstack.org/#/c/94621/4
12:21 holser mihgen, thanks
13:08 mihgen vkramskikh: any movements in https://bugs.launchpad.net/fuel/+bug/1311265 direction?
13:10 vkramskikh i did some research some time ago, nothing useful, can do it deeper tomorrow
13:21 EeeBotu New bug #1322176 in fuel: "Need to enable platfrom heat test in ha mode" [Medium, New] https://bugs.launchpad.net/bugs/1322176
13:21 EeeBotu New bug #1322175 in fuel: "Controller and compute went offline after provisioning" [High, New] https://bugs.launchpad.net/bugs/1322175
13:33 mihgen Folks looks like we have are really one step away from HCF, and bugs are addressed. We just need to do code review / testing of them: https://review.openstack.org/#/c/94820/ ,https://review.openstack.org/#/c/94853/2
13:33 mihgen waiting for Fuel CI here: https://review.openstack.org/#/c/94819/
13:34 mihgen mattymo: are you around? can you test https://review.openstack.org/#/c/94853/, and xenolog will just skim through
13:35 mihgen Shuffle AMQP nodes for all OpenStack services https://review.openstack.org/#/c/93883/ doesn't seem to be viable. who is working on it?
13:35 mihgen holser: ? did you rebase on master that shuffle?
13:36 holser mihgen: I did
13:36 holser we need to accept initial patch without rotating …
13:36 mihgen which one?
13:37 holser patchset 1
13:39 holser mihgen, fqdn_rotate doesn’t do a right thing, it doesn’t rotate array
13:40 mattymo mihgen, 94853 starting iso now and will test
13:42 mihgen holser: ok, so you just uploaded 1st patchset now?
13:42 mihgen mattymo: ok, cool, thanks
13:42 holser not yet
13:53 teran joined #fuel-dev
13:58 teran_ joined #fuel-dev
14:08 e0ne_ joined #fuel-dev
14:08 e0ne__ joined #fuel-dev
14:16 xdeller joined #fuel-dev
14:38 mihgen dpyzhov: bogdando aglarendil https://review.openstack.org/#/c/94851/ - ready to merge?
14:39 tnurlygayanov hm...
14:39 aglarendil mihgen: it should be tested
14:39 aglarendil mihgen: by someone other than the developer
14:39 tnurlygayanov probably you know about the bug with Neutron
14:39 tnurlygayanov ...  MultipleAgentFoundByTypeHost: Multiple agents with agent_type=Open vSwitch agent and host=node-16.domain.tld found
14:40 dpyzhov mihgen: let me test it
14:40 tnurlygayanov what is incorrect with my OpenStack installation? I have many tracebacks and this errors message in my /var/log/neutron/neutron.conf
14:40 mihgen dpyzhov: thanks, looking forward for results
14:46 EeeBotu New bug #1322208 in fuel: "Redundant interfaces in controller node after deployment FlatDHCP HA" [High, Confirmed] https://bugs.launchpad.net/bugs/1322208
15:01 IlyaE joined #fuel-dev
15:02 tnurlygayanov https://bugs.launchpad.net/fuel/+bug/1322228
15:14 tnurlygayanov Who can take this bug? I can provide the environment with this problem.
15:19 mihgen tnurlygayanov: does it affect 4.1 series only?
15:20 mihgen havana actually?
15:20 tnurlygayanov I can not test it with 5.x
15:20 tnurlygayanov yes, I found this on 4.1a, Havanna
15:20 tnurlygayanov looks like it can be reproduced on 5.x too
15:21 tnurlygayanov so, on small cluster it is not reproduced
15:22 tnurlygayanov but when we have cluster with 50 baremetal servers - Neutron works really strange.
15:23 mihgen tnurlygayanov: xenolog looks at it
15:23 tnurlygayanov ok, cool
15:23 tnurlygayanov xenolog, I can provide my cloud for you
15:25 xenolog please provide credentials me by skype
15:25 xenolog
15:26 pbrooko joined #fuel-dev
15:27 tnurlygayanov xenolog, add me to the contack list, my skype: xwizard707
15:28 tnurlygayanov *contact
15:34 EeeBotu New bug #1322231 in fuel: "ERR: mysqladmin -u root  password QdsXGRhS returned 1 instead of one of [0]" [Medium, New] https://bugs.launchpad.net/bugs/1322231
15:34 EeeBotu New bug #1322230 in fuel: "ERR: ceph-deploy osd activate node-11:/dev/sdc4 returned 1 instead of one of [0]" [Medium, New] https://bugs.launchpad.net/bugs/1322230
15:34 EeeBotu New bug #1322228 in fuel: "MultipleAgentFoundByTypeHost: Multiple agents with agent_type=Open vSwitch agent" [High, Confirmed] https://bugs.launchpad.net/bugs/1322228
15:34 EeeBotu New bug #1322221 in fuel: "Neutron error: unsupported operand type(s) for +: 'NoneType' and 'str'" [Medium, New] https://bugs.launchpad.net/bugs/1322221
15:34 mihgen aglarendil: https://review.openstack.org/#/c/94895/
15:35 mihgen dilyin: https://review.openstack.org/#/c/94895/ - please review
15:38 mihgen folks let's merge https://review.openstack.org/#/c/94895/ otherwise user will see interfaces on interfaces page like "eth0-hapr", which is virtual interface
15:38 teran joined #fuel-dev
15:49 rmoe joined #fuel-dev
16:02 artem_panchenko joined #fuel-dev
16:05 holser left #fuel-dev
16:08 holser joined #fuel-dev
16:10 pbrooko joined #fuel-dev
16:14 Tatyanka_Leontov left #fuel-dev
16:15 jobewan joined #fuel-dev
16:23 mihgen mattymo: aglarendil dpyzhov https://review.openstack.org/#/c/94851/
16:23 mihgen please review
16:24 mattymo mihgen, is there an iso?
16:24 mattymo or bogdando ?
16:25 mihgen mattymo: nope. I tested it locally on my bootstrap
16:25 mihgen you can come over to my desk and see how it works
16:25 mattymo actually there is one from dpyzhov on patchset 2
16:26 mattymo tiny tiny changes so I'll use it
16:32 mihgen mattymo: so...
16:32 mihgen I still wait for your pluses guys
16:33 mihgen we are ready for HCF
16:34 mihgen only this one is left.  https://review.openstack.org/#/c/93883/ unfortunately has -1 from aglarendil , it doesn't go in yet. It may be an exception though ...
16:35 EeeBotu New bug #1322259 in fuel: "Openstack cluster do not work after failover  of  primary controller" [High, New] https://bugs.launchpad.net/bugs/1322259
16:37 angdraug joined #fuel-dev
16:39 angdraug mihgen: is https://review.openstack.org/94851 the last bit we need to merge before we can build an RC?
16:40 angdraug mihgen: oh wait, we need this too: https://review.openstack.org/93883
16:41 dshulyak_ joined #fuel-dev
16:45 e0ne joined #fuel-dev
16:51 mihgen angdraug: yep. take a look at log of this chat.
16:51 mihgen angdraug: mattymo is doing final verification for bootstrap logrotate
16:52 mattymo really serious final verification :)
16:52 mihgen angdraug: shuffling amqp looks to be risky at the moment, and I consider it as exceptional thing that you can merge to master after testing today
16:53 mihgen and then we can back port it to stable/5.0 if everything is fine
16:54 mihgen mattymo: angdraug if you guys +1 this https://review.openstack.org/#/c/94890/ it would be great
16:54 mihgen I don't want to call astute as orchestrator anymore
16:54 mihgen because it is not orchestrator anymore actually, it is worker
16:54 mihgen multiple workers actually
16:55 mihgen almost no logic in there, as it was moved to python code a while ago
16:55 angdraug I've started a centos ha deploy to test the shuffle patch
16:56 mihgen angdraug: ok, cool
16:57 mattymo mihgen, +1
16:58 angdraug on one hand, I get the argument about it not being an orchestrator anymore, on the other, only fuel devs know what astute means
16:58 angdraug can we have a descriptive name like "Worker"?
16:59 angdraug also you'll need update all the mentions of the Orchestrator in the UI, not just the logs tab
16:59 mihgen angdraug: orchestrator still there, but it is part of nailgun now.
17:00 mihgen actually all our logs are internals
17:00 mihgen angdraug: important question:
17:00 mihgen fuel-docs
17:00 mihgen should we create stable/5.0 there as well now?
17:00 mihgen bookwar says there is CI build which actually tracks branches
17:00 mihgen so from stable/5.0 there is gonna be fuel-5.0/
17:01 angdraug in that case yes we should
17:01 angdraug will allow more people to review the documentation before it's finalized
17:01 angdraug and will let us fix and test all direct URLs
17:02 mihgen angdraug: ok, cool. so creating stable/5.0 for it, and all further changes will require backporting to it from master
17:02 mihgen r0mikiam: are you around?
17:05 r0mikiam mihgen: yes, repository for 5.1 created
17:05 r0mikiam for new master
17:05 mattymo angdraug, if you see any docs review requests come up, make sure I'm on it
17:05 mattymo I review a lot of it
17:06 angdraug mattymo: ok
17:10 mattymo we're supposed to have a power outage here... but it never happened
17:10 mattymo or as our IT said "a blackout"
17:13 angdraug anyone looking at https://bugs.launchpad.net/fuel/+bug/1321662?
17:15 mihgen angdraug: don't think so. please review all what we have in New status, could be that it is critical one
17:16 mihgen I've sent an announcement to openstack-dev - hard code freeze is in action
17:16 angdraug that's the only one in 5.0
17:16 mihgen angdraug: http://fuel-launchpad.mirantis.com/project/fuel/bug_table_for_status/New/None
17:17 angdraug https://bugs.launchpad.net/fuel/+bug/1321907 is targeted for 5.1
17:17 mihgen link shows all bugs in New state
17:18 mihgen it means that we need to confirm / triage
17:18 mihgen which implies setting the right milestone and priority
17:19 mihgen in accordance with https://wiki.openstack.org/wiki/BugTriage
17:19 angdraug I've updated it to Confirmed, can keep it critical for 5.1
17:26 mihgen angdraug: actually https://bugs.launchpad.net/fuel/+bug/1321662 looks very similar to what aglarendil provided a fix for https://bugs.launchpad.net/fuel/+bug/1320123
17:26 mihgen angdraug: take a look at https://gerrit.mirantis.com/#/c/15811/1
17:27 mihgen we spent a lot to figure it out
17:32 angdraug yeah, I see keystone errors in nova-api.log in that snapshot
17:32 Ch00k joined #fuel-dev
17:40 bookwar joined #fuel-dev
17:55 xarses joined #fuel-dev
18:15 e0ne joined #fuel-dev
18:35 angdraug https://review.openstack.org/93883 worked fine for me, but for some reason, rabbitmq_hosts is the same on both compute hosts I've deployed
18:35 angdraug it's different between the controllers, though
18:53 dshulyak_ joined #fuel-dev
18:53 Ch00k joined #fuel-dev
19:43 IlyaE joined #fuel-dev
19:50 angdraug joined #fuel-dev
19:55 e0ne joined #fuel-dev
20:03 pbrooko joined #fuel-dev
20:22 mihgen angdraug: rmoe did you guys see https://bugs.launchpad.net/fuel/+bug/1322259 ? sounds like a duplicate to one of the existing ha bugs, but needs to be confirmed..
20:23 rmoe yeah, that's a duplicate of all of our ha bugs I think :)
20:25 mihgen =)
20:26 rmoe https://review.openstack.org/#/c/95007/
20:26 rmoe can somebody review this? we're still testing it but I want people to take a look
20:26 rmoe changing that value will allow the env to recover in around 2 and a half minutes
20:27 rmoe from killing rabbit node to the time vms are booted on computes that were connected to that rabbit host happen in 2:30 now
20:28 rmoe instead of 15 minutes when using the default tcp_retries2 value
20:28 mihgen Tatyanka_Leontov actually says her  https://bugs.launchpad.net/fuel/+bug/1322259 didn't restore in 2 hours..
20:28 mihgen not sure if anyone from Europe still alive here to review
20:29 rmoe yeah, I figured that would be the case
20:30 pbrooko joined #fuel-dev
20:30 rmoe that's odd, even without upgraded kombu packages or our keepalive settings everything would recover after 2 hours
20:31 rmoe in my previous testing
21:14 teran joined #fuel-dev
21:23 mihgen rmoe: don't know… can you please do something with that bug, like close as incomplete or duplicate?)
21:23 mihgen there is one more actually for you to take a look at: https://bugs.launchpad.net/fuel/+bug/1322228
21:23 mihgen it's havana
21:23 mihgen don't know if it is reproduced on icehouse..
22:15 teran joined #fuel-dev
22:24 IlyaE joined #fuel-dev
22:25 xarses joined #fuel-dev
22:49 xarses joined #fuel-dev
22:58 angdraug joined #fuel-dev
23:07 IlyaE joined #fuel-dev
23:15 teran joined #fuel-dev

| Channels | #fuel-dev index | Today | | Search | Google Search | Plain-Text | summary