Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-09-10

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:35 frayedknot joined #openstack-rally
00:39 puranamr joined #openstack-rally
00:41 akrzos_ joined #openstack-rally
01:12 openstackgerrit Kun Huang proposed openstack/rally: New nova jobs: boot_and_delete_multiple_servers  https://review.openstack.org/221615
01:20 frayedknot joined #openstack-rally
01:23 puranamr joined #openstack-rally
01:37 kun_huang boris-42: ping
01:38 boris-42 kun_huang: pong
01:39 kun_huang boris-42: have a look at http://paste.openstack.org/show/451164/
01:39 kun_huang some of scenario's output doesn't look good
01:40 kun_huang the result is from create_and_list_external_router
01:40 kun_huang I think that will be a problem...
01:41 kun_huang the result can't represent benchmark business very well
01:45 boris-42 kun_huang: looking at it
01:45 boris-42 kun_huang: yep this scenario should be fixed
01:45 kun_huang okay
01:45 boris-42 kun_huang: it is mistake to call in loop atomic action
01:45 boris-42 kun_huang: so we should use with atomic.ActionTimer():
01:45 boris-42 for ....:
01:45 boris-42 do_utils()
01:45 kun_huang I know this
01:45 kun_huang it's better that you feel this is an issue
01:45 kun_huang https://review.openstack.org/#/c/220200/
01:45 kun_huang that output is from this one
01:48 ilbot3 joined #openstack-rally
01:48 Topic for #openstack-rally is now ☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ Review Dashboard: http://goo.gl/YuCJfl ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  boris-42, yfried, msdubov, rediskin, andreykurilin, amaretskiy  Ã¢ËœÂ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally:  https://rally.readthedocs.org/en/latest/contribute.html
01:52 boris-42 kun_huang: btw
01:53 kun_huang boris-42:  I'm listening :)
01:59 openstackgerrit Sirisha Areti proposed openstack/rally: Adds nova image list plugin  https://review.openstack.org/221501
02:03 openstackgerrit wenwu proposed openstack/rally: Fix typo in rally/consts.py  https://review.openstack.org/221182
02:07 openstackgerrit Kun Huang proposed openstack/rally: New nova jobs: boot_and_delete_multiple_servers  https://review.openstack.org/221615
02:52 puranamr joined #openstack-rally
03:03 puranamr joined #openstack-rally
03:48 psuriset joined #openstack-rally
03:50 Aish joined #openstack-rally
03:56 ompp joined #openstack-rally
04:38 tfreger joined #openstack-rally
05:10 rvasilets joined #openstack-rally
05:11 rdas joined #openstack-rally
05:26 neeti joined #openstack-rally
06:02 Aish joined #openstack-rally
06:13 arxcruz joined #openstack-rally
06:17 psuriset joined #openstack-rally
06:28 vipul joined #openstack-rally
06:38 yfried__ joined #openstack-rally
06:41 yfried joined #openstack-rally
07:03 Aish joined #openstack-rally
07:08 kun_huang our gate is broken or everyone's gate is broken?
07:18 rdas_ joined #openstack-rally
07:22 arxcruz joined #openstack-rally
07:58 fhubik joined #openstack-rally
08:00 bapalm joined #openstack-rally
08:12 amaretskiy joined #openstack-rally
08:24 kbaikov joined #openstack-rally
08:30 karimb joined #openstack-rally
08:34 openstackgerrit Kiran proposed openstack/rally: Add Neutron LBaaS V1 healthmonitor scenarios  https://review.openstack.org/217041
08:35 boris-42 kun_huang: i don't know but ours are deff broken
08:36 kun_huang boris-42: I got it
08:36 kun_huang boris-42: ceilometer again
08:36 kun_huang their event list api is updated
08:36 kun_huang quite slow
08:36 kun_huang ReadTimeout: HTTPConnectionPool(host='127.0.0.1', port=8777): Read timed out. (read timeout=180)
08:37 kun_huang 3 minutes are not enough....
08:37 kun_huang my friend is working on that
08:42 cdent joined #openstack-rally
08:50 tfreger1 joined #openstack-rally
08:50 tfreger1 joined #openstack-rally
08:57 e0ne joined #openstack-rally
09:00 arxcruz joined #openstack-rally
09:12 e0ne joined #openstack-rally
09:14 anshul joined #openstack-rally
09:24 tosky joined #openstack-rally
09:42 e0ne joined #openstack-rally
09:52 yfried andreykurilin: amaretskiy: question about https://bugs.launchpad.net/rally/+bug/1492980
09:52 openstack Launchpad bug 1492980 in Rally "Floating IP leakage on boot_runcommand_delete" [High,Confirmed] - Assigned to Yair Fried (yfried)
09:52 yfried if a server fails to achieve active status, where is it cleaned up?
09:56 amaretskiy yfried: i guess that we should make cleanup smarter
09:56 yfried amaretskiy: or, add the boot to the try/catch
09:56 yfried amaretskiy: in vmtask
09:57 tfreger joined #openstack-rally
09:58 amaretskiy yfried: wee need a patch set sot we can discuss that more concrete
09:58 amaretskiy I think so
09:58 openstackgerrit Roman Vasilets proposed openstack/rally: Add 'Who Is Using Rally' section to the docs  https://review.openstack.org/222099
09:59 amaretskiy yfried: *we need a patch set so we can discuss that more concrete
09:59 yfried amaretskiy: I'm working on it, that's why I'm looking for the code that cleans the VM in case of boot failure
10:02 amaretskiy yfried: try/except over server boot looks good, however, I think, having ability to smart remove servers in context.cleanup is also good idea
10:03 amaretskiy yfried: oh, if server failed to boot so nova cleanup will not work
10:03 amaretskiy yfried: try/except over boot server - looks good
10:03 yfried amaretskiy: why won't nova cleanup kick in in case of server boot?
10:04 yfried amaretskiy: also the "finally" is deleting  a server. if server fails to create, it will fail
10:05 amaretskiy yfried: need to investigate this, maybe cleanup will also work
10:07 yfried amaretskiy: cleanup is called at the end of task, not at the end of iteration, isn't it?
10:07 amaretskiy yfried: yes, cleanup runs after all iterations are finished
10:13 aix joined #openstack-rally
10:15 andreykurilin yfried, amaretskiy: ContextCleanup tries to remove resource without attention of its status, so even if vm in error state, it should be removed
10:16 yfried andreykurilin: amaretskiy: so adding floating ips to cleanup should take care of leakage
10:17 openstackgerrit Yair Fried proposed openstack/rally: [Cleanup] NeutronFloatingIP  https://review.openstack.org/222111
10:17 amaretskiy yfried: i think this can be solved by cleanup + if cleanup-way will care about similar problem in another scenarios
10:18 andreykurilin amaretskiy: Also, ContextCleanup contains tries to remove resource with several attempts( https://github.com/openstack/rally/blob/master/rally/plugins/openstack/context/cleanup/manager.py#L83-L85 )
10:18 andreykurilin yfried: it looks like not only neutron is affected
10:21 andreykurilin yfried: my mistake. `VMTasks.boot_runcommand_delete ` fails at gate-rally-dsvm-rally-nova due to another issue - http://logs.openstack.org/86/221286/1/check/gate-rally-dsvm-rally-nova/a75c4df/rally-plot/results.html.gz#/VMTasks.boot_runcommand_delete/failures
10:40 yfried andreykurilin: what does status NONE mean? ping returns UP or DOWN
10:50 psuriset joined #openstack-rally
10:59 ompp joined #openstack-rally
11:09 redixin joined #openstack-rally
11:17 andreykurilin yfried: I don't know:)
11:17 andreykurilin something went wrong
11:17 andreykurilin yfried|afk: ^
11:18 stpierre joined #openstack-rally
11:35 aix joined #openstack-rally
11:40 akrzos joined #openstack-rally
11:52 mwagner_lap joined #openstack-rally
11:55 yfried andreykurilin: amaretskiy: I'm looking at the discovered resources post VMTask run, and no Neutorn resources are discovered at all. any idea why?
11:57 andreykurilin yfried: because neutron is missed from listed services of cleanup context for VMTask resources - https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/vm/vmtasks.py#L45-L46
11:57 yfried andreykurilin: should I add it there? would it break novenetwork tests?
11:58 yfried andreykurilin: or should I add it to the task's json somehow?
12:02 andreykurilin yfried: it will break novanet
12:02 yfried andreykurilin: so? how should we solve this? right now we have neutron resource leakage
12:03 andreykurilin yfried: corrently, CleanupContext is hidden, so you can't configure it outside scenario's decorators
12:04 andreykurilin yfried: if we talk about only floatings ips, imo, novaclient should support to list and remove it, even in envs with neutron
12:06 MaxPC joined #openstack-rally
12:11 andreykurilin so, it would be nice to implement simple FloatingIpsResource and mark it as nova resource and it will work for both nova and neuron envs
12:19 frayedknot joined #openstack-rally
12:22 openstackgerrit Chris St. Pierre proposed openstack/rally: Use network context for Neutron scenarios  https://review.openstack.org/210612
12:24 openstackgerrit Yair Fried proposed openstack/rally: [Cleanup] FloatingIP  https://review.openstack.org/222111
12:25 redixin joined #openstack-rally
12:38 openstackgerrit Illia Khudoshyn proposed openstack/rally: Add task format converter  https://review.openstack.org/211160
12:39 psuriset joined #openstack-rally
12:46 yfried andreykurilin: amaretskiy: I want to change rally conf file on my dev setup. where do I find it? rally is installed in venv and I've added my local repo to  pythonpath
12:48 amaretskiy yfried: there are several standard locations https://github.com/openstack/rally/blob/master/rally/cli/cliutils.py#L50-L57
12:49 yfried amaretskiy: where is the path list?
12:49 amaretskiy yfried: system-wide is /etc/rally/rally.conf
12:50 amaretskiy yfried: https://github.com/openstack/rally/blob/master/rally/cli/cliutils.py#L39
12:50 ompp joined #openstack-rally
12:50 yfried amaretskiy: tnx
12:50 amaretskiy yfried: so you can override system-wide with ~/.rally/etc/rally.cong
12:51 amaretskiy *rally.conf
12:54 yfried amaretskiy: what if rally's venv isn't in ~/.rally
12:54 yfried ?
12:56 amaretskiy yfried: that is why sys.prefix + "/etc/rally" is on the first place in  https://github.com/openstack/rally/blob/master/rally/cli/cliutils.py#L39
12:56 yfried amaretskiy: tnx
12:57 puranamr joined #openstack-rally
12:58 andreykurilin__ joined #openstack-rally
13:16 puranamr joined #openstack-rally
13:33 e0ne joined #openstack-rally
13:34 dspano joined #openstack-rally
13:39 openstackgerrit Yair Fried proposed openstack/rally: [VMTask] Avoid Floating IP leakage  https://review.openstack.org/222191
13:43 yfried amaretskiy: andreykurilin: boris-42: https://review.openstack.org/#/q/status:open+project:openstack/rally+branch:master+topic:bug/1492980,n,z
13:53 tosky_ joined #openstack-rally
14:13 aswadr joined #openstack-rally
14:14 moravec joined #openstack-rally
14:25 lutostag joined #openstack-rally
14:51 skraynev joined #openstack-rally
14:53 boris-42 yfried: amaretskiy it will be cleaned up
14:53 boris-42 yfried: amaretskiy during the generic cleanup
14:53 boris-42 yfried: amaretskiy no matter what stats it has
14:53 yfried boris-42: are you talking about the spec?
14:53 boris-42 yfried: nope about cleanup*
14:53 yfried boris-42: that isn't implemented yet?
14:54 yfried boris-42: it isn't
14:54 boris-42 yfried: generic cleanup is implemented already for more then a year
14:54 boris-42 yfried: it's cleanup and admin_cleanup context
14:54 yfried boris-42: floating ips are still leaked - see bug
14:56 boris-42 yfried: so it means that the order may be wrong*
14:56 yfried boris-42: about flips?
14:56 boris-42 yfried: yep
14:56 yfried boris-42: they aren't in the resources. see the patches
14:56 boris-42 yfried: the order of deletion resources
14:56 yfried boris-42: resource module doesn't have flips in it
14:57 boris-42 нyfried so the proper fix is to add it
14:58 boris-42 yfried: this one is ok patch https://review.openstack.org/#/c/222111/2/rally/plugins/openstack/context/cleanup/resources.py
14:59 boris-42 yfried: just one small nit https://review.openstack.org/#/c/222111/
14:59 boris-42 yfried: btw gates are currently broken by ceilometer I believe
15:02 Aish joined #openstack-rally
15:03 e0ne joined #openstack-rally
15:06 yfried boris-42: ack
15:10 Aish joined #openstack-rally
15:11 openstackgerrit Yair Fried proposed openstack/rally: [VMTask] Avoid Floating IP leakage  https://review.openstack.org/222191
15:11 openstackgerrit Yair Fried proposed openstack/rally: [Cleanup] FloatingIP  https://review.openstack.org/222111
15:12 boris-42 yfried: so I don't understand patch VMTask
15:12 yfried boris-42: andreykurilin: ^ your comments are addressed
15:12 yfried boris-42: have you read the bug?
15:13 boris-42 yfried: btw you didn't address my comment=(
15:14 yfried boris-42: about skipping nova floating ips? I did - it handles neutron floating ips, whichever is picked up first is good
15:15 boris-42 yfried: ah I see
15:15 boris-42 yfried: regardign to VMTask patch
15:16 boris-42 yfried: about cleanups I know that it will work but we will cleanup floating ips 2 times*
15:17 yfried boris-42: are you talking about novanet cleaning neutron resources?
15:17 yfried boris-42: IIUC neutron will not pick up it's resources if nnet cleaned them. I might be wrong...
15:18 boris-42 yfried: I am just talking that it won't be clear e.g. we are deleting from nova netruon resources
15:19 openstackgerrit Sergey Skripnick proposed openstack/rally: [do-not-merge] trying to find recently introduced ceilometer bug  https://review.openstack.org/222243
15:19 boris-42 yfried: after that we are running neturong cleanup that will try to delete the same resources
15:20 boris-42 yfried:  in any way +2
15:20 yfried boris-42: if you have the logic for a skip, I'll add it (how do I test that nnet exist or not?)
15:22 boris-42 yfried: so basically what I was thinking about this https://github.com/openstack/rally/blob/master/rally/osclients.py#L440
15:25 emagana joined #openstack-rally
15:26 aix joined #openstack-rally
15:28 Prashant joined #openstack-rally
15:30 ompp joined #openstack-rally
15:31 Aish left #openstack-rally
15:51 skraynev joined #openstack-rally
16:02 e0ne joined #openstack-rally
16:06 Aish joined #openstack-rally
16:12 Prashant joined #openstack-rally
16:21 ompp joined #openstack-rally
16:47 spyderdyne joined #openstack-rally
16:59 puranamr joined #openstack-rally
17:10 openstackgerrit Chris St. Pierre proposed openstack/rally: WIP: Consistent resource naming  https://review.openstack.org/184888
17:32 emagana joined #openstack-rally
17:38 emagana joined #openstack-rally
17:41 pvaneck joined #openstack-rally
18:08 puranamr joined #openstack-rally
18:13 e0ne joined #openstack-rally
18:25 psuriset joined #openstack-rally
18:33 madhu_ak joined #openstack-rally
18:34 iurygregory joined #openstack-rally
19:19 puranamr joined #openstack-rally
19:31 puranamr joined #openstack-rally
19:36 Prashant joined #openstack-rally
19:49 madhu_ak joined #openstack-rally
19:51 yfried joined #openstack-rally
20:11 josdotso joined #openstack-rally
20:34 karimb joined #openstack-rally
20:40 aix joined #openstack-rally
20:43 puranamr joined #openstack-rally
21:05 openstackgerrit Chris St. Pierre proposed openstack/rally: WIP: Consistent resource naming  https://review.openstack.org/184888
21:17 boris-42 stpierre: ^ uh maybe we need to split that patch
21:17 boris-42 stannie: it looks quite hue
21:22 akrzos joined #openstack-rally
21:24 stpierre pfft, it's just +1308, -1364
21:24 stpierre :P
21:24 stpierre i can think of one way we can split it. i'll try to make that happen, and also work on figuring out if there are any others
21:35 puranamr joined #openstack-rally
21:38 akrzos joined #openstack-rally
21:39 sacharya joined #openstack-rally
21:39 sacharya left #openstack-rally
21:51 openstackgerrit Andrey Kurilin proposed openstack/rally: [JOBS] disable several ceilometer scenarios to unblock gates  https://review.openstack.org/222381
22:00 akrzos joined #openstack-rally
22:21 davideag_ joined #openstack-rally
22:23 madhu_ak hi, how to pass admin credentials while running the rally tests?
22:24 madhu_ak actually I am trying to create a new tenant using keystone_client, but I get this error: 2015-09-10 15:23:33.546 62351 INFO rally.task.runner [-] Task 2d13dde3-fee5-4fb5-862e-e6f7e4a17430 | ITER: 0 END: Error Forbidden: You are not authorized to perform the requested action: admin_required (Disable debug mode to suppress these details.) (HTTP 403) (Request-ID: req-786674d1-3eb5-4e02-a6a7-d2c00f7db47a)
22:24 madhu_ak not sure where I need to source or pick admin creds before keystone_client create a new tenant..
22:25 madhu_ak boris-42 ^^
22:31 akrzos joined #openstack-rally
22:46 albertw joined #openstack-rally
22:49 frayedknot joined #openstack-rally
22:51 akrzos joined #openstack-rally
22:55 davideagnello joined #openstack-rally
23:02 Prashant joined #openstack-rally
23:05 akrzos joined #openstack-rally
23:08 boris-42 madhu_ak: hi there
23:08 madhu_ak boris-42 hi
23:08 boris-42 madhu_ak: so not sure what you are trying to do )
23:08 madhu_ak boris-42 just a min
23:09 boris-42 madhu_ak: sure
23:13 madhu_ak boris-42: http://paste.openstack.org/show/455822/
23:13 madhu_ak boris-42 I am trying like that, for creating a new tenant..
23:13 madhu_ak not sure what I am doing wrong..
23:13 boris-42 madhu_ak: keystone_client = self.clients("keystone")
23:13 boris-42 madhu_ak: is wrong
23:14 boris-42 madhu_ak: admin_keystone_client = self.admin_clients("keystone")
23:14 boris-42 madhu_ak: you can create tenants if you are not admin
23:15 madhu_ak wow, awesome.. Thanks boris-42
23:16 madhu_ak boris-42 by the way, how can I debug the test cases written in rally?
23:17 boris-42 madhu_ak: soooo rally -vd rally task start ...
23:17 boris-42 madhu_ak: and you'll get debug LOG
23:17 madhu_ak ah I see
23:17 madhu_ak boris-42 by the way, how can I create tenants if I am not admin.. without using  admin_keystone_client = self.admin_clients("keystone")
23:18 boris-42 madhu_ak: you can't create them
23:18 boris-42 madhu_ak: without chaning keystone polices *
23:18 boris-42 madhu_ak: by default it's admin only operation
23:20 madhu_ak boris-42 oh, good to know. by the way, if I create tenant in admin operation, if I want to create network for that tenant_id, then I need to use the same way like  admin_neutron_client = self.admin_clients("neutron")?
23:20 madhu_ak because, it gives me an error saying Specifying 'tenant_id' other than authenticated tenant in request requires admin privileges
23:22 boris-42 madhu_ak nope
23:22 boris-42 madhu_ak: you need to create network from the user*
23:22 boris-42 madhu_ak: take a look at this code
23:23 boris-42 madhu_ak: https://github.com/openstack/rally/blob/master/rally/plugins/openstack/context/network/networks.py#L53-L72
23:24 boris-42 madhu_ak: it creates networks for tenants
23:24 boris-42 madhu_ak: btw could you explain me the purpouse of such test ?)
23:25 madhu_ak sure boris-42 thanks for the link
23:25 madhu_ak boris-42 am actually validatiing vpn services across different tenants
23:33 chen12 joined #openstack-rally
23:35 MaxPC joined #openstack-rally
23:36 boris-42 madhu_ak: so you can use network context
23:36 boris-42 madhu_ak: that already exist
23:36 boris-42 madhu_ak: or you can use existing scenarios that creates network
23:37 boris-42 madhu_ak: routers and other stuff
23:37 boris-42 madhu_ak: idea of rally is to create building blocks not hardcode scenarios
23:37 boris-42 madhu_ak: https://github.com/openstack/rally/tree/master/samples/tasks/scenarios/neutron
23:38 boris-42 madhu_ak: here is the code https://github.com/openstack/rally/tree/master/rally/plugins/openstack/scenarios/neutron

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary