Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-03-06

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:13 rook "we will burn nova"
00:22 boris-42 rook: =)
00:22 boris-42 rook: btw what do you think about that comment in review
00:22 rook there are two.
00:22 boris-42 rook: regarding to replace mode to run_scenarios_in_parallel?
00:25 rook could there be a option to run parallel, sequential or random -- where Rally would choose random sequencing?
00:25 rook I don't see why we need to limit it to 1 or 0
00:25 rook but maybe there is a good reason
00:27 rook realizing the 'random' option doesn't exist./
00:32 boris-42 rook: so the idea of run_scenarios_in_parallel is just to make it self-documented
00:33 boris-42 rook: like "mode" is not clear
00:34 rook hm - well if there will only ever be two options than i see his point
00:35 boris-42 rook: so I don't see other options
00:35 boris-42 rook: like or you are running them 1by1 or all in parallel
00:35 boris-42 rook: "random" doesn't seem reasonable
00:36 dmorita joined #openstack-rally
01:12 boris-42 rook: btw https://review.openstack.org/#/c/161699/
01:14 meteorfox boris-42: I was thinking on the idea  rook suggested about random. I think it has some merit. Perhaps its not that reasonable for uniform random distributions, but I can see having something like weights for each scenario useful. Where 90% of the time you want to execute some scenario over others
01:15 rook fyi boris-42 and meteorfox haproxy was the issue
01:15 rook removed it in good shape now
01:15 boris-42 rook: great
01:15 boris-42 meteorfox: so you are controlling runners of each scenario
01:16 boris-42 meteorfox: it's up to scenarios to specify duration of load from each scenario
01:16 boris-42 meteorfox: scenario's runner*
01:16 aix joined #openstack-rally
01:17 meteorfox Right
01:32 openstackgerrit Boris Pavlovic proposed stackforge/rally: [Sahara] cleanup clusters correctly  https://review.openstack.org/161293
01:33 openstackgerrit Boris Pavlovic proposed stackforge/rally: [Sahara] Fix Job Binaries download  https://review.openstack.org/161309
01:35 meteorfox boris-42: but say we have a new scenario primitive that can call other scenarios, and then have a new runner that can do weighted executions.
01:36 boris-42 meteorfox: and?
01:36 boris-42 meteorfox: it shouldn't be related to the mode of scenarios of exectuion
01:36 boris-42 meteorfox: runner can run single scenrio, scenario is set of predefined actions
01:36 boris-42 meteorfox: keeping this interfaces clean as possible is my major task in rally
01:41 meteorfox boris-42: sorry I was driving
01:42 meteorfox boris-42: yeah, I agree in this case it wouldn't be related at all with mode property
01:43 boris-42 meteorfox: so actually in first version of that proposal we didn't have mode and I was suggesting to run it in parallel alwasy
01:43 boris-42 meteorfox: but then we found valid use cases where it can be nice to use sequences
01:44 meteorfox boris-42: yes, I agree with the mode property. We want that
01:44 openstackgerrit Mikhail Dubov proposed stackforge/rally: Unify RPS and constant runners and tune constant runner  https://review.openstack.org/155225
01:44 meteorfox boris-42: I was suggesting a different possible implementation to run weighted scenarios
01:45 meteorfox boris-42: by having a scenario of scenarios
01:47 meteorfox boris-42: the proposal for me is good as it is
01:48 meteorfox boris-42: this new suggestion wouldn't be impacted by the proposal. Because it would just be a new scenario.
01:50 boris-42 meteorfox: yep
03:17 openstackgerrit Merged stackforge/rally: [Sahara] cleanup clusters correctly  https://review.openstack.org/161293
04:30 nkhare joined #openstack-rally
04:35 zerda joined #openstack-rally
04:50 exploreshaifali joined #openstack-rally
05:40 exploreshaifali joined #openstack-rally
05:56 yfried joined #openstack-rally
07:19 echoingumesh joined #openstack-rally
08:07 fhubik joined #openstack-rally
08:33 openstackgerrit Nikita Konovalov proposed stackforge/rally: [Sahara] Fix Job Binaries download  https://review.openstack.org/161309
08:37 openstackgerrit Nikita Konovalov proposed stackforge/rally: [Sahara] Suppurt batch job execution  https://review.openstack.org/161188
08:40 arxcruz joined #openstack-rally
08:49 psd joined #openstack-rally
08:52 openstackgerrit Pavel Boldin proposed stackforge/rally: Add FIO disk benchmark for VMs  https://review.openstack.org/152388
08:56 andreykurilin_ joined #openstack-rally
08:58 amaretskiy joined #openstack-rally
09:01 stannie joined #openstack-rally
09:08 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add rally tests for Ceilometer  https://review.openstack.org/153994
09:10 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add Ceilometer scenario for nova notifications  https://review.openstack.org/154803
09:32 openstackgerrit Mikhail Dubov proposed stackforge/rally: Unify RPS and constant runners and tune constant runner  https://review.openstack.org/155225
09:45 aarefiev joined #openstack-rally
10:09 e0ne joined #openstack-rally
10:18 andreykurilin__ joined #openstack-rally
10:25 psd joined #openstack-rally
10:33 openstackgerrit Andrey Kurilin proposed stackforge/rally: Unblock gates  https://review.openstack.org/162081
10:39 e0ne joined #openstack-rally
10:52 psd_ joined #openstack-rally
11:24 psd_ joined #openstack-rally
11:25 openstackgerrit Mikhail Dubov proposed stackforge/rally: Unify RPS and constant runners and tune constant runner  https://review.openstack.org/155225
11:47 e0ne joined #openstack-rally
11:56 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add rally tests for Ceilometer  https://review.openstack.org/153994
12:01 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add rally tests for Ceilometer  https://review.openstack.org/153994
12:22 openstackgerrit Merged stackforge/rally: Unblock gates  https://review.openstack.org/162081
12:26 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add Ceilometer scenario for nova notifications  https://review.openstack.org/154803
12:36 cdent joined #openstack-rally
12:38 psd_ joined #openstack-rally
12:52 openstackgerrit Mikhail Dubov proposed stackforge/rally: Fix texts and images in docs  https://review.openstack.org/156093
12:57 openstackgerrit Ivan Kolodyazhny proposed stackforge/rally: Implement create_and_upload_volume_to_image scenario for Cinder  https://review.openstack.org/152670
13:02 openstackgerrit Andrey Kurilin proposed stackforge/rally: Add Python 3.4 as supported interpreters  https://review.openstack.org/158743
13:03 cdent joined #openstack-rally
13:09 openstackgerrit Andrey Kurilin proposed stackforge/rally: Add Python 3.4 as supported interpreters  https://review.openstack.org/158743
13:17 pboros joined #openstack-rally
13:30 aix joined #openstack-rally
13:30 mwagner_lap joined #openstack-rally
13:44 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add Ceilometer scenario for nova notifications  https://review.openstack.org/154803
13:45 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add Ceilometer scenario for nova pollsters  https://review.openstack.org/160387
13:49 openstackgerrit Ivan Kolodyazhny proposed stackforge/rally: Implement create_and_upload_volume_to_image scenario for Cinder  https://review.openstack.org/152670
13:58 obutenko joined #openstack-rally
13:59 openstackgerrit Merged stackforge/rally: Add scenarios for live migration of an instance with volumes  https://review.openstack.org/157844
14:03 openstackgerrit Merged stackforge/rally: [Sahara] Fix Job Binaries download  https://review.openstack.org/161309
14:17 echoingumesh joined #openstack-rally
14:22 psd__ joined #openstack-rally
14:25 openstackgerrit Pavel Boldin proposed stackforge/rally: Add FIO disk benchmark for VMs  https://review.openstack.org/152388
14:29 openstackgerrit Vitaly Gusev proposed stackforge/rally: Add Ceilometer scenario for nova pollsters  https://review.openstack.org/160387
14:32 openstackgerrit Andrey Kurilin proposed stackforge/rally: Add Python 3.4 as supported interpreters  https://review.openstack.org/158743
14:34 obutenko joined #openstack-rally
14:38 echoingumesh joined #openstack-rally
14:39 openstackgerrit Andrey Kurilin proposed stackforge/rally: Fix unstable job  https://review.openstack.org/162175
14:46 psd__ joined #openstack-rally
14:49 openstackgerrit Kairat Kushaev proposed stackforge/rally: Add create-check-delete stack scenario  https://review.openstack.org/155685
14:49 openstackgerrit Kairat Kushaev proposed stackforge/rally: Add create-suspend-resume-delete stack scenario  https://review.openstack.org/155346
14:56 exploreshaifali joined #openstack-rally
15:07 openstackgerrit Roman Vasilets proposed stackforge/rally: Adding Multiple Request Scenario  https://review.openstack.org/117705
15:23 openstackgerrit Roman Vasilets proposed stackforge/rally: Add murano benchmarks  https://review.openstack.org/137661
15:23 openstackgerrit Roman Vasilets proposed stackforge/rally: Add murano base for murano benchmarks  https://review.openstack.org/137650
15:30 openstackgerrit Roman Vasilets proposed stackforge/rally: Adding Multiple Request Scenario  https://review.openstack.org/117705
15:32 e0ne joined #openstack-rally
15:42 openstackgerrit Andrey Kurilin proposed stackforge/rally: Add Python 3.4 as supported interpreters  https://review.openstack.org/158743
15:50 openstackgerrit Ivan Kolodyazhny proposed stackforge/rally: Implement create_and_upload_volume_to_image scenario for Cinder  https://review.openstack.org/152670
16:00 openstackgerrit Olga Kopylova proposed stackforge/rally: Implementation of 'rally task abort' command  https://review.openstack.org/161636
16:02 echoingumesh joined #openstack-rally
16:02 Miouge joined #openstack-rally
16:08 echoingumesh joined #openstack-rally
16:14 jaypipes joined #openstack-rally
16:21 stannie joined #openstack-rally
16:46 echoingumesh joined #openstack-rally
16:50 openstackgerrit Mikhail Dubov proposed stackforge/rally: Fix texts and images in docs  https://review.openstack.org/156093
16:53 boris-42 joined #openstack-rally
16:55 openstackgerrit OpenStack Proposal Bot proposed stackforge/rally: Updated from global requirements  https://review.openstack.org/161802
17:03 strummer_ie joined #openstack-rally
17:06 openstackgerrit Mikhail Dubov proposed stackforge/rally: Fix texts and images in docs  https://review.openstack.org/156093
17:06 echoingumesh joined #openstack-rally
17:23 neerbeer joined #openstack-rally
17:23 neerbeer hello. Does rally work with identity v3?
17:24 neerbeer We are able to use the openstack client to create users/projects. 'rally task start authenticate/keystone.json' fails w/ ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of users.'
17:24 neerbeer Help.
17:35 boris-42 neerbeer: yep it works
17:36 boris-42 neerbeer: you should use this file https://github.com/stackforge/rally/blob/master/samples/deployments/existing-keystone-v3.json
17:37 boris-42 neerbeer: during the execution of "rally deployment create --file ... --name  some name"
17:41 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Add classes for benchmark HTML report charts  https://review.openstack.org/159458
17:48 openstackgerrit Merged stackforge/rally: Fix unstable job  https://review.openstack.org/162175
17:55 openstackgerrit Carlos L. Torres proposed stackforge/rally: Adds median metric to summary report of task  https://review.openstack.org/161037
17:56 meteorfox boris-42: nothing new, I just rebased for latest changes, to see if that fixes the jenkins stability
17:59 neerbeer boris-42: Thanks for the info. I tried that. Looks like it was able to create two users and failed: http://pastebin.com/18n3xZBH
18:06 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Add chunks support and chart `Parallel iterations' to report  https://review.openstack.org/146814
18:06 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Add classes for benchmark HTML report charts  https://review.openstack.org/159458
18:11 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Add classes for benchmark HTML report charts  https://review.openstack.org/159458
18:12 meteorfox boris-42: do I need to set up something to run tox -e cli, locally?
18:17 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Add chunks support and chart `Parallel iterations' to report  https://review.openstack.org/146814
18:17 meteorfox boris-42: I get this error ''Module_six_moves_urllib_parse' object has no attribute 'SplitResult'. I google around and it seems to be that the six version might need to be updated
18:18 amaretskiy1 joined #openstack-rally
18:22 boris-42 neerbeer: meteorfox one moment
18:22 e0ne joined #openstack-rally
18:25 boris-42 neerbeer: nope seems like it wasn't able to create uses
18:25 boris-42 neerbeer: users
18:25 boris-42 neerbeer: it failed during the validation process that creates only one user
18:26 meteorfox boris-42: sure man. Whenever you have time. Here's the output https://gist.github.com/meteorfox/4e681adf70ff7ed212a1 , what's strange is that pip install says I have six 1.9.0, but when I run rally-integrated test under the cli venv, it says that six 1.5.2 is installed, which I think is the cause of the problem
18:27 neerbeer boris-42: Thanks for the speedy help. When I see /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py in the debug output it makes me think that it's using the keystone client code which is not identity v3 compatible. But I could be wrong.
18:29 coolsvap joined #openstack-rally
18:32 neerbeer boris-42: should I file a bug? thanks again
18:40 boris-42 neerbeer: hmmm
18:40 boris-42 neerbeer: actually rally works against keystone v3 if you use that config file
18:41 boris-42 neerbeer: otherwise we will have a bunch of bugs related to that
18:41 boris-42 neerbeer: did you specify admin user ?
18:41 boris-42 neerbeer: and admin tenant?
18:43 neerbeer Yes and Yes. I can 'openstack user create ...  ' and 'openstack user delete ... ' as well as 'rally show flavors' and 'rally show images'. Pls let me know where I should look or other tests I can run.  Thanks .
18:44 boris-42 neerbeer: if keystone authenticate doesn't work
18:44 boris-42 neerbeer: nothing will work
18:44 boris-42 neerbeer: are you using fuel?
18:45 neerbeer boris-42: perhaps you could point out which line in the debug is failing the validation and I cold look in source there. Fuel? No.
18:45 boris-42 neerbeer: ok
18:45 meteorfox boris-42: locally, I changed the cli conf on tox.ini to not use sitepackages, and that fixed my problem. Seems like the sitepackages doesn't the latest six version.
18:46 meteorfox *have
18:46 boris-42 meteorfox: let me read your messages
18:47 boris-42 meteorfox: so to run "tox -e cli" you need to have default rally deployment in it's DB
18:48 meteorfox boris-42: ok, got it. But the error I showed you above is also happening on the tox-ecli-py27-dsvm gate
18:49 boris-42 meteorfox: hm so redixin is fixing that issue now
18:50 meteorfox boris-42: awesome.
18:50 boris-42 meteorfox: but I belive it should work locally
18:50 boris-42 meteorfox: let me take a look at your patch
18:50 boris-42 neerbeer: soo
18:51 boris-42 neerbeer: back to your issue, for some reason rally is not able to create-and-delete user
18:52 neerbeer borris-42: I'm looking at vi +255 /usr/local/lib/python2.7/dist-packages/rally/benchmark/context/users.py
18:54 neerbeer boris-42: looks like self.context["tenants"] = self._create_tenants() ... shouldn't this use 'projects' and not 'tenants' .. just a thought
18:54 boris-42 neerbeer: we are supporting both
18:54 boris-42 neerbeer: versions of keystone API
18:54 boris-42 neerbeer: could you share me your deployment config
18:55 boris-42 neerbeer: that you pass to "rally deployment create"
18:57 neerbeer boris-42: I used 'rally deployment create --filename=existing-v3.json --name=existing'
18:57 neerbeer boris-42: the config file is here: http://pastebin.com/3Q6REqpJ
19:04 boris-42 neerbeer: could you try this http://paste.openstack.org/show/190487/
19:05 neerbeer boris-42: ok. I'll give that a shot now.
19:49 echoingu_ joined #openstack-rally
19:53 echoingumesh joined #openstack-rally
20:02 boris-42 neerbeer: does it work?
20:12 neerbeer boris-42: I found an error. I had two 'admin' users.
20:12 boris-42 neerbeer: oh
20:12 neerbeer boris-42: i just destoryed the deployment and recreated.
20:13 neerbeer boris-42: The other admin user was in a different domain and had different role assigned . I've deleted that user from keystone. However , I'm still getting the same error.
20:14 boris-42 neerbeer: okay try next
20:14 boris-42 neerbeer: . ~/.rally/openrc
20:15 boris-42 neerbeer: keystone user-create --name=some_user
20:15 boris-42 neerbeer: keystone user-create --name=some_user  --pass=pass
20:17 neerbeer boris-42: keystone doesn't support v3, correct ?
20:17 neerbeer boris-42:  http://pastebin.com/tBJPvjdt
20:18 boris-42 neerbeer:  hm strange very strange
20:20 boris-42 neerbeer: could you paste the ~/.rally/openrc
20:21 neerbeer boris-42: To get the keystone client commands to work I usu need to point to identity v2.0 'export OS_AUTH_URL=http://keystone-host:5000/v2.0'
20:21 neerbeer boris-42: That's why I switched to using the openstack client as the keystone client is (now) deprecated .
20:21 boris-42 neerbeer: ah so you need to use keystone v2.0 ?
20:22 boris-42 neerbeer: keystone client is not depracted
20:22 neerbeer boris-42: not deprecated .. but pending deprecated: http://docs.openstack.org/developer/python-keystoneclient/man/keystone.html
20:23 neerbeer boris-42: I had a wonderfully working rally w/ juno using identity v2. I  added v3 functionality , all else is working , but rally is not.
20:24 neerbeer boris-42:  so instead of using 'keystone catalog' , I use 'openstack endpoint list' . The keystone client no longer works for me unless I set the OS_AUTH_URL to v2.0
20:24 boris-42 neerbeer: so but you have keystone v3?
20:25 boris-42 neerbeer: and want to use it?
20:26 neerbeer boris-42: yes, I have keystone v3 and would like to use it if possible. All services ( horizon, nova, cinder , glance ) are working just fine for me. Rally was too when using v2 . Rally fails for me w/ v3.
20:27 boris-42 neerbeer: so the situation is next, rally use python-keystoneclient lib
20:27 boris-42 neerbeer: so if it is failing (as you are saying with keystone v3) rally is going to fail as well...
20:38 neerbeer boris-42: what does 'rally use python-keystoneclient lib' mean ?
20:38 neerbeer boris-42: is that a command ?
20:40 neerbeer boris-42: so my keystone client *should* work w/ v3? Is that what you are saying ?
20:43 boris-42 neerbeer: Rally communicates with OpenStack using python library called "python-keystoneclient"
20:45 exploreshaifali joined #openstack-rally
20:46 neerbeer boris-42: my python-keystone is version 1:0.10.1-0ubuntu1 .
20:47 boris-42 neerbeer: as far as you are using rally docker image
20:47 boris-42 neerbeer: it has own one
20:47 boris-42 neerbeer: regarding to rally project requriments
20:48 boris-42 neerbeer: it's really strange that python client doesn't work for your keystone
20:48 boris-42 neerbeer: seems like some bug somewhere in client/your deployment
20:49 neerbeer boris-42: I did a git clone https://git.openstack.org/stackforge/rally
20:49 boris-42 neerbeer: so you run python setup.py install?
20:49 boris-42 neerbeer: or ./install_rally.sh
20:49 boris-42 ?
20:50 neerbeer boris-42: hmmm, I ran install_rally.sh
20:54 boris-42 neerbeer: sooo you can try to do next
20:54 boris-42 neerbeer: create a virtualenv
20:54 boris-42 activate it
20:54 boris-42 and run "python setup.py install"
20:54 boris-42 after that you will get proper keystone client that should work against Juno and Master
20:55 boris-42 at least that is tested
22:05 meteorfox boris-42: Jenkins is failing for me here: https://jenkins02.openstack.org/job/gate-rally-dsvm-cli/675/console
22:05 meteorfox boris-42: but the errors seems unrelated to my patch
22:09 openstackgerrit Mikhail Dubov proposed stackforge/rally: Unify RPS and constant runners and tune constant runner  https://review.openstack.org/155225
22:19 meteorfox boris-42: all is get is 'float is required' right after test scenario Dummy.dummy_exception executed
22:22 neerbeer boris-42: do you have a step-by-step to get the correct python-keystone client ?
22:22 e0ne joined #openstack-rally
22:23 neerbeer boris-42: step-by-step for the rally w/ the virtualenv and correct python-keystoneclient?
22:24 andreykurilin_ joined #openstack-rally
22:26 exploreshaifali joined #openstack-rally
22:33 boris-42 neerbeer: just install in virtualenv
22:33 boris-42 neerbeer: rally and you will get proper verison of python-keystoneclient
22:34 neerbeer boris-42: I did ./rally/install_rally.sh -v
22:34 neerbeer boris-42: activate and cd rally && python setup.py install
22:34 neerbeer boris-42: That gave me a keystone command line client in /opt/rally/bin/keystone
22:37 openstackgerrit Andrey Kurilin proposed stackforge/rally: Add Python 3.4 as supported interpreters  https://review.openstack.org/158743
22:38 neerbeer boris-42: Unfortunately , it doesn't appear that this version of keystone command line client in /opt/rally/bin/keystone supports v3 either: http://pastebin.com/vYje5UFy
22:39 boris-42 neerbeer: it should be in /opt/rally/bin/keystone
22:39 boris-42 neerbeer: it should be in virutalenv
22:39 boris-42 neerbeer: you should use rally from virtualenv that has inside it installed keystone client
22:41 neerbeer boris-42: I've got /opt/rally/bin/keystone ... pls send a link/url for what to do next ? Does't /opt/bin/rally/activate get me into virutalenv ?
22:44 boris-42 neerbeer: it should
22:58 openstackgerrit Mikhail Dubov proposed stackforge/rally: Fix texts and images in docs  https://review.openstack.org/156093
23:04 cdent joined #openstack-rally
23:54 echoingumesh joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary