Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2016-03-18

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 moravec joined #openstack-rally
00:13 davideagnello joined #openstack-rally
00:26 moravec joined #openstack-rally
00:40 yingjun joined #openstack-rally
00:59 asti joined #openstack-rally
02:03 zhimoupeng joined #openstack-rally
02:12 itlinux joined #openstack-rally
02:25 ylobankov joined #openstack-rally
02:29 itlinux joined #openstack-rally
02:39 rfolco joined #openstack-rally
03:08 Aish joined #openstack-rally
03:25 itlinux joined #openstack-rally
03:47 itlinux joined #openstack-rally
04:28 akrzos joined #openstack-rally
04:30 shausy joined #openstack-rally
05:05 itlinux joined #openstack-rally
05:59 akrzos joined #openstack-rally
06:02 neeti joined #openstack-rally
06:10 Deng joined #openstack-rally
06:21 aswadr_ joined #openstack-rally
06:25 rdas joined #openstack-rally
06:26 dratushnyy1 joined #openstack-rally
06:37 rcernin joined #openstack-rally
07:26 psuriset joined #openstack-rally
07:30 akrzos joined #openstack-rally
07:35 e0ne joined #openstack-rally
07:47 edannon joined #openstack-rally
07:47 psuriset joined #openstack-rally
07:55 anshul joined #openstack-rally
07:57 pcaruana joined #openstack-rally
07:59 sverma joined #openstack-rally
08:14 amaretskiy joined #openstack-rally
08:19 dratushnyy1 joined #openstack-rally
08:20 tesseract joined #openstack-rally
08:26 tesseract- joined #openstack-rally
08:33 psuriset joined #openstack-rally
08:47 arxcruz joined #openstack-rally
09:00 akrzos joined #openstack-rally
09:13 openstackgerrit Merged openstack/rally: [CI] Check nova is available in deployment  https://review.openstack.org/293955
09:44 jose_lausuch joined #openstack-rally
09:44 jose_lausuch andreykurilin ping
09:44 yingjun joined #openstack-rally
09:44 andreykurilin__ jose_lausuch: pong
09:44 jose_lausuch may I ask you a question about rally?
09:46 andreykurilin__ sure
09:48 jose_lausuch let's say that I have an openstack deploment with SSL endpoints
09:48 jose_lausuch so, https
09:48 jose_lausuch and I need a certificate
09:48 jose_lausuch so I export OS_CACERT=....
09:48 jose_lausuch along with the other openstack credentials
09:49 ushkalim joined #openstack-rally
09:49 jose_lausuch If I use rally deployment create  --fromenv .... will that OS_CACERT be taken into consideration?
09:49 andreykurilin__ jose_lausuch: yes, it should be
09:49 jose_lausuch because I am getting this error
09:49 jose_lausuch http://hastebin.com/idumopapug.vhdl
09:50 andreykurilin__ jose_lausuch: https://github.com/openstack/rally/blob/master/rally/cli/envutils.py#L104-L106
09:50 andreykurilin__ it should work...
09:51 andreykurilin__ jose_lausuch: I need to go, sorry. will be available in 10-15 minutes
09:52 jose_lausuch andreykurilin__: ok
10:01 mvk joined #openstack-rally
10:10 andreykurilin jose_lausuch: I'm here, again
10:11 andreykurilin jose_lausuch: can you share logs via http://paste.openstack.org/ or http://xsnippet.org/ ? hastebin.com doesn't work for me on my PC(only my phone can display it)
10:12 jose_lausuch andreykurilin: sure, give me a sec. We are troubleshooting that
10:12 jose_lausuch do we need OS_INSECURE=true as well?
10:12 jose_lausuch andreykurilin: http://paste.openstack.org/show/491064/
10:13 andreykurilin jose_lausuch: if your do not need to verify your cacert - yes, you need to setup insecure
10:14 jose_lausuch what's the point of not verifying the cacert if we have it?
10:20 andreykurilin jose_lausuch: if you have self-signed cacert, keystone will unable to verify it and will fail.
10:21 jose_lausuch we have tried OS_INSECURE=true
10:21 jose_lausuch and rally deployment check worked
10:21 jose_lausuch but we have errors some where else now
10:21 jose_lausuch with this
10:21 jose_lausuch keystone_client = keystoneclient.Client(**creds_keystone)
10:22 andreykurilin can you share new errors?)
10:23 jose_lausuch yes, I will try to clean the ouput because there is too much info about other stuffs
10:25 openstackgerrit Andrey Kurilin proposed openstack/rally: [spec] Rally Verification refactoring  https://review.openstack.org/294198
10:26 jose_lausuch andreykurilin: http://paste.openstack.org/show/491067/
10:28 goutham_ joined #openstack-rally
10:28 jose_lausuch andreykurilin: so, lot of warnings InsecureRequestWarning:
10:29 andreykurilin jose_lausuch: As far as I remember, keystone is "unique". It accept not insecure=True, but verify=False :D Btw, why osclients module is not used?
10:29 jose_lausuch osclients?
10:29 jose_lausuch you mean instead of keystone client?
10:29 goutham_ osclients??
10:29 andreykurilin https://github.com/openstack/rally/blob/master/rally/osclients.py#L663
10:29 goutham_ hi andrey we spoke a couple of days back regarding tempest
10:30 goutham_ ok andrey how will i be using osclients?
10:31 andreykurilin http://paste.openstack.org/show/491069/
10:31 andreykurilin goutham_: hi
10:31 jose_lausuch oh awesome
10:31 akrzos joined #openstack-rally
10:31 andreykurilin osclients include most of openstack clients
10:31 jose_lausuch mmm
10:32 andreykurilin and most of them accept version and service type for non-default values
10:32 jose_lausuch can we also get the glance/cinder/neutron clients out that one?
10:32 andreykurilin yes
10:32 andreykurilin you can)
10:32 jose_lausuch that is awesome
10:32 jose_lausuch we have been always doing thins like:
10:33 jose_lausuch neutron_client = neutronclient.Client(**creds_neutron)
10:33 jose_lausuch keystone_client = keystoneclient.Client(**creds_keystone)
10:33 jose_lausuch etc
10:33 andreykurilin :)
10:33 jose_lausuch this makes things easier
10:34 andreykurilin Btw, osclients module tries to provide an easy and unified way to initialize all openstack clients
10:34 andreykurilin "btw" was left from another message:)
10:34 jose_lausuch ok
10:35 jose_lausuch thanks a lot for this
10:35 andreykurilin so osclients.Clients can be initialized with credentials obj and api_info dict
10:35 jose_lausuch we will refactor the code a bit
10:36 jose_lausuch what about the INSECURE?
10:36 jose_lausuch too many warnings...
10:37 andreykurilin api_info dict is a dict with non-default service_types and versions. For example, you want to initialize Clients object for cinder v2. You can do it like clients = osclients.Clients(credentials, {"cinder": {"version": "2", "service_type": "volumev2"}}) and use clients.cinder() or initialize Clients without api_info and call clients.cinder("2", "volumev2")
10:38 andreykurilin jose_lausuch: I don't know a lot about insecure options, but it looks like warnings are normal:) I suppose that the way to hide them, but I don't know it
10:39 andreykurilin left #openstack-rally
10:39 andreykurilin joined #openstack-rally
10:39 jose_lausuch andreykurilin__: ok, thanks a lot
10:39 jose_lausuch goutham_: I created a task to fix this https://jira.opnfv.org/browse/FUNCTEST-157
10:39 jose_lausuch but that will take some time, there are too many scripts doing that
10:40 jose_lausuch we should have a env manager or something
10:40 andreykurilin jose_lausuch: you are welcome
10:46 tosky joined #openstack-rally
10:52 goutham_ yea jose thanks
10:52 jose_lausuch goutham_: np, but we didnt fix our problem :)
10:52 goutham_ yea jos e
10:52 goutham_ jose*8
10:52 jose_lausuch lol
10:53 andreykurilin jose_lausuch: what problem do you have?)
10:53 jose_lausuch if we use cacert and insecure=true, our common way of initializing the clients fail
10:53 jose_lausuch keystone_client = keystoneclient.Client(**creds_keystone)
10:54 andreykurilin ah..
10:58 moravec joined #openstack-rally
11:00 jose_lausuch where creds_keystone is for example {"username":"admin","password":"admin","auth_url":"asdf","tenant_name":"admin","ca_cert":"/etc/cert"}
11:02 mvk joined #openstack-rally
11:03 andreykurilin jose_lausuch: osclients.Clients accepts not dict as credentials, you should initilize https://github.com/openstack/rally/blob/master/rally/common/objects/credential.py#L19
11:04 jose_lausuch andreykurilin: ok, I will take it into account when I change the code
11:05 jose_lausuch andreykurilin: anyway, if we dont use OS_INSCURE, rally failed
11:06 jose_lausuch as you can see here http://paste.openstack.org/show/491064/
11:08 jose_lausuch bad handshake: Error([('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')],) 2016-03-18 08:39:30.494 6886 ERROR rally  Command failed, please check log for more info
11:08 e0ne joined #openstack-rally
11:08 jose_lausuch goutham_: is the certificate right?
11:09 andreykurilin jose_lausuch: fuel uses self-signed cacerts by-default
11:09 andreykurilin so even from cli, openstack clients will not work without insecure parameter
11:09 jose_lausuch andreykurilin: you mean we should use INSCEURE=true?
11:09 andreykurilin yes
11:09 jose_lausuch ok
11:10 jose_lausuch what is the name of the credentials for the dic of OS_INSECURE?
11:11 jose_lausuch I think its just "insecure":"true/false"
11:11 rpromyshlennikov jose_lausuch: https_insecure
11:12 jose_lausuch hmmmm
11:12 jose_lausuch and for cacert?
11:12 jose_lausuch we use
11:12 edannon joined #openstack-rally
11:13 jose_lausuch ca_cert
11:13 jose_lausuch should it be https_cacert?
11:14 rpromyshlennikov yep, if talk about kwargs to init Credentials object
11:14 jose_lausuch yes, kwargs
11:15 openstackgerrit Rodion Promyshlennikov proposed openstack/rally: Change deployment model schema  https://review.openstack.org/276821
11:15 jose_lausuch thanks
11:15 rpromyshlennikov you are welcome
11:15 jose_lausuch "True" or "true" ?
11:15 jose_lausuch :)
11:16 openstackgerrit Rodion Promyshlennikov proposed openstack/rally: Move Credentials initialization to OSClients  https://review.openstack.org/294520
11:16 openstackgerrit Rodion Promyshlennikov proposed openstack/rally: Make Credential class plugin based  https://review.openstack.org/294521
11:18 rpromyshlennikov i think, that it should be capitalized
11:20 openstackgerrit Chris St. Pierre proposed openstack/rally: Convert existing scenarios to new types plugins  https://review.openstack.org/249464
11:21 jose_lausuch rpromyshlennikov: ok
11:21 andreykurilin jose_lausuch rpromyshlennikov: Rally uses oslo_utils.strutils for convertation boolean values, which transforms value to lower case and checks it with https://github.com/openstack/oslo.utils/blob/master/oslo_utils/strutils.py#L46
11:22 andreykurilin so you can use TRUE, true, TrUe and so on:)
11:22 andreykurilin all this variants should work
11:22 jose_lausuch lol, then I will use TrUe  :p
11:23 andreykurilin (y)
11:32 redixin joined #openstack-rally
11:34 yingjun joined #openstack-rally
11:36 yingjun joined #openstack-rally
11:47 akrzos joined #openstack-rally
11:54 rfolco joined #openstack-rally
12:16 igajsin joined #openstack-rally
12:17 igajsin left #openstack-rally
12:29 kiran-r joined #openstack-rally
12:36 asti joined #openstack-rally
12:40 jose_lausuch rpromyshlennikov: andreykurilin: https_cacert and https_insecure didnt work
12:40 jose_lausuch we have used "cacert" and "insecure" and it worked
12:40 andreykurilin ;(
12:40 jose_lausuch we use keystoneclient.v2_0
12:40 jose_lausuch maybe for v3 is different?
12:40 jose_lausuch not sure
12:40 stpierre joined #openstack-rally
12:41 andreykurilin jose_lausuch: cacert and insecure options are named different across different clients
12:42 andreykurilin jose_lausuch: osclients.Clients should handle the difference
12:42 jose_lausuch sorry, ca_cert
12:42 diogogmt joined #openstack-rally
12:42 jose_lausuch ya
12:42 jose_lausuch that will be the next step
12:42 jose_lausuch but for now...
12:43 jose_lausuch why openstack does not agree about having common parameters?
12:43 jose_lausuch its driving developers crazy!
12:43 jose_lausuch :D
12:44 MaxPC joined #openstack-rally
12:45 andreykurilin jose_lausuch: there is several initiatives. I started work on OpenStack from blueprint "unification client code". There was apiclient module in oslo-incubator, but most of cores said "we don't depend on oslo stuff and will continue to develop our X-client by ourserves"
12:45 andreykurilin *we don't want to depend on
12:45 jose_lausuch thats crazy
12:46 andreykurilin jose_lausuch: one or two releases ago, apiclient was removed and openstacksdk was chosen as an new right way
12:46 jose_lausuch it makes things more complicated
12:46 andreykurilin but it was not ready when I checked it last time
12:46 jose_lausuch ya, that makes sense and its a good achievement
12:46 jose_lausuch but you can't do everything with the os client
12:47 jose_lausuch it has some limitations I think
12:47 andreykurilin also, there is another project - os-cloud-config, which is designed to configure all clients by one common yaml file
12:47 andreykurilin jose_lausuch: os client and openstacksdk are different things:)
12:48 jose_lausuch ah you meant sdk
12:48 jose_lausuch ok
12:48 openstackgerrit joined #openstack-rally
12:49 jose_lausuch :)
12:51 andreykurilin jose_lausuch: I expected that openstacksdk will become a base for every python-*clients, but it looks like alternative for openstackclient
12:51 andreykurilin https://github.com/openstack/python-openstacksdk
12:59 jose_lausuch andreykurilin: what I will do for now is this crazy thing:
12:59 jose_lausuch creds.update({"cacert":cacert,"ca_cert":cacert,"https_ca_cert":cacert,"https_cacert":cacert})
13:00 jose_lausuch lol
13:02 andreykurilin lol
13:08 tesseract joined #openstack-rally
13:13 sverma joined #openstack-rally
13:30 jose_lausuch andreykurilin new things happening :)
13:38 sverma joined #openstack-rally
13:55 e0ne joined #openstack-rally
14:07 adiantum joined #openstack-rally
14:17 diogogmt joined #openstack-rally
15:00 tesseract joined #openstack-rally
15:11 adiantum joined #openstack-rally
15:25 baker joined #openstack-rally
15:25 itlinux joined #openstack-rally
15:30 e0ne joined #openstack-rally
15:34 baker joined #openstack-rally
15:46 openstackgerrit Piyush Raman Srivastava proposed openstack/rally: Fix validate_args function in cliutils  https://review.openstack.org/293569
16:02 itlinux joined #openstack-rally
16:22 mvk Hey, when running boot-runcommand-delete scenario, all response times in output table are marked as n/a, any idea how to fix that?
16:44 andreykurilin stpierre, our cleanup guru, hi! can you look at this issue - https://bugs.launchpad.net/rally/+bug/1559220 ?
16:44 openstack Launchpad bug 1559220 in Rally "Resource deletion failed" [Undecided,New]
16:45 andreykurilin amaretskiy: can you help mvk with his issue?
16:45 amaretskiy mvk: hi
16:46 mvk amaretskiy, hey
16:46 amaretskiy mvk: need output of this task run, with "-v" option, rally -v task start ...
16:47 amaretskiy mvk: or, you can make a html report
16:47 amaretskiy mvk: can you provide me a html report for this task?
16:47 mvk amaretskiy, yes, a moment
16:47 pcaruana joined #openstack-rally
16:48 baker joined #openstack-rally
16:52 mvk amaretskiy, http://paste.openstack.org/show/491135/ ?
16:54 amaretskiy mvk i see failure in report
16:55 amaretskiy mvk please open Failure stab
16:55 amaretskiy *Failures tab
16:55 amaretskiy mvk: ScriptError                 Script  execution failed: Command {'interpreter': '/bin/sh', 'script_inline':  'sleep 120'} has not output valid JSON: No JSON object could be decoded.  Output:
16:55 gubouvier_ joined #openstack-rally
16:55 amaretskiy mvk what is the script you run by command?
16:56 amaretskiy mvk sorry
16:56 amaretskiy mvk I see the script :)
16:56 amaretskiy mvk: sleep 120
16:56 mvk amaretskiy, tes, just for testing purposes
16:57 amaretskiy mvk the command must always output valid json
16:57 baker joined #openstack-rally
16:58 mvk amaretskiy, So If there is a failure anywhere, no response times will be displayed?
16:58 amaretskiy mvk: this means that for testing you should run something like sleep 120; echo "{\"foo\": 123}"
16:59 amaretskiy mvk since script actually failed (rally expects json but it returned empty data) so Rally thinks that scenario is actually failed
16:59 mvk amaretskiy, I see, and since scenario fails, no response times of atomic actions displaued?
17:00 amaretskiy mvk: sorry, I thisnk this is interesting
17:00 amaretskiy mvk: please wait a while......
17:00 mvk amaretskiy, no worries, I am happy for any help
17:05 amaretskiy mvk https://github.com/openstack/rally/blob/master/rally/task/processing/charts.py#L379-L380
17:05 amaretskiy mvk the reason of n/a is the following
17:05 amaretskiy you have only one iteration
17:05 amaretskiy but this iteration has failed (we have ScriptError)
17:06 amaretskiy MainStatsTable does not process atomic actions that have failed
17:06 amaretskiy so you have actually 0 data to make stats
17:06 amaretskiy that is the reason
17:07 amaretskiy mvk here is processing stats https://github.com/openstack/rally/blob/master/rally/task/processing/charts.py#L383-L384
17:07 amaretskiy as you see "error" condition is triggered
17:07 baker joined #openstack-rally
17:08 amaretskiy mvk: just fix the test script, I think you can even put echo "{}" there
17:09 mvk amaretskiy, interesting, does it always expect json output? can I somehow just run a bash command?
17:09 amaretskiy mvk yes, you can invoke file from filesystem
17:09 mvk amaretskiy, but yes you are right, If I add "echo {}", now I can see the reposne times
17:10 mvk mvk, Thanks a lot, should have paid more attention to failures:(
17:11 amaretskiy mvk keep in mind that returning json from scenario method is deprecated way to get output data from scenario
17:12 amaretskiy mvk: we have our new cool Scenario.add_output() method that can render different types of charts and also a table
17:12 mvk amaretskiy, I will take a look:)
17:12 amaretskiy mvk looks at example http://logs.openstack.org/19/294119/1/check/gate-rally-dsvm-rally/98d7923/rally-plot/results.html.gz#/Dummy.dummy_output/output
17:13 amaretskiy *look
17:13 amaretskiy mvk https://rally.readthedocs.org/en/latest/plugin/plugin_reference.html#processing-output-charts
17:13 amaretskiy mvk you can have  cool custom output data in report
17:16 mvk amaretskiy, I am trying to find a way how to custom it
17:19 mvk amaretskiy, anyway, thanks a lot:)
17:20 baker joined #openstack-rally
17:20 harshs joined #openstack-rally
17:22 openstackgerrit Dmitry Ratushnyy proposed openstack/rally: [CLI] Display task errors in human-friendly form  https://review.openstack.org/294727
17:30 madhu_ak joined #openstack-rally
17:32 openstackgerrit Dmitry Ratushnyy proposed openstack/rally: [CLI] Display task errors in human-friendly form  https://review.openstack.org/294727
17:33 baker joined #openstack-rally
17:37 e0ne joined #openstack-rally
17:42 lutostag joined #openstack-rally
17:52 pvaneck joined #openstack-rally
17:58 Aish joined #openstack-rally
18:08 openstackgerrit Roman Vasilets proposed openstack/rally: Add verify task exporter to testrail  https://review.openstack.org/261528
18:08 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add task exporter to the file system  https://review.openstack.org/261527
18:15 baker joined #openstack-rally
19:01 dratushnyy joined #openstack-rally
19:22 e0ne joined #openstack-rally
20:14 mvk joined #openstack-rally
20:15 e0ne joined #openstack-rally
21:23 lezbar__ joined #openstack-rally
21:24 diogogmt joined #openstack-rally
21:24 gubouvier__ joined #openstack-rally
21:25 ukinau- joined #openstack-rally
21:26 kambiz joined #openstack-rally
21:26 rvasilets joined #openstack-rally
21:27 hughsaunders joined #openstack-rally
21:31 openstackgerrit Tom Patzig proposed openstack/rally: Allow static fip in VMTasks.boot_runcommand_delete  https://review.openstack.org/271704
21:39 _hanhart joined #openstack-rally
22:20 openstackgerrit Tom Patzig proposed openstack/rally: Allow static fip in VMTasks.boot_runcommand_delete  https://review.openstack.org/271704
22:26 rook-lappy joined #openstack-rally
22:34 lewo joined #openstack-rally
23:09 baker joined #openstack-rally
23:43 itlinux joined #openstack-rally
23:44 e0ne joined #openstack-rally
23:47 akrzos joined #openstack-rally
23:58 harshs joined #openstack-rally
23:59 Aish left #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary