Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-12-08

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:01 arnoldje joined #openstack-rally
00:14 spyderdyne joined #openstack-rally
00:35 chenli joined #openstack-rally
00:51 stpierre boris-42_: did you see my question about the functional testing mixin stuff?
00:53 boris-42_ stpierre: nope
00:53 boris-42_ stpierre: I was not active recently in Rally =(
00:53 stpierre what's up with https://github.com/openstack/rally/blob/master/rally/task/functional.py ? i notice it's only used in one scenario, and it seems a bit strange, but we've got some people interested in doing more functional type stuff
01:02 boris-42_ stpierre: so that was first point
01:02 boris-42_ stpierre: so we will make better benchmarks
01:02 boris-42_ stpierre: with assertations
01:03 boris-42_ stpierre: the idea was that community will support this and update *all* scenarios and make proper assertations
01:03 stpierre ok
01:03 stpierre that's great
01:03 boris-42_ stpierre: as well to write some SLA checks for assertations
01:04 boris-42_ stpierre: so we can make possible "soft" assertation
01:05 boris-42_ stpierre: I heard from people that they are interested in non failing assertations check (like it is not so "critical" if something is failing asseration check)
01:05 boris-42_ stpierre: so a lot of possibilites
01:25 coolsvap joined #openstack-rally
01:34 rook joined #openstack-rally
01:47 openstackgerrit Merged openstack/rally: [gates] move ceilometer alarts scenarios to non-voting job  https://review.openstack.org/254263
01:49 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
01:57 arnoldje joined #openstack-rally
03:13 baker joined #openstack-rally
03:15 gsagie_ joined #openstack-rally
03:16 gsagie_ Hello all, i want to add a Rally gate job for specific Neutron backend and was wondering how to do it? if i look at Neutron i don't see it has a specific Rally job defined in neutron.yam, so wonder how can i deploy it with a specific Neutron plugin and run the same tests?
03:16 gsagie_ anyone know of an example of something like that
03:28 gsagie_ I would like to run a gate job of Rally tests for a specific Neutron backend, haven't seen any example of this, wonder whats the best way to do it.
03:44 arnoldje joined #openstack-rally
03:53 itzikb_ joined #openstack-rally
03:57 baker_ joined #openstack-rally
04:05 akrzos joined #openstack-rally
04:13 akrzos joined #openstack-rally
04:20 bkopilov joined #openstack-rally
04:52 chenli joined #openstack-rally
05:10 rdas joined #openstack-rally
05:32 stpierre joined #openstack-rally
05:34 itzikb_ joined #openstack-rally
05:57 jaypipes joined #openstack-rally
05:58 bochi-michael joined #openstack-rally
06:04 tfreger joined #openstack-rally
06:34 rook joined #openstack-rally
06:38 e0ne joined #openstack-rally
06:49 e0ne joined #openstack-rally
07:02 e0ne joined #openstack-rally
07:03 itzikb_ joined #openstack-rally
07:21 e0ne joined #openstack-rally
07:23 yfried_ joined #openstack-rally
07:25 anshul joined #openstack-rally
08:18 rook joined #openstack-rally
08:21 arxcruz joined #openstack-rally
09:03 e0ne joined #openstack-rally
09:13 amaretskiy joined #openstack-rally
09:49 openstackgerrit Bo Chi proposed openstack/rally: change name of rally.common.log module  https://review.openstack.org/254009
10:01 aix joined #openstack-rally
10:16 andreykurilin gsagie: hi
10:18 andreykurilin gsagie: What do you mean by " specific Neutron backend"? Some neutron service with non default service type?
10:28 MaxPC joined #openstack-rally
10:33 adiantum joined #openstack-rally
10:33 aix joined #openstack-rally
10:36 openstackgerrit Bo Chi proposed openstack/rally: change name of rally.common.log module  https://review.openstack.org/254009
10:38 neeti joined #openstack-rally
10:42 openstackgerrit Roman Vasilets proposed openstack/rally: Fix placements of docs, samples, certification in the Dockerfile  https://review.openstack.org/254671
10:44 openstackgerrit Roman Vasilets proposed openstack/rally: Fix bug in Dockerfile with docs, samples, certification  https://review.openstack.org/254671
10:44 openstackgerrit Roman Vasilets proposed openstack/rally: Fix bug in Dockerfile with docs, samples, certification  https://review.openstack.org/254671
10:50 rook joined #openstack-rally
10:52 tosky joined #openstack-rally
10:55 gsagie andreykurilin: i meant just different Neutron backends, like ODL, OVN, Midonet and such..
10:56 gsagie but i think i understand how to do it, similar to the murano gate job in rally
10:57 gsagie just need to enable the correct backend devstack plugin
10:57 gsagie i guess...
10:58 andreykurilin gsagie: As far as I understand it is more about neutron configuration
10:59 andreykurilin you should extend this section: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L77-L79
11:00 andreykurilin gsagie: also, I suppose that thios job-template should be updated - https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L471-L491 and proper builder(neutron-extended) should be used.
11:00 gsagie andreykurilin: yeah, i want the job however to be in the project own repository (the Neutron driver) and i only want it to run Network based scenarios, but i think i saw how to do it with rally_gate.sh
11:01 gsagie which takes the scenario file from pre-defined location
11:01 andreykurilin gsagie: yes
11:01 andreykurilin it is quite easy
11:01 andreykurilin one moment
11:02 andreykurilin gsasie: rally_gate.sh uses yaml file base on job name.
11:02 openstackgerrit joined #openstack-rally
11:03 andreykurilin gsagie: and script searches yaml files in project_repo/rally-jobs
11:03 gsagie yeah, thanks
11:03 andreykurilin gsagie: rally project runs a big number of jobs in rally-gates. and we have a separate yaml files for each of them - https://github.com/openstack/rally/tree/master/rally-jobs
11:04 andreykurilin so you should just name your job correctly and put corresponding yaml file to your repo
11:05 gsagie andreykurilin: okie, i will need my own template as i need to enable the plugin and enable services for the specific backend, is there a reason why the job defnition is at the rally project and not at each of the other projects location?
11:07 andreykurilin gsagie: no no no) each project which want rally jobs, should have own rally-jobs dir, where rally_gate script will try to find task
11:08 andreykurilin rally project was an example of a project which have multiple number of rally jobs with own configurations
11:08 gsagie andreykurilin: ok but how do i configure the job in project-config? do i configure the template in my own project yaml file?
11:09 gsagie i guess the only example i can see for something like that is with ec2-api
11:09 gsagie and group-base-policy
11:09 andreykurilin gsagie: keystone, cinder have rally gates
11:09 andreykurilin https://github.com/openstack/cinder/tree/master/rally-jobs
11:10 andreykurilin glance have rally job too
11:10 gsagie andreykurilin: yeah, but none of them has it defined in their project .yaml file in project-config
11:10 gsagie beside ec2-api and group-base-policy
11:11 gsagie and since i need to edit the template, i can either put this job in networking-ovn.yaml for example, or in rally.yaml
11:12 gsagie just wonder what is best practice
11:12 andreykurilin gsagie: oh...I don't know where is a best place for it :)
11:13 andreykurilin gsagie: as a rally core, I'm not against to store it in rally.yaml
11:20 andreykurilin gsagie: btw, you can ping redixin. he added most of the jobs:)
11:23 gsagie andreykurilin: thanks for your help btw, i appreciate it and really like the way Rally is build , i prefer to put it my project repository.
11:24 andreykurilin gsagie: np:) feel free to ping me
11:24 andreykurilin gsagie: so you want to put rally plugin to your repository. right?
11:25 gsagie yes
11:44 andreykurilin gsagie: there are several disadvantages :) A lot of people wants just to clone rally and launch tests. So it will be harder to launch your scenarios by end-users. Also rally team will able to review your plugins and code will be better in terms of rally:)
11:45 andreykurilin gsagie: but I understand that merging changes to rally repo can take more time
11:47 gsagie andreykurilin: yeah thats usualy the main concern, its better to distribute this things :) i think the Neutron team can tell you all about that...
11:48 gsagie However, your point is valid as well, i would like the rally team members to review this code
12:01 andreykurilin gsagie: we will try to help you no matter it will be change in rally or in you repo. But in case of your repo, you will need to ping us:)
12:01 gsagie andreykurilin: thanks, i will see what the other team members think and we will decide, i am currently at exploring mode :)
12:04 andreykurilin gsagie: also, if your plugins will be located in rally code and launched in rally gates(even in experimental), the chance to break it by backward incompatible change is less :D
12:10 e0ne joined #openstack-rally
12:22 Liuqing joined #openstack-rally
12:55 akrzos joined #openstack-rally
12:55 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Neutron] Fix _get_or_create_subnets() return value  https://review.openstack.org/254736
13:08 mwagner_lap joined #openstack-rally
13:11 amaretskiy itzikb_: ping
13:12 itzikb_ amaretskiy: hey
13:12 amaretskiy regarding https://bugs.launchpad.net/rally/+bug/1523417
13:12 openstack Launchpad bug 1523417 in Rally "Running create_and_list_routers task fails: TypeError: string indices must be integers" [Undecided,Triaged] - Assigned to Alexander Maretskiy (maretskiy)
13:12 amaretskiy the scenario is buggy
13:12 amaretskiy try it without `network' context as workaround
13:13 amaretskiy until the bug is fixed
13:13 amaretskiy itzikb_: ^
13:13 itzikb_ amaretskiy: What do you mean without network context ?
13:14 amaretskiy itzikb_: in input yaml file remove line 'network: {}' under `context;
13:15 itzikb_ amaretskiy: oh.ok I'll try that once my setup is ready again.tnx!
13:21 lewo itzikb_, I just tested this workaround and it works
13:22 itzikb_ lewo: Thanks
13:23 itzikb_ amaretskiy: Thanks for updating the bug with the workaround
13:35 jaypipes joined #openstack-rally
13:39 yfried_ joined #openstack-rally
13:42 openstackgerrit Illia Khudoshyn proposed openstack/rally: Prepare for distribured runner, part 1  https://review.openstack.org/251889
13:54 MaxPC1 joined #openstack-rally
13:56 Liuqing joined #openstack-rally
13:58 diogogmt joined #openstack-rally
13:58 openstackgerrit Merged openstack/rally: [Sahara] Fix for Sahara cluster context  https://review.openstack.org/254281
14:04 marcoceppi joined #openstack-rally
14:04 marcoceppi joined #openstack-rally
14:05 rook-desktop joined #openstack-rally
14:06 kambiz is there an example scenario for ensuring a router gets created with an external gateway on a specific external network along with an interface on the rally created network that someone can point me to?
14:07 kambiz (trying to use boot_runcommand_delete using floating ip allocation)
14:11 marcoceppi joined #openstack-rally
14:11 marcoceppi joined #openstack-rally
14:15 openstackgerrit Evgeny Sikachev proposed openstack/rally: [Sahara] Update of EDP tests  https://review.openstack.org/254774
14:22 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Fix] Make create_and_list_routers working with network context  https://review.openstack.org/254776
14:29 openstackgerrit Illia Khudoshyn proposed openstack/rally: Prepare for distribured runner, part 2  https://review.openstack.org/254780
14:33 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
14:40 andreykurilin amaretskiy: Can you answer kambiz question?
14:40 amaretskiy andreykurili, kambiz: hi
14:41 kambiz hello amaretskiy
14:42 amaretskiy kambiz: scenario that you trying (boot_runcommand_delete) does this
14:42 amaretskiy kambiz: use it with network context
14:43 amaretskiy kambiz: in this case network context will create network and the scenario will create and attach floating ip
14:43 kambiz amaretskiy: I thought so, but not sure what to place in the network context to ensure the router that gets created has the correct external gateway set
14:43 kambiz I have multiple external networks.
14:43 kambiz so I was not able to attach the floating IP
14:43 kambiz BadRequest: Unable to associate floating ip 10.8.171.218 to fixed ip 10.2.0.5 for instance 4573ac66-c9d2-4f1b-9d18-2d23a54ecd86. Error: External network 4d7d6ee4-4423-46c8-9e03-8f4ae8869841 is not reachable from subnet 9c7b00a3-8609-403c-9600-78bf51735f40.  Therefore, cannot associate Port 3193b50d-d52e-41f5-bcab-fd2faac3bfe3 with a Floating IP. (HTTP 400) (Request-ID:
14:43 kambiz req-aa4c782c-c29d-4d50-a6c4-19cb9f9c247c)
14:44 amaretskiy kambiz: https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/vm/vmtasks.py#L56
14:44 amaretskiy use_floating_ip=True
14:44 amaretskiy set this kwarg
14:44 kambiz I have that set.
14:44 amaretskiy in task file
14:44 amaretskiy kambiz: make paste with your task input file
14:45 kambiz http://fpaste.org/298600/83941144/
14:45 kambiz which expands to this (as per the results page):  http://fpaste.org/298602/83997144/
14:45 amaretskiy kambiz:  try to remove `floating_network' from args
14:46 openstackgerrit Tom Patzig proposed openstack/rally: Additional argument support for CinderVolumes  https://review.openstack.org/253659
14:46 rook-desktop https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/vm/utils.py#L116
14:46 rook-desktop kosh ^
14:46 rook-desktop kambiz: ^
14:48 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add verify export command  https://review.openstack.org/254797
14:48 kambiz amaretskiy: no dice
14:50 amaretskiy kambiz: does it work now?
14:51 kambiz amaretskiy: sorry .. the expression "no dice" means it didn't work.
14:51 bkopilov joined #openstack-rally
14:51 openstackgerrit Illia Khudoshyn proposed openstack/rally: Prepare for distribured runner, part 2  https://review.openstack.org/254780
14:51 kambiz and as rook-desktop pointed out, if you set use_floating_ip, you also have to set the external_network
14:53 openstackgerrit Evgeny Sikachev proposed openstack/rally: [Sahara] Update of EDP tests  https://review.openstack.org/254774
14:53 amaretskiy kambiz: same error?
14:53 kambiz yes
14:55 amaretskiy kambiz: please report a bug - specify rally version (rally --version), input file, brief environment description and result error
14:55 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add verify export command  https://review.openstack.org/254797
15:09 baker joined #openstack-rally
15:22 arnoldje joined #openstack-rally
15:26 tosky joined #openstack-rally
15:36 diogogmt joined #openstack-rally
15:38 openstackgerrit Evgeny Sikachev proposed openstack/rally: [Sahara] Update of EDP tests  https://review.openstack.org/254774
15:48 ekarlso andreykurilin: rvasilets https://review.openstack.org/#/c/249313/ https://review.openstack.org/#/c/249314/
15:48 ekarlso can we get that merged ?
15:49 openstackgerrit Endre Karlson proposed openstack/rally: Designate V2 support - part 2  https://review.openstack.org/249313
15:50 openstackgerrit Evgeny Sikachev proposed openstack/rally: [Sahara] Added spark and ambari plugins  https://review.openstack.org/254836
15:51 rvasilets ekarlso, now we try to make release as fast as possible. So the fast answer that probably after we cut the release
15:51 rvasilets m/k
15:52 ekarlso rvasilets: uh, not included in the release ?
15:52 ekarlso that sucked -,,-
15:55 rvasilets Note that this is not the last release). Maybe I'm wrong we will talk about it
15:56 ekarlso ;p
15:56 openstackgerrit Yuki Nishiwaki proposed openstack/rally: Add detaied function to rally.api.Task  https://review.openstack.org/253830
15:58 openstackgerrit Yuki Nishiwaki proposed openstack/rally: Add detaied function to rally.api.Task  https://review.openstack.org/253830
15:59 Aish joined #openstack-rally
15:59 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add verify export command  https://review.openstack.org/254797
16:01 openstackgerrit Endre Karlson proposed openstack/rally: Designate V2 - part 3  https://review.openstack.org/249314
16:07 Aish joined #openstack-rally
16:10 openstackgerrit Merged openstack/rally: [Sahara] Remove volumes from non-workers  https://review.openstack.org/253535
16:28 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Reports] Add charts classes for new output format  https://review.openstack.org/254851
16:41 Aish joined #openstack-rally
16:43 boris-42_ joined #openstack-rally
16:47 openstackgerrit joined #openstack-rally
16:53 baker joined #openstack-rally
17:02 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Don't install Tempest when `rally verify [gen/show]config`  https://review.openstack.org/252652
17:21 baker joined #openstack-rally
17:22 stpierre joined #openstack-rally
17:26 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add verify export command  https://review.openstack.org/254797
17:26 _hanhart joined #openstack-rally
17:34 Aish joined #openstack-rally
17:36 stpierre joined #openstack-rally
17:53 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Don't install Tempest when `rally verify [gen/show]config`  https://review.openstack.org/252652
18:00 Aish joined #openstack-rally
18:22 Aish joined #openstack-rally
18:30 madhu_ak joined #openstack-rally
18:39 e0ne joined #openstack-rally
18:40 MaxPC joined #openstack-rally
18:48 pvaneck joined #openstack-rally
18:49 openstackgerrit Chris St. Pierre proposed openstack/rally: Fix format of existing network in _get_or_create_network()  https://review.openstack.org/254903
19:02 openstackgerrit joined #openstack-rally
19:03 madhu_ak_ joined #openstack-rally
19:06 openstackgerrit Chris St. Pierre proposed openstack/rally: Remove excessive quotes in _revert_resize()  https://review.openstack.org/254913
19:08 boris-42_ stpierre: https://review.openstack.org/#/c/254913/ how this worked before OO ?
19:08 stpierre it didn't, we didn't test it in gates afaict
19:11 boris-42_ stpierre: ah i see
19:17 rook joined #openstack-rally
19:20 itzikb_ joined #openstack-rally
19:30 amaretskiy joined #openstack-rally
19:38 harlowja joined #openstack-rally
19:54 dpaterson joined #openstack-rally
19:56 Aish joined #openstack-rally
19:58 smurke joined #openstack-rally
19:59 phd2 joined #openstack-rally
20:02 baker joined #openstack-rally
20:18 itsuugo_ joined #openstack-rally
21:00 MaxPC joined #openstack-rally
21:00 phd2 joined #openstack-rally
21:03 spyderdyne joined #openstack-rally
21:07 baker joined #openstack-rally
21:16 itzikb_ joined #openstack-rally
21:18 stpierre any other cores around who could +2 the two fairly minor bug fixes i put in earlier? thanks
21:20 rook joined #openstack-rally
21:27 phd2 joined #openstack-rally
21:37 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
21:50 boris-42_ stpierre: not sure beasue it is too late for russia=)
21:50 stpierre yeah
21:50 boris-42_ stpierre: and to early for china
22:02 baker_ joined #openstack-rally
22:07 josdotso joined #openstack-rally
22:12 marcoceppi joined #openstack-rally
22:12 marcoceppi joined #openstack-rally
22:22 Aish joined #openstack-rally
22:44 Aish joined #openstack-rally
22:51 phd2 hello everyone
22:51 phd2 how do I run the rally plugins
22:53 stpierre 'rally task start ...' with a task file that includes the plugin(s) that you want to use
22:53 stpierre samples/ has lots of sample task files
22:54 boris-42_ phd2: hi
22:54 boris-42_ phd2: you mean your own plugins ?
22:54 boris-42_ phd2: if so you should properly place them
22:55 boris-42_ phd2: here are some details https://rally.readthedocs.org/en/latest/plugins.html
22:56 phd2 hey thanks guys
22:57 phd2 my own plugins because i want to create a long running job that will test if i can create and keep a router up and running
22:59 boris-42_ phd2: so just write code, place it properly or use rally task start argument that specify plugins paths
23:00 boris-42_ phd2: and write yaml with your plugin
23:05 openstackgerrit Merged openstack/rally: Remove excessive quotes in _revert_resize()  https://review.openstack.org/254913
23:25 phd2 joined #openstack-rally
23:28 rook joined #openstack-rally
23:42 openstackgerrit Merged openstack/rally: Minor change in docstring  https://review.openstack.org/253443
23:44 openstackgerrit Merged openstack/rally: Make disk_format configurable  https://review.openstack.org/253978
23:51 _dpaterson joined #openstack-rally
23:57 baker joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary