Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-09-04

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:22 akrzos joined #openstack-rally
00:37 akrzos joined #openstack-rally
00:56 openstackgerrit Boris Pavlovic proposed openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
01:34 akrzos joined #openstack-rally
01:48 ilbot3 joined #openstack-rally
01:48 Topic for #openstack-rally is now ☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ Review Dashboard: http://goo.gl/YuCJfl ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  boris-42, yfried, msdubov, rediskin, andreykurilin, amaretskiy  ☁ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally:  https://rally.readthedocs.org/en/latest/contribute.html
02:35 akrzos joined #openstack-rally
02:45 kambiz joined #openstack-rally
02:45 puranamr joined #openstack-rally
03:11 openstackgerrit_ joined #openstack-rally
03:21 puranamr joined #openstack-rally
03:31 gus joined #openstack-rally
03:34 flwang1 joined #openstack-rally
03:42 puranamr joined #openstack-rally
04:15 psuriset joined #openstack-rally
04:30 omp_ joined #openstack-rally
04:36 openstackgerrit Boris Pavlovic proposed openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
04:37 openstackgerrit Boris Pavlovic proposed openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
04:40 pvaneck joined #openstack-rally
04:53 psd joined #openstack-rally
05:13 openstackgerrit Boris Pavlovic proposed openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
05:22 puranamr joined #openstack-rally
05:23 rdas joined #openstack-rally
05:25 puranamr_ joined #openstack-rally
05:44 adiantum joined #openstack-rally
05:49 e0ne joined #openstack-rally
05:52 agarciam joined #openstack-rally
05:54 neeti joined #openstack-rally
06:00 openstackgerrit Boris Pavlovic proposed openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
06:48 openstackgerrit Rohan Kanade proposed openstack/rally: Allow non virtual environment option for verify  https://review.openstack.org/220414
07:12 neeti joined #openstack-rally
07:18 arxcruz joined #openstack-rally
07:20 neeti joined #openstack-rally
07:31 anshul joined #openstack-rally
07:34 anshul joined #openstack-rally
07:47 karimb joined #openstack-rally
07:54 e0ne joined #openstack-rally
08:05 neeti joined #openstack-rally
08:12 frobware_ joined #openstack-rally
08:31 cdent joined #openstack-rally
09:01 coolsvap_ joined #openstack-rally
09:08 rdas joined #openstack-rally
09:18 neeti joined #openstack-rally
09:25 tosky joined #openstack-rally
09:50 openstackgerrit Jean-Philippe Braun proposed openstack/rally: Add member role to created users (keystone V2 API)  https://review.openstack.org/220441
09:54 neeti joined #openstack-rally
10:03 neeti joined #openstack-rally
10:15 neeti_ joined #openstack-rally
10:35 kiran-r joined #openstack-rally
10:39 rdas joined #openstack-rally
10:44 karmatronic joined #openstack-rally
10:44 neeti joined #openstack-rally
10:51 neeti joined #openstack-rally
10:55 omp_ joined #openstack-rally
11:04 psuriset joined #openstack-rally
11:18 kiran-r joined #openstack-rally
11:40 _kiran_ joined #openstack-rally
11:44 akrzos joined #openstack-rally
11:50 openstackgerrit Kiran proposed openstack/rally: Add check for neutron extension support in utils  https://review.openstack.org/218151
11:56 redixin joined #openstack-rally
11:59 openstackgerrit Timofey Durakov proposed openstack/rally: DO NOT MERGE  https://review.openstack.org/220473
12:35 stpierre joined #openstack-rally
12:56 omp_ joined #openstack-rally
13:08 coolsvap_ joined #openstack-rally
13:17 MaxPC joined #openstack-rally
13:32 puranamr joined #openstack-rally
13:40 frayedknot joined #openstack-rally
13:44 puranamr joined #openstack-rally
13:54 openstackgerrit Merged openstack/rally: [gates] Convert Rally to the new Devstack plugin model  https://review.openstack.org/184629
13:57 puranamr joined #openstack-rally
14:23 aix joined #openstack-rally
14:26 karimb joined #openstack-rally
14:38 psuriset joined #openstack-rally
14:39 openstackgerrit Boris Pavlovic proposed openstack/rally: Do not remove network from dhcp agent if they are not supported  https://review.openstack.org/219526
15:05 psuriset joined #openstack-rally
15:10 emagana joined #openstack-rally
15:13 nagyz_ hmmm
15:13 nagyz_ so let's say I have a task that I like. is there a way to merge consequtive runs' outputs into a single html output?
15:13 nagyz_ I'd like to run the same task again and again let's say every 30 minutes
15:13 nagyz_ and plot the changes
15:24 karimb joined #openstack-rally
15:27 puranamr joined #openstack-rally
15:36 baker joined #openstack-rally
15:37 openstackgerrit Illia Khudoshyn proposed openstack/rally: Add task format converter  https://review.openstack.org/211160
15:58 frayedknot joined #openstack-rally
16:00 frayedknot joined #openstack-rally
16:01 psuriset joined #openstack-rally
16:35 kiran-r joined #openstack-rally
16:41 davideagnello joined #openstack-rally
16:41 _afazekas joined #openstack-rally
16:46 openstackgerrit Chris St. Pierre proposed openstack/rally: Nova: Support auto_assign_nic when booting multiple servers  https://review.openstack.org/219855
16:48 afazekas joined #openstack-rally
17:02 openstackgerrit_ joined #openstack-rally
17:05 MaxPC joined #openstack-rally
17:09 exploreshaifali joined #openstack-rally
17:11 afazekas joined #openstack-rally
17:12 puranamr joined #openstack-rally
17:15 tosky joined #openstack-rally
17:18 _afazekas joined #openstack-rally
17:22 madhu_ak joined #openstack-rally
17:47 pvaneck joined #openstack-rally
17:54 omp_ joined #openstack-rally
18:02 puranamr joined #openstack-rally
18:14 frayedknot joined #openstack-rally
18:21 kiran-r joined #openstack-rally
18:22 akrzos joined #openstack-rally
18:26 omp_ joined #openstack-rally
18:27 psd joined #openstack-rally
18:29 e0ne joined #openstack-rally
18:32 openstackgerrit Chris St. Pierre proposed openstack/rally: Fix users/tenants in Neutron job and sample tasks  https://review.openstack.org/218859
18:44 madhu_ak hi folks, anyone have trouble in setting up rally service while installing devstack?
18:45 madhu_ak okay, found to be some issue with keystone I guess..
19:02 mpopow joined #openstack-rally
19:03 e0ne joined #openstack-rally
19:11 madhu_ak error for your reference: http://paste.openstack.org/show/445708/
19:35 stpierre BENHCMARK_TENANT= looks like a typo
19:37 stpierre madhu_ak: can you paste a few lines before that, too? it looks like ADMIN_USER/ADMIN_ROLE aren't getting properly populated either
19:37 stpierre incidentally, BENHCMARK_TENANT is a typo, but a consistent one
19:37 stpierre ah, nm, presumably the few lines before that also have Authorization Failed: The resource could not be found. (HTTP 404)
19:41 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/219502
19:50 jalphonso joined #openstack-rally
19:52 madhu_ak stpierre: let me post some for you
19:53 madhu_ak stpierre: http://paste.openstack.org/show/445744/
19:54 stpierre yeah, no idea why it can't run keystone there
19:54 jalphonso Is rally supported with nova-network still or have things more or less migrated over to neutron?  The reason I ask is I'm noticing different behavior when I use existing networks with rally vs specifying the network context and having rally create the networks.  The former works fine while the latter creates the network and then never creates the VM.  rally says "The resource could not be found" and in the nova logs on both the controller and
19:54 stpierre jalphonso: it still works great with nova-network.
19:55 stpierre madhu_ak: if you can, i'd recommend just avoiding the devstack integration bits and setting up rally separately after you've installed devstack. devstack is fragile enough without introducing more bits into it
19:55 jalphonso I'm using the VMTasks.boot_runcommand_delete scenario with OpenStack Juno nova-network and having issues when I let rally create the network as described above
19:57 stpierre jalphonso: you cut off at "in the nova logs on both the controller and t"
19:57 jalphonso oh ok
19:58 jalphonso rally says "The resource could not be found" and in the nova logs on both the controller and the compute I see it says "NoNetworksFound" despite the network being successfully created by rally.  Am I missing something?  Is there a way to get rally to create and use the networks with nova-network?
19:59 stpierre i think i've seen the same thing, but my solution was just to not do that :)
19:59 jalphonso lol, so pre-create?
20:01 jalphonso that brings up another issue then.  So if use existing networks and lets say I've pre-created 4K of them, rally takes a long time (5mins or so) to setup and cleanup.  When running the "rally -vd task start" I see that it is traversing through the entire list of networks at both setup and cleanup which accounts for the delay.
20:02 stpierre 4,000 is a lot of networks
20:02 stpierre our test lab is pretty small stuff, so you're working at a bigger scale than i have.
20:03 jalphonso it is. but i'm focusing on network testing.  is there a reason rally has to read through the whole list twice or at all?
20:04 boris-42 joined #openstack-rally
20:04 openstackgerrit_ joined #openstack-rally
20:04 jalphonso stpierre: thank you for your input.  are you one of the rally devs?  If not, I'm interested if any of the devs can comment. I'd like to find a more elegant way to accomplish my testing.
20:05 boris-42 jalphonso: hi there
20:05 stpierre it traverses it looking for networks whose name starts with "rally_novanet", which is what all rally-created networks should start with
20:05 jalphonso boris-42: hi boris.
20:06 stpierre although that should only happen at cleanup AIUI
20:07 boris-42 nagyz_: pign
20:07 boris-42 nagyz_: you can put any amount of uuids in rally task report
20:07 boris-42 nagyz_: that will create single report from all those results*
20:08 boris-42 madhu_ak: it should be fixed *
20:08 boris-42 madhu_ak: I hope I fixed issues yestarday&
20:08 boris-42 stpierre: ^
20:09 boris-42 stpierre: yestarday was terrible day our gates were broken in multiple ways-)
20:10 stpierre it was a day that ended in "y"
20:10 madhu_ak boris-42: oh, I just pulled master branch and ran them.. need to remove rally conf in /etc and run from scratch?
20:10 boris-42 madhu_ak: master branch of what?
20:11 madhu_ak devstack, with enable_service rally in local.conf
20:12 boris-42 madhu_ak: so I would suggest to use clean vm and start evertyhing from begging
20:12 boris-42 madhu_ak: or make sure that opt/stack is purged
20:12 madhu_ak yep, I removed /opt/stack, it didnt help. clean vm should be the best option
20:13 madhu_ak trying one more time
20:13 madhu_ak boris-42,
20:13 boris-42 stpierre: sooo
20:13 boris-42 stpierre: seems like gates are not in the best condition even now
20:14 boris-42 stpierre: something changed in nova and it is failing
20:14 stpierre hah, i got a bunch of stuff to pass earlier today -- i must have hit the timing just right
20:14 stpierre quick, +2 it all!
20:15 openstackgerrit Chris St. Pierre proposed openstack/rally: Use network context for Neutron scenarios  https://review.openstack.org/210612
20:15 boris-42 stpierre: =)))
20:16 boris-42 stpierre: this sounds bad http://logs.openstack.org/26/219526/4/check/gate-rally-dsvm-rally-nova/8aa9acf/rally-plot/results.html.gz#/
20:16 stpierre oh ffs
20:17 rmschn joined #openstack-rally
20:17 stpierre i bet they did s/tenant_id/project_id/ or something
20:17 stpierre api microversions should make it possible to work around that, but ffs
20:17 vichoward joined #openstack-rally
20:19 madhu_ak even removing /opt/stack didnt help. so, I shall install rally seperately
20:20 boris-42 stpierre: I am not sure whatever we should fix this before doing merges of everything
20:26 psuriset joined #openstack-rally
20:28 boris-42 madhu_ak: i belive it may be a rally bug
20:28 boris-42 madhu_ak: please report a bug
20:29 MaxPC joined #openstack-rally
20:29 madhu_ak boris-42: thanks. will do now
20:29 madhu_ak so it will be useful to get comments from community in that bug
20:33 aix boris-42, hey, again a question about multiscenarios with new rally task format. Would it be possible to run multiple scenarios in serial with the same resources (instance, volume, user, ..)?
20:33 boris-42 aix: yes
20:34 aix boris-42, this is targeted for 0.2.0 as well?
20:34 boris-42 aix: yep
20:34 aix boris-42, very nice :), thanks
20:35 boris-42 aix: actually serail implementation will be first
20:36 aix boris-42, even better:)
20:36 madhu_ak boris-42, as suggested: https://bugs.launchpad.net/rally/+bug/1492451
20:36 openstack Launchpad bug 1492451 in Rally "installing devstack with rally plugin fails" [Undecided,New]
20:38 boris-42 madhu_ak: seems like something is bad with rally
20:38 boris-42 madhu_ak: that you are using
20:38 boris-42 madhu_ak: e.g. it has old cached version
20:39 boris-42 madhu_ak: you see this patch is merged https://review.openstack.org/#/c/184629/19/devstack/lib/rally
20:39 madhu_ak I just procceeded with the same way I installed yesterday...so ended up like that :( boris-42
20:39 boris-42 madhu_ak: and if fixes exactly this
20:39 boris-42 madhu_ak: you see there is no more lines https://review.openstack.org/#/c/184629/19/devstack/lib/rally that are executed
20:40 boris-42 madhu_ak: in your case
20:40 boris-42 madhu_ak: they were removed from master*
20:40 madhu_ak I see.
20:40 madhu_ak so I should give it a try once more?
20:40 madhu_ak or what would be your suggestion to install?
20:41 boris-42 madhu_ak: so I don't know why you are fetching old version of rally
20:41 boris-42 madhu_ak: (devstack is fetching)
20:41 madhu_ak heh, yeah. but in local.conf, enable_service rally should be fine?
20:41 madhu_ak or do I need to fetch rally repo before I run ./stack.sh?
20:42 boris-42 madhu_ak: nope you don't need to fetch rally repo
20:42 madhu_ak thats the point
20:42 boris-42 madhu_ak: did you run second time on clear VM?
20:42 madhu_ak u meant, after ./clean.sh and stack.sh?
20:43 boris-42 madhu_ak: no I mean did you create a new VM
20:43 puranamr joined #openstack-rally
20:43 boris-42 madhu_ak: and do in clear env git clone ...devstack
20:43 boris-42 madhu_ak: ./stack.sh
20:43 madhu_ak nope.. let me do spin up a new cloud instance and run then
20:47 jalphonso left #openstack-rally
20:47 openstackgerrit_ joined #openstack-rally
20:48 boris-42 madhu_ak: yep
20:48 madhu_ak boris-42 trying out in a machine where it doesn't have rally installed
20:48 boris-42 madhu_ak: I belive the issue is that rally is cached somethwer
20:48 madhu_ak I second that
20:48 openstackgerrit_ joined #openstack-rally
20:51 boris-42 stpierre: so we need to spend some time on fixing gates
20:51 boris-42 stannie: terrible amount of scenarios is failing constantly..
20:51 boris-42 stannie: sorry*
20:51 boris-42 stpierre: so take a look at this BadRequest: Invalid input for field/attribute 0. Value: {u'boot_index': 0, u'uuid': u'a6d19bbb-50df-46a6-91b1-cdbdf324a9a2', u'device_name': u'vdrally', u'source_type': u'', u'volume_id': u'a6d19bbb-50df-46a6-91b1-cdbdf324a9a2', u'delete_on_termination': u'1'}. Additional properties are not allowed (u'source_type',
20:51 boris-42 u'boot_index', u'uuid' were unexpected) (HTTP 400) (Request-ID: req-449bda60-aede-4480-b65c-4629db811ed6)
20:52 boris-42 stpierre: http://logs.openstack.org/11/210611/7/check/gate-rally-dsvm-rally-nova/27e09d0/rally-plot/results.html.gz#/VMTasks.boot_runcommand_delete-2/failures
21:01 frobware joined #openstack-rally
21:01 frobware joined #openstack-rally
21:06 puranamr joined #openstack-rally
21:06 davideag_ joined #openstack-rally
21:08 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/219502
21:12 lutostag joined #openstack-rally
21:15 madhu_ak joined #openstack-rally
21:15 lutostag joined #openstack-rally
21:17 lutostag joined #openstack-rally
21:20 lutostag_ joined #openstack-rally
21:21 lutostag_ joined #openstack-rally
21:22 pvaneck joined #openstack-rally
21:22 karimb joined #openstack-rally
21:26 lutostag joined #openstack-rally
21:27 adiantum joined #openstack-rally
21:30 lutostag joined #openstack-rally
21:33 madhu_ak boris-42 now, rally itself is not being cloned at all, but the devstack suceeded. I dont find rally in /opt/stack/
21:34 boris-42 madhu_ak: opt/stack/new/rally
21:34 madhu_ak boris-42 :(
21:35 boris-42 madhu_ak: did you enable rally?
21:35 boris-42 madhu_ak: in devstack?
21:35 madhu_ak yeah
21:36 madhu_ak if you get time, could you try in your setup ?
21:44 madhu_ak boris-42: the bst guess would be keystone failure
21:44 madhu_ak best*
21:48 openstackgerrit Merged openstack/rally: Fix argument name in Murano context  https://review.openstack.org/219670
21:53 boris-42 madhu_ak: so we are running this against each patch in each dsvm job
21:53 boris-42 madhu_ak: so hm it should work...
21:56 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/219502
22:18 karimb joined #openstack-rally
22:29 nagyz_ boris-42, rally task report uuid1 uuid2 ... uuidn --out index.html doesn't work
22:30 nagyz_ ok I actually need to add --tasks
22:31 e0ne joined #openstack-rally
22:31 nagyz_ but that doesn't seem to give me one or two nice charts summing it all up but lists each individual scenario
22:31 nagyz_ it's still better than nothing, of course
22:36 aix boris-42, wrt nagyz_ use case, I read in docs, Scenario runners about periodic mode which should allow me to run runs with some intervals between them.
22:36 boris-42 nagyz_: it supouse to do that
22:36 boris-42 nagyz_: just combine all together
22:37 boris-42 nagyz_: it doesn't do trends
22:37 aix boris-42, but couldn't find anything like that implemented in runners, maybe just missed it..or was it removed not implemented?
22:37 boris-42 aix: it's called rps
22:38 aix boris-42, hm, let me check
22:42 aix boris-42, I can specify how many interations to execute per second only? or am I able to specify per defined time? i.e. N interations per 30mins?
22:43 boris-42 aix: you have only 2 arguments that you can specify
22:43 boris-42 aix: rps and times
22:43 boris-42 aix: rps means amount of sceanrio per second to run
22:43 boris-42 aix: times amount of iteration to run
22:44 boris-42 aix: so you need to put in rps = N / (30 * 60)
22:44 boris-42 aix: to get N iteration per 30 mins
22:45 aix boris-42, yes, I assumed that wouldn't work, but I need to try :)
22:45 boris-42 aix: why it wouldn't work?
22:58 aix boris-42, honestly I don't know, need to go through code more carefully, most likely wrong assumption
23:00 openstackgerrit Merged openstack/rally: Fix typos in Rally code  https://review.openstack.org/219904
23:09 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/219502
23:11 boris-42 aix: so I mean rps is runner that you are interesting in
23:11 boris-42 aix: you can specify float rps value if you need iteration more rare then in 1 second
23:12 boris-42 aix: btw soon rally plugin reference will be ready
23:12 boris-42 aix: http://docs-draft.openstack.org/74/218874/1/check/gate-rally-docs/c2ebab1//doc/build/html/plugin_reference.html#plugin-reference

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary