Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-12-09

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:09 Aish joined #openstack-rally
00:18 phd2 Hey any idea why the Nova tests don’t show up in the reports?
00:18 stpierre if you ran them, they should show up
00:18 stpierre there were nova scenarios listed in your task file, but they aren't in the HTML report?
00:19 phd2 yeah
00:19 phd2 i am running them out of
00:20 stpierre can you pastebin your task file?
00:20 stpierre and the command you're using to start the task
00:20 phd2 yeah give me a sec
00:20 phd2 I am running them out of scenarios/nova/
00:22 phd2 http://pastebin.com/LTk3nkwj
00:22 phd2 that should work right?
00:23 stpierre that will run each one as a separate task
00:23 stpierre so when you get the report at the end, it will only get the report for the last task you run
00:24 phd2 no I am gnerating all the task like this
00:24 phd2 rally task report --html --out reports/report1-$UNIQUEDATE.html --tasks `rally task list --uuids-only  | tr '\n' ' '`
00:24 stpierre and every report is empty?
00:24 phd2 no i see
00:25 phd2 No I see CinderVolumes, GlanceImages, HeatStacks, KeystoneBasic and VMTasks on the left side
00:25 madhu_ak_ joined #openstack-rally
00:25 phd2 and they all have tests but none for nova
00:26 stpierre with the task list you posted, you shouldn't see anything but NovaServers
00:27 phd2 yes but hmmm
00:27 phd2 let me try it again
00:28 stpierre instead of firing off a zillion different tasks, it'd probably be simpler to create a single task file with all of those subtasks in it and just run one task
00:29 phd2 yeah true
00:29 phd2 maybe that is what I should do next
00:29 phd2 Love what you guys have done with Tempest and how easy it is to run
00:29 boris-42_ phd2: it is done already
00:30 boris-42_ phd2: https://github.com/openstack/rally/tree/master/certification/openstack
00:33 phd2 boris-42_: what is this certificaiton?
00:37 boris-42_ phd2: all-in-one task
00:37 stpierre phd2: it certifies that your cloud runs. there's no Official Certificate of Certification or anything
00:37 boris-42_ phd2: so you don't need to use samples a have zillions of files and do combined reports
00:38 adiantum joined #openstack-rally
00:47 phd2 joined #openstack-rally
00:49 phd2 omg that is awesome
00:49 phd2 i love you guys!
00:50 Aish joined #openstack-rally
00:52 openstackstatus joined #openstack-rally
00:53 openstack joined #openstack-rally
00:56 boris-42_ phd2: so it still in progress
00:56 boris-42_ phd2: so I would recommend to run it in smoke mode always
00:56 boris-42_ phd2: however you can help us to write proper formulas for load
00:56 boris-42_ phd2: that depends on size of cloud
00:56 phd2 boris-42_: Loads for a cloud are very difficult since there are various parameters
00:57 boris-42_ phd2: yep
00:57 phd2 boris-42_: something like a cross porduct of cpu x memory x network x storage x security
00:57 boris-42_ phd2: so we need to pick proper parameters
00:57 boris-42_ phd2: and proper formulas
00:57 boris-42_ phd2: based on this parameters
00:57 phd2 yes that is true
00:57 phd2 but very tough
00:57 boris-42_ phd2: so we started work on it
00:58 phd2 is there a smoke mode?
00:58 boris-42_ phd2: it's by default
00:58 boris-42_ phd2: open task-args.yaml
00:59 phd2 wht does smoke = true do?
01:04 stpierre smoke=1 runs everything only once instead of doing multiple iterations
01:04 stpierre i guess smoke=true works
01:07 boris-42_ stpierre: phd2 if smoke is enabled 1 or true
01:07 boris-42_ stpierre: phd2 it runs 1 iteration with 1 concurrency
01:07 boris-42_ stpierre: phd2 so it looks like smoke test
01:08 stpierre boris-42_: it's been a while since i looked at the certification stuff in any depth, you've damn near invented your own DSL for defining rally tasks here :)
01:10 boris-42_ stpierre: it's just jinja2 template
01:11 boris-42_ stpierre: jinjga2 template + arguments of jinja2 tempalte
01:11 stpierre i know, but there are a bunch of macros and stuff
01:11 boris-42_ stpierre: just to avoid code duplications=)
01:11 stpierre it's scarcely even yaml any more
01:12 chenli joined #openstack-rally
01:12 boris-42_ stpierre: at the end of jinja2 rendering magically it will become valid plain yaml =)
01:12 boris-42_ however it's way better then implementing own DSL
01:16 yingjun joined #openstack-rally
01:21 diogogmt joined #openstack-rally
01:44 phd2 hey guys runnign into an issue here
01:44 phd2 Subtask CinderVolumes.create_and_attach_volume[0] has wrong configuration\Subtask configuration:
01:44 phd2 {'runner': {'type': 'constant', 'concurrency': 1, 'times': 1}, 'args': {'flavor': {'name': 'm1.tiny'}, 'image': {'name': '^(cirros.*uec|TestVM)$'}, 'size': 1}, 'sla': {'failure_rate': {'max': 0}}, 'context': {'users': {'users_per_tenant': 1, 'tenants': 1}, 'quotas': {'cinder': {'gigabytes': -1, 'volumes': -1, 'snapshots': -1}}}, 'name': 'CinderVolumes.create_and_attach_volume'}
01:44 phd2 Reason:
01:44 phd2 Invalid scenario argument: ''min_ram''`
01:44 phd2 what is this min_ram buisiness and why are we running into it
01:45 stpierre_ joined #openstack-rally
01:48 Liuqing joined #openstack-rally
01:48 boris-42_ phd2: it's one of scenarios
01:48 boris-42_ CinderVolumes.create_and_attach_volume[
01:51 phd2 yeah i see it
01:51 phd2 but why does it see zero
01:52 phd2 ok got rid of the lines :)
01:53 phd2 nope same error
01:56 stpierre_ oh, i hit this the other day
01:56 stpierre trying to remember how i fixed it
01:57 phd2 can you do a git diff ?
01:57 phd2 and see if you can find out what the code was?
01:57 stpierre i don't think i fixed it in code
01:58 openstackgerrit Merged openstack/rally: Make param description & LogInfo better  https://review.openstack.org/252759
02:00 phd2 how did you fix it again?
02:00 boris-42_ phd2: nop that line
02:00 boris-42_ phd2: so I don't know why that doesn't work
02:00 phd2 you mean this call min_ram
02:00 boris-42_ phd2: seems wired
02:01 phd2 you mean this one right  CinderVolumes.create_and_attach_volume
02:01 stpierre istr that it was something with the image we were trying to boot from, but i could be wrong
02:02 phd2 naa didn’t work
02:03 phd2 new failiure  NovaServers.snapshot_server
02:06 phd2 so i am just deleteing those tests?
02:09 boris-42_ phd2: heh it will be better to find the root issue
02:09 boris-42_ let me try to debug
02:09 phd2 ok
02:11 bochi-michael joined #openstack-rally
02:15 phd2 any ideas
02:18 phd2 guys?
02:28 boris-42_ phd2:  oh I broke my vm
02:28 boris-42_ need some more time
02:28 phd2 haha
02:28 phd2 ok :)
02:28 phd2 what did you do
02:28 phd2 thanks so much
02:28 Aish joined #openstack-rally
02:28 phd2 i am going to go home in about 30 mins so you got some time
02:31 boris-42_ phd2: just be online in irc
02:31 boris-42_ phd2: we will find some solution
02:31 phd2 might not be for 3 more hours
02:31 phd2 I am on PST
02:33 phd2 so it wil be late
02:33 boris-42_ phd2: i am as well
02:33 boris-42_ =)
02:33 phd2 ok great then see you this evening
02:35 boris-42_ phd2: so
02:35 boris-42_ phd2:  I tested
02:36 boris-42_ phd2:  rally task validate task.yaml --task-args-file ./task_arguments.yaml
02:36 boris-42_ Task syntax is correct :)
02:36 boris-42_ Task config is valid :)
02:36 boris-42_ so seems like it works for me
02:36 boris-42_ what arguments are you putting ?
02:36 boris-42_ phd2: ^
02:40 phd2 ok let me check
02:41 phd2 top of tree at 7b3fe80d42609f74caba2dabcde0c6560a3ddb44 what every task_argument.yaml is
02:42 phd2 where does min_ram come from
02:50 phd2 ok i am heading home!
02:53 phd2 maybe there is a good readon
02:53 phd2 reason
02:53 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
02:56 baker joined #openstack-rally
02:59 openstackgerrit Merged openstack/rally: [Sahara] Added spark and ambari plugins  https://review.openstack.org/254836
03:10 akrzos joined #openstack-rally
03:48 rook joined #openstack-rally
03:59 arnoldje joined #openstack-rally
04:03 stpierre joined #openstack-rally
04:05 yingjun joined #openstack-rally
04:08 stpierre joined #openstack-rally
04:20 openstackgerrit Merged openstack/rally: [Neutron] Fix _get_or_create_subnets() return value  https://review.openstack.org/254736
04:20 akrzos joined #openstack-rally
04:21 openstackgerrit Merged openstack/rally: Fix format of existing network in _get_or_create_network()  https://review.openstack.org/254903
04:25 Aish joined #openstack-rally
04:48 tfreger joined #openstack-rally
04:49 chenli joined #openstack-rally
05:06 shausy joined #openstack-rally
05:11 rdas joined #openstack-rally
05:32 tfreger joined #openstack-rally
05:44 shausy joined #openstack-rally
05:52 rook joined #openstack-rally
05:59 yingjun joined #openstack-rally
06:15 chenli hello, when  i set up context for rally test, can I set role for users rally create ?
06:16 itzikb_ joined #openstack-rally
06:31 jaypipes joined #openstack-rally
06:50 shausy joined #openstack-rally
07:02 itzikb joined #openstack-rally
07:07 itzikb_ joined #openstack-rally
07:10 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
07:20 rcernin joined #openstack-rally
07:31 boris-42_ joined #openstack-rally
07:35 neeti joined #openstack-rally
07:52 e0ne joined #openstack-rally
07:52 rook joined #openstack-rally
08:00 openstackgerrit Evgeny Sikachev proposed openstack/rally: [Sahara] Update of EDP samples  https://review.openstack.org/254774
08:00 yfried_ joined #openstack-rally
08:04 anshul joined #openstack-rally
08:12 rdas joined #openstack-rally
08:19 yingjun joined #openstack-rally
08:22 psd joined #openstack-rally
08:25 tosky joined #openstack-rally
08:33 yfried joined #openstack-rally
08:45 adiantum joined #openstack-rally
08:47 arxcruz joined #openstack-rally
08:58 tosky_ joined #openstack-rally
09:04 lezbar joined #openstack-rally
09:07 openstackstatus joined #openstack-rally
09:09 openstack joined #openstack-rally
09:13 yfried joined #openstack-rally
09:17 yingjun joined #openstack-rally
09:29 shausy joined #openstack-rally
09:32 openstackgerrit joined #openstack-rally
09:42 shausy joined #openstack-rally
09:53 rdas joined #openstack-rally
09:56 rook joined #openstack-rally
10:03 openstackgerrit joined #openstack-rally
10:10 e0ne joined #openstack-rally
10:20 aix joined #openstack-rally
10:37 MaxPC joined #openstack-rally
11:08 ekarlso rvasilets: why do you mean https://review.openstack.org/#/c/249313/5/rally/plugins/openstack/context/designate/zones.py should inherit from the utils too ?
11:09 rvasilets ekarlso, look at other contexts
11:10 rvasilets we use such a way
11:10 ekarlso rvasilets: ehhh, I looked at the cinder one
11:10 ekarlso that does not do it like that
11:10 ekarlso neither does murano
11:11 ekarlso https://github.com/openstack/rally/blob/master/rally/plugins/openstack/context/murano/murano_packages.py#L35 < rvasilets
11:12 rvasilets ekarlso, yes looks like our contexts a bit inconsistent
11:12 ekarlso rvasilets: then why do I get a -1 ?
11:12 ekarlso :p
11:13 rvasilets ekarlso, so ok. Lets left this part
11:13 ekarlso : o
11:14 aix joined #openstack-rally
11:14 rvasilets because there are other comments there)
11:15 openstackgerrit Endre Karlson proposed openstack/rally: Designate V2 support - part 2  https://review.openstack.org/249313
11:15 rvasilets about order, docs and its not used anywhere
11:16 rvasilets
11:16 rvasilets Roman Vasilets12:20 AM
11:16 rvasilets Lets move generating name inside _create_zone if we not pass the name
11:16 rvasilets we not tolked about that
11:17 rvasilets and add usage of this context to the patch
11:17 ekarlso rvasilets: sorry ?
11:18 rvasilets You add context yes?
11:18 ekarlso rvasilets: yeah ?
11:18 rvasilets Is it uses somehow?
11:18 rvasilets шы ше еуыеув шт пфеуы?
11:19 rvasilets is it tested in gates?
11:19 ekarlso rvasilets: eh, ref your earlier comments you wanted the context to be added in a seperate patch from the scenario... *sigh*
11:21 ekarlso so since that I added the context stuff to a seperate patch from the scenarios that didnt need them and a seperate patch for scenarios that needs them ref *part 3*
11:22 rvasilets <ekarlso> rvasilets: yeah ? <== Why you ask me. Its fact. You tried to add context. It should be tested on gates. You didn't tested it. To make this. You need to add new task to the rally-designate.yaml for example this scenario with zone context https://github.com/openstack/rally/blob/master/rally-jobs/rally-designate.yaml#L146
11:23 ekarlso rvasilets: dude: https://review.openstack.org/#/c/249314/ < it's used there ..
11:23 ekarlso dare you saying I need to test it a different way ?
11:24 ekarlso s/dare/are
11:24 rvasilets I wrote that changes that add in the patch should be tested in the same patch
11:24 ekarlso rvasilets: eh, it is tested with unit tests ?
11:25 rvasilets ekarlso, and no. Zone context not used anywhere in rally-designate.yaml https://review.openstack.org/#/c/249314/4/rally-jobs/rally-designate.yaml
11:27 ekarlso rvasilets: hmms, think I've misunderstood, but which scenario could I add that takes a zone context ?
11:27 rvasilets ekarlso, could you give me proper link with exact line where we tests zone context?
11:27 ekarlso the ones that need the zone context are in the part 3
11:27 ekarlso I have forgot to add them there yet but https://review.openstack.org/#/c/249314/4/rally-jobs/rally-designate.yaml < ref your comments there
11:29 ekarlso rvasilets: is that enough ?
11:30 rvasilets just add http://paste.openstack.org/show/481298/ to the end of the rally-designate.yaml
11:31 ekarlso ok :)
11:31 rvasilets ekarlso, to the patch with context adding
11:31 ekarlso rvasilets: sure!
11:31 rvasilets )
11:32 rvasilets and don't forget small issues)
11:39 itzikb joined #openstack-rally
12:00 ekarlso rvasilets: hmmm getting a error http://pastebin.com/admz5f8s when doing tox -epy27
12:01 ekarlso rvasilets: u got a idea on that ?
12:02 rvasilets ekarlso, I need to think or debug. Try to debug test by yourself. Looks to you utils pass something strange
12:03 rvasilets If you wouldn't solve it I wil take a look one more
12:03 rvasilets I believe you can)
12:28 openstackgerrit Endre Karlson proposed openstack/rally: Designate V2 support - part 2  https://review.openstack.org/249313
12:28 ekarlso ^ rvasilets
12:30 rvasilets ekarlso, https://review.openstack.org/#/c/249313/7/rally/plugins/openstack/context/designate/zones.py in the line 56. Could you hide generate into _create...
12:30 rvasilets I will review it later
12:31 ekarlso rvasilets: eh, I dunno what you mean by hiding but, it's similar to what Cinder does..
12:32 rvasilets 1)delete line 56 2) add 56th line inside _create_zone
12:33 rvasilets therefore line 57 would be look like designate_util._create_zone()
12:33 rvasilets ekarlso, ^
12:34 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Scenario] New output schema  https://review.openstack.org/254261
12:35 ekarlso rvasilets: also adding the stuff you said to rally-designate.yaml blows up tests :(
12:36 ekarlso http://pastebin.com/n8yz1J7r
12:40 rvasilets obviously you made wrong yaml. How? - I don't know. I don't see it. Maybe something with charset or identation
12:41 akrzos joined #openstack-rally
12:44 ekarlso rvasilets: ref http://paste.openstack.org/show/481298/ doesnt that need to go under a scenario
12:45 rvasilets Don't do just copy paste
12:46 rvasilets similar workload item(with usage of context should be added to the task. I showed to you an example
12:47 abalutoiu joined #openstack-rally
12:47 ekarlso ok ok ;p
12:49 ekarlso rvasilets: should I squash part 2 and 3 together sicne part 3 requires the context whilst the other scenarios does not ?
12:50 openstackgerrit Nikita Konovalov proposed openstack/rally: [Sahara] Improved flavor paramter for clusters  https://review.openstack.org/255243
12:53 gsagie joined #openstack-rally
12:53 rvasilets No if you do like I suggest
12:53 ekarlso yeah, I did that but the scenario doesn't require the context though
13:02 openstackgerrit Endre Karlson proposed openstack/rally: Designate V2 support - part 2  https://review.openstack.org/249313
13:05 Liuqing joined #openstack-rally
13:06 openstackgerrit Merged openstack/rally: [StreamingAlgorithms] Unify exception type raised by result()  https://review.openstack.org/254302
13:08 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Don't install Tempest when `rally verify [gen/show]config`  https://review.openstack.org/252652
13:14 tfreger joined #openstack-rally
13:18 openstackgerrit Nikita Konovalov proposed openstack/rally: [Sahara] Improved flavor paramter for clusters  https://review.openstack.org/255243
13:37 gsagie joined #openstack-rally
13:39 bkopilov joined #openstack-rally
13:40 arnoldje joined #openstack-rally
13:42 diogogmt joined #openstack-rally
13:51 openstackgerrit Illia Khudoshyn proposed openstack/rally: Prepare for distribured runner, part 1  https://review.openstack.org/251889
13:52 openstackgerrit Illia Khudoshyn proposed openstack/rally: Prepare for distribured runner, part 2  https://review.openstack.org/254780
13:57 baker joined #openstack-rally
13:58 dpaterson joined #openstack-rally
14:01 logan- joined #openstack-rally
14:06 _dpaterson joined #openstack-rally
14:26 diogogmt joined #openstack-rally
14:26 openstackgerrit Roman Vasilets proposed openstack/rally: [WIP]Add verify export command  https://review.openstack.org/254797
14:47 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Scenario] Switch to new scenario output format schema  https://review.openstack.org/255293
15:19 openstackgerrit Roman Vasilets proposed openstack/rally: Fix bug in Dockerfile with docs, samples, certification  https://review.openstack.org/254671
15:25 diogogmt joined #openstack-rally
15:38 ekarlso rcernin: so why did this fail ? https://review.openstack.org/#/c/249313/
15:51 arnoldje joined #openstack-rally
15:53 openstackgerrit Roman Vasilets proposed openstack/rally: Change rps value from min to max with step  https://review.openstack.org/234195
15:56 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Scenario] Add method `add_output'  https://review.openstack.org/255336
16:02 spyderdyne joined #openstack-rally
16:04 lezbar joined #openstack-rally
16:19 dpaterson joined #openstack-rally
16:51 openstackgerrit Sergey Skripnick proposed openstack/rally: [do-not-merge] Add network context to scenarios using _create_network_structure  https://review.openstack.org/255373
16:53 tfreger joined #openstack-rally
16:54 FatDarrel joined #openstack-rally
16:56 stpierre joined #openstack-rally
16:58 stpierre joined #openstack-rally
17:08 diogogmt joined #openstack-rally
17:11 openstackgerrit Kun Huang proposed openstack/rally: [WIP] remove usage of wait_for  https://review.openstack.org/255384
17:13 diogogmt_ joined #openstack-rally
17:18 FatDarrel hello
17:18 FatDarrel is Boris around
17:23 tosky joined #openstack-rally
17:49 FatDarrel joined #openstack-rally
18:04 yfried joined #openstack-rally
18:07 psd joined #openstack-rally
18:09 openstackgerrit Kun Huang proposed openstack/rally: Remove usage of wait_for  https://review.openstack.org/255384
18:10 stpierre joined #openstack-rally
18:18 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/253000
18:41 ekarlso andreykurilin: you got a clue on https://review.openstack.org/#/c/249313/?
18:43 pvaneck joined #openstack-rally
19:15 e0ne joined #openstack-rally
19:25 FatDarrel joined #openstack-rally
19:27 phd2 joined #openstack-rally
19:27 phd2 boris-42_:
19:27 phd2 you around?
20:13 kevinbenton_ joined #openstack-rally
20:14 kevinbenton joined #openstack-rally
20:20 Aish joined #openstack-rally
20:31 madhu_ak joined #openstack-rally
20:53 phd2 joined #openstack-rally
20:56 dpaterson joined #openstack-rally
21:10 phd2 helloanyone here
21:12 madhu_ak_ joined #openstack-rally
21:14 meteorfox joined #openstack-rally
21:21 stpierre phd2: just ask your question and anyone who is here and can answer will do so
21:24 phd2 ok here ti goes
21:36 phd2 http://pastebin.com/aaHF4D7d
21:37 phd2 rally task validate task.yaml --task-args-file task_arguments.yaml fails with this
21:37 phd2 2015-12-09 13:31:13.815 26878 ERROR rally.task.scenario KeyError: 'min_ram'
21:42 phd2 yeah so  stpierre saw it and he figured it out but he forgot
21:42 phd2 stpierre: you around?
21:43 stpierre yeah
21:43 phd2 so you remember how you figured that min_ram error issue
21:45 stpierre nope
21:46 stpierre i know that whatever image object rally was looking up was basically empty -- it contained no info about the image
21:46 stpierre but i can't remember why
21:58 phd2 i tried it
21:58 phd2 i gave it the exact cirros path and it didn’t work
22:09 openstackgerrit Andrey Kurilin proposed openstack/rally: WIP do not ignore unknown service_types  https://review.openstack.org/255570
22:14 phd2 joined #openstack-rally
22:27 phd2 joined #openstack-rally
22:35 stpierre joined #openstack-rally
22:51 harlowja joined #openstack-rally
22:59 boris-42_ joined #openstack-rally
23:05 akrzos joined #openstack-rally
23:06 baker joined #openstack-rally
23:11 stpierre joined #openstack-rally
23:21 phd2 yeah didn’t work
23:33 meteorfox joined #openstack-rally
23:37 rcernin joined #openstack-rally
23:48 marcoceppi joined #openstack-rally
23:48 marcoceppi joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary