Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2016-03-04

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:04 baker joined #openstack-rally
00:05 baker_ joined #openstack-rally
00:18 arnoldje joined #openstack-rally
00:32 yingjun joined #openstack-rally
00:44 baker joined #openstack-rally
00:52 ylobankov joined #openstack-rally
01:21 Aish left #openstack-rally
01:26 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Fixing Tempest resources context to create network resources  https://review.openstack.org/285758
01:35 diogogmt joined #openstack-rally
01:54 baker_ joined #openstack-rally
01:59 baker joined #openstack-rally
02:48 ilbot3 joined #openstack-rally
02:48 Topic for #openstack-rally is now ☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ Review Dashboard: http://goo.gl/YuCJfl ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  boris-42, yfried, msdubov, rediskin, andreykurilin, amaretskiy  ☁ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally:  https://rally.readthedocs.org/en/latest/contribute.html
03:05 luzC joined #openstack-rally
03:11 baker joined #openstack-rally
03:14 baker_ joined #openstack-rally
03:31 akrzos joined #openstack-rally
03:44 yingjun joined #openstack-rally
03:55 ylobankov joined #openstack-rally
04:16 baker joined #openstack-rally
04:24 luzC joined #openstack-rally
04:29 openstack joined #openstack-rally
04:32 openstack joined #openstack-rally
04:32 openstackgerrit Merged openstack/rally: Fixed imcompatible argument in service create with keystone v2/3 API  https://review.openstack.org/287058
04:33 jlk joined #openstack-rally
04:33 jlk joined #openstack-rally
04:36 openstack joined #openstack-rally
04:37 openstack joined #openstack-rally
04:45 akrzos joined #openstack-rally
04:46 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Fixing Tempest config generation  https://review.openstack.org/288246
04:49 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/286971
04:57 baker joined #openstack-rally
05:17 openstackgerrit Allen Gao proposed openstack/rally: Update the scenario development section  https://review.openstack.org/287660
05:17 ylobanko_ joined #openstack-rally
05:32 neeti joined #openstack-rally
05:38 rdas joined #openstack-rally
05:39 baker joined #openstack-rally
06:01 rcernin joined #openstack-rally
06:48 akrzos joined #openstack-rally
07:15 anshul joined #openstack-rally
07:49 akrzos joined #openstack-rally
08:30 amaretskiy joined #openstack-rally
08:51 akrzos joined #openstack-rally
08:51 arxcruz joined #openstack-rally
08:53 e0ne joined #openstack-rally
08:58 yingjun joined #openstack-rally
09:05 permalac joined #openstack-rally
09:48 openstackgerrit Sergey Skripnick proposed openstack/rally: [CI] Fix rally-mos job to work with mos-8.0  https://review.openstack.org/287687
09:51 e0ne joined #openstack-rally
09:54 adiantum joined #openstack-rally
09:55 openstackgerrit Merged openstack/rally: Updated from global requirements  https://review.openstack.org/286971
10:18 yingjun joined #openstack-rally
10:19 yingjun joined #openstack-rally
10:29 openstackgerrit Sergey Skripnick proposed openstack/rally: [CI] Fix rally-mos job to work with mos-8.0  https://review.openstack.org/287687
10:30 openstackgerrit Kiran proposed openstack/rally: Deprecate 'script' in favor of 'command'  https://review.openstack.org/288370
10:32 permalac joined #openstack-rally
10:42 kiran-r joined #openstack-rally
10:49 openstackgerrit Sergey Skripnick proposed openstack/rally: [CI] Fix rally-mos job to work with mos-8.0  https://review.openstack.org/287687
10:51 openstackgerrit Kiran proposed openstack/rally: Deprecate 'script' in favor of 'command'  https://review.openstack.org/288370
10:52 akrzos joined #openstack-rally
10:56 tosky joined #openstack-rally
11:09 openstackgerrit Andrey Kurilin proposed openstack/rally: [Docs] Rework "Rally Plugins Reference"  https://review.openstack.org/284168
11:18 yingjun joined #openstack-rally
11:20 openstackstatus joined #openstack-rally
11:24 openstackstatus NOTICE: testing status bot
11:25 openstackgerrit Merged openstack/rally: Update the scenario development section  https://review.openstack.org/287660
12:08 openstackgerrit Sergey Skripnick proposed openstack/rally: [CI] Fix rally-mos job to work with mos-8.0  https://review.openstack.org/287687
12:54 akrzos joined #openstack-rally
12:58 MaxPC joined #openstack-rally
13:03 openstackgerrit_ joined #openstack-rally
13:04 e0ne joined #openstack-rally
13:12 akrzos joined #openstack-rally
13:13 openstackgerrit_ joined #openstack-rally
13:15 openstackgerrit Andrey Kurilin proposed openstack/rally: [docs] Improvements in docstrings  https://review.openstack.org/288450
13:18 stpierre joined #openstack-rally
13:18 stpierre joined #openstack-rally
13:25 jose_lausuch joined #openstack-rally
13:25 jose_lausuch andreykurilin: thanks for the help
13:26 andreykurilin jose_lausuch: my pleasure
13:26 jose_lausuch andreykurilin: can you see this? https://gerrit.opnfv.org/gerrit/#/c/10969/1
13:27 jose_lausuch andreykurilin: I'm installing requirements.txt and test-requirements.txt in the tempest dir.. I hope that's fine. Not sure if both are neeeded. But doing it manually, I managed to run a smoke test in system-wide
13:27 andreykurilin jose_lausuch: yes, I can
13:28 andreykurilin jose_lausuch: I suppose you don't need to install test-requirements. They are used only for self-testing tempest stuff
13:29 jose_lausuch andreykurilin: what I dont understand yet is how rally (without using --source and --system-wide) knows what tempest version to check out
13:29 jose_lausuch ah ok
13:29 andreykurilin jose_lausuch: it uses master branch :)
13:29 jose_lausuch andreykurilin: ya, but what tag... latest I suppose
13:30 andreykurilin yes, latest
13:30 jose_lausuch andreykurilin: ok, so we have the responsability then :)
13:31 andreykurilin jose_lausuch: We have a lot of tasks which should provide more user-friendly interface for `rally verify`, but we don't have enough contributors:(
13:32 jose_lausuch andreykurilin: we have more contributors now in OPNFV that are taking a look at improving the Rally and Tempest test executions... one of our targets is also to contribute upstream, so in the Rally project
13:32 andreykurilin wow
13:32 andreykurilin cool
13:33 jose_lausuch anyway, I think the work you are doing is great
13:34 andreykurilin thanks
13:34 andreykurilin jose_lausuch: I hope I will finish the spec about refactoring "verification" component at these weekends. It will include all negative parts and the way how they can be fixed/improved.
13:34 jose_lausuch andreykurilin: nice :) what kind of refactoring?
13:39 andreykurilin jose_lausuch: inner and cli:) All the stuff releated to Tempest launch is based on "testr" and "subunit". Tempest is not the only one tool which works on the top of them. For example, we can launch Gabbi via `rally verify` or in-tree functional tests. So I want to move "Verification" component at plugin base and unify cli to work with different verifiers
13:39 jose_lausuch ah ok, what you said in the email
13:39 jose_lausuch that will be very interesting to see :)
13:40 jose_lausuch what can be an example of "in tree functional tests"
13:40 jose_lausuch I wonder if we can add something of the new features to Release C of OPNFV
13:43 andreykurilin jose_lausuch, example of in-tree functional tests : https://github.com/openstack/python-novaclient/tree/master/novaclient/tests/functional or https://github.com/openstack/nova/tree/master/nova/tests/functional
13:43 andreykurilin they are based on tempest-lib
13:47 openstackgerrit Andrey Kurilin proposed openstack/rally: [docs] Improvements in docstrings  https://review.openstack.org/288450
13:47 openstackgerrit Andrey Kurilin proposed openstack/rally: [Docs] Rework "Rally Plugins Reference"  https://review.openstack.org/284168
13:51 twm2016 joined #openstack-rally
13:54 rook morning andreykurilin
13:54 rook I have been afk from the main project for a while, is boris gone/
13:56 twm2016 Hi everyone, would creating a flavor in rally-gate.sh cause it to not be deletable?
13:56 twm2016 I had a patch approved and the jenkins tests failed and gave it a -2.
13:57 andreykurilin rook: hi! boris-42 is sleeping now and will be available in 2-3 hours
13:57 rook ahh
13:57 andreykurilin twm2016: hi! link for a patch?
13:57 rook andreykurilin so, i wanted to ask about the delete function... and how I hate it :)
13:57 andreykurilin lol
13:57 rook andreykurilin well delete/cleanup
13:57 twm2016 andreykurilin: https://review.openstack.org/#/c/284149/
13:58 rook andreykurilin: i can create 24000 instances < 1hour
13:58 rook and the clenaup function takes > 7 hours.
13:58 rook cleanup*
13:58 andreykurilin lol
13:58 twm2016 This is where the logs show creation: http://logs.openstack.org/49/284149/16/gate/gate-rally-dsvm-rally/af6cefb/console.html#_2016-03-04_11_02_04_562
13:58 andreykurilin :D
13:58 openstackgerrit_ joined #openstack-rally
13:58 rook andreykurilin something is massively broken.
13:58 twm2016 And here is where I think it fails to delete it: http://logs.openstack.org/49/284149/16/gate/gate-rally-dsvm-rally/af6cefb/console.html#_2016-03-04_11_03_05_467
14:00 andreykurilin twm2016: the failure is not depend on your change. just try to "recheck"
14:00 jose_lausuch andreykurilin: intersting, maybe we think of including it in opnfv :)
14:00 twm2016 thats what I was hoping for, thank you!
14:01 andreykurilin rook: I need to look more closely to cleanup code
14:01 andreykurilin also, we can ask stpierre about it :)
14:02 andreykurilin stpierre: hi! Can you help us?)
14:02 stpierre those logs show creation of a flavor and failure to delete an image
14:03 stpierre so they can't be related
14:03 andreykurilin stpierre: no no
14:03 andreykurilin stpierre: I want to ask help for rook question:)
14:03 stpierre i can try
14:03 andreykurilin :)
14:04 rook stpierre :)
14:04 rook stpierre so, I can launch 24000 guests in < 1 hours, however, the cleanup function takes > 7 hours
14:05 rook stpierre so, either I need to disable the cleanup and do it on my own... or we need to quickly figure out why the cleanup seems to be so slow (maybe it is one operation at a time)
14:05 rook possibly we could increase the concurrency.
14:05 stpierre cleanup is parallel, but probably not as parallel as creating 24000 guests
14:05 stpierre what's your concurrency for that?
14:06 andreykurilin jose_lausuch: so functional tests based of tempest-lib are not ideal. They are worse even then Tempest :) tempest-lib doesn't have mechanism for multi-users tests, so all tests are launched from one user and one tenant. If tenant has some quota limits, it can be awful.
14:07 openstack joined #openstack-rally
14:07 stpierre looks like default cleanup concurrency is 20 threads
14:07 stpierre which seems super arbitrary
14:08 stpierre as much time as it spends sleeping, a large system could easily run more threads than that
14:08 andreykurilin jose_lausuch: If you want to write something in-tree you can use Rally-framework(no, this is not an advertisement ) for example, glance has in-tree rally plugin - https://github.com/openstack/glance/blob/master/rally-jobs/plugins/plugin_sample.py It is a single scenario
14:08 stpierre but it's going to be tough to make that configurable
14:09 stpierre but we can easily verify if that's the main bottleneck by changing the default value for `threads` here: https://github.com/openstack/rally/blob/master/rally%2Fplugins%2Fopenstack%2Fcleanup%2Fbase.py#L36
14:09 stpierre e.g., set that to whatever your concurrency setting in your task is, and see if it goes faster
14:10 stpierre we could actually change that to a config option in rally.conf pretty easily
14:13 rook stpierre it is varies through the test.
14:13 rook stpierre: ill make that change and try again.
14:13 rook maybe a smaller set
14:13 rook if it helps ill push a patch
14:14 yingjun joined #openstack-rally
14:26 arnoldje joined #openstack-rally
14:28 moravec joined #openstack-rally
14:36 luzC joined #openstack-rally
14:37 openstackgerrit_ joined #openstack-rally
14:52 jose_lausuch andreykurilin: ok, I'll have a look. Thank you! :)
14:54 amaretskiy yfried rook: FYI there is a patch https://review.openstack.org/#/c/287329/3 that fixes https://bugs.launchpad.net/rally/+bug/1550262
14:54 openstack Launchpad bug 1550262 in Rally "rally task detailed, rally task report and rally task status show diffrent results" [High,Triaged]
14:54 amaretskiy yfried rook: next step will be improvement of statistics streaming calculation so it will be more accurate
14:54 rook ah, my other issue :)
14:55 rook haha, thanks amaretskiy
14:55 amaretskiy :)
14:55 amaretskiy rook: https://bugs.launchpad.net/rally/+bug/1510175
14:55 openstack Launchpad bug 1510175 in Rally "Rally task detailed 95%ile Response Times different from HTML graphics report" [High,Triaged] - Assigned to Alexander Maretskiy (maretskiy)
14:55 amaretskiy rook: another bug :)
14:57 diogogmt joined #openstack-rally
15:00 openstackgerrit Andrey Kurilin proposed openstack/rally: [docs] Improvements in docstrings  https://review.openstack.org/288450
15:00 openstackgerrit Andrey Kurilin proposed openstack/rally: [Docs] Rework "Rally Plugins Reference"  https://review.openstack.org/284168
15:00 psd joined #openstack-rally
15:03 TheBlackDeath joined #openstack-rally
15:18 ylobankov joined #openstack-rally
15:20 arnoldje joined #openstack-rally
15:21 openstackgerrit Andrey Kurilin proposed openstack/rally: DO NOT MERGE: print mire debug messages for neutron scenario  https://review.openstack.org/288522
15:22 mvk joined #openstack-rally
15:26 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Fixing Tempest resources context to create network resources  https://review.openstack.org/285758
15:26 baker joined #openstack-rally
15:33 openstackgerrit Andrey Kurilin proposed openstack/rally: DO NOT MERGE: print mire debug messages for neutron scenario  https://review.openstack.org/288522
15:39 baker joined #openstack-rally
15:48 luzC joined #openstack-rally
15:49 openstackgerrit Merged openstack/rally: Change unstable neutron rally job's flavors  https://review.openstack.org/284149
15:49 andreykurilin left #openstack-rally
15:50 openstackgerrit Merged openstack/rally: [Docs] Rework "Rally Plugins Reference"  https://review.openstack.org/284168
15:53 kiran-r joined #openstack-rally
16:00 baker joined #openstack-rally
16:06 openstackgerrit Roman Vasilets proposed openstack/rally: [Bug1535948] Add Heat template validator  https://review.openstack.org/284736
16:17 TheBlackDeath joined #openstack-rally
16:22 openstackgerrit Roman Vasilets proposed openstack/rally: [Bug1535948] Add Heat template validator  https://review.openstack.org/284736
16:26 ylobankov joined #openstack-rally
16:41 jaypipes joined #openstack-rally
16:58 Aish joined #openstack-rally
17:06 openstackgerrit Roman Vasilets proposed openstack/rally: Add Image content upload context  https://review.openstack.org/266531
17:13 absubram joined #openstack-rally
17:14 absubram_ joined #openstack-rally
17:25 Aish left #openstack-rally
17:31 openstackgerrit Yaroslav Lobankov proposed openstack/rally: [Verify] Fixing Tempest config generation  https://review.openstack.org/288246
17:31 Aish joined #openstack-rally
17:33 Aish left #openstack-rally
17:43 openstackgerrit Merged openstack/rally: Refactored atomic action in authenticate scenario  https://review.openstack.org/274882
17:48 openstackgerrit OpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/288362
17:52 luzC joined #openstack-rally
17:57 madhu_ak joined #openstack-rally
18:49 Aish joined #openstack-rally
19:08 gubouvier joined #openstack-rally
19:14 pvaneck joined #openstack-rally
19:55 TheBlackDeath joined #openstack-rally
19:58 beslemon joined #openstack-rally
21:39 ylobankov joined #openstack-rally
21:58 pcaruana joined #openstack-rally
22:11 e0ne joined #openstack-rally
22:16 moravec joined #openstack-rally
22:47 TheBlackDeath joined #openstack-rally
23:15 e0ne joined #openstack-rally
23:25 TheBlackDeath joined #openstack-rally
23:30 TheBlackDeath joined #openstack-rally
23:59 baker joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary