Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2017-06-06

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 stpierre joined #openstack-rally
00:23 zackf joined #openstack-rally
00:24 aojea joined #openstack-rally
01:03 stpierre joined #openstack-rally
01:07 LindaWang joined #openstack-rally
01:07 tovin07_ joined #openstack-rally
01:13 openstackgerrit Hai Shi proposed openstack/rally master: Add BGP VPN scenarios  https://review.openstack.org/469127
01:48 ilbot3 joined #openstack-rally
01:48 Topic for #openstack-rally is now Gitter https://gitter.im/rally-dev/Lobby ☁ Review board: https://goo.gl/iYw2m0 ☁ Rally RoadMap: http://goo.gl/JZkmwY ☁ IRC logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  andreykurilin, boris-42, amaretskiy, rvasilets, stpierre  ☁ Documentation: https://rally.readthedocs.org/en/latest/ ☁ To publish changes to Rally:
03:25 yamamoto_ joined #openstack-rally
03:30 chhavi joined #openstack-rally
04:20 reveller joined #openstack-rally
04:55 zackf joined #openstack-rally
05:51 yamamoto joined #openstack-rally
05:55 aojea joined #openstack-rally
05:56 LindaWang joined #openstack-rally
06:10 rcernin joined #openstack-rally
06:15 aojea joined #openstack-rally
06:16 aojea joined #openstack-rally
06:29 itlinux_ joined #openstack-rally
06:30 a8O81A1UB [From Gitter] andreykurilin : We have an issue with CLI job...
06:33 openstackgerrit Ma Xinjian proposed openstack/rally master: Add CinderVolumes.create_unmanage_and_manage_volume  https://review.openstack.org/421088
06:39 pcaruana joined #openstack-rally
06:43 LindaWang joined #openstack-rally
06:47 yamamoto joined #openstack-rally
06:50 marcoceppi joined #openstack-rally
06:50 marcoceppi joined #openstack-rally
07:03 aarefiev joined #openstack-rally
07:13 tesseract joined #openstack-rally
07:25 aojea joined #openstack-rally
07:46 a8O81A1UB [From Gitter] Pigueiras : > We have an issue with CLI job...
07:47 a8O81A1UB [From Gitter] Pigueiras : I noticed too ^^
07:47 openstackgerrit Ma Xinjian proposed openstack/rally master: Add CinderVolumeTypes.create_volume_type_set_key_and_create_volume  https://review.openstack.org/431328
07:47 a8O81A1UB [From Gitter] Pigueiras : [edit] > We have an issue with CLI job...
07:47 a8O81A1UB [From Gitter] Pigueiras : [edit]
07:47 a8O81A1UB [From Gitter] Pigueiras : [edit] I noticed too ^^
07:47 openstackgerrit Cedric Savignan proposed openstack/rally master: Add BGP VPN scenarios  https://review.openstack.org/469127
07:48 alexchadin joined #openstack-rally
08:01 oanufrii joined #openstack-rally
08:01 Serlex joined #openstack-rally
08:13 e0ne joined #openstack-rally
08:17 tosky joined #openstack-rally
08:40 ushkalim_ joined #openstack-rally
08:52 mvk joined #openstack-rally
08:56 openstackgerrit Andrey Kurilin proposed openstack/rally master: Revert "[ci] remove pytest-xdist dependency"  https://review.openstack.org/471265
08:56 a8O81A1UB [From Gitter] andreykurilin : https://review.openstack.org/471265 should speed up launching tests and add more info for debugging
09:02 aojea joined #openstack-rally
09:16 zackf joined #openstack-rally
09:36 openstackgerrit Ma Xinjian proposed openstack/rally master: Add NovaServers.boot_and_get_vnc_console  https://review.openstack.org/374514
09:38 a8O81A1UB [From Gitter] chenhb-zte : strange error. that is why?
09:48 alexchadin joined #openstack-rally
09:49 openstackgerrit Cedric Savignan proposed openstack/rally master: Add BGP VPN scenarios  https://review.openstack.org/469127
09:51 openstackgerrit Andrey Kurilin proposed openstack/rally master: [ci] use latest pytest  https://review.openstack.org/470333
09:53 a8O81A1UB [From Gitter] andreykurilin : http://logs.openstack.org/65/471265/1/check/gate-rally-dsvm-cli/5f48b77/console.html#_2017-06-06_09_50_50_066932
09:54 rallydev-bot joined #openstack-rally
09:54 rallydev-bot [From Gitter] andreykurilin : 1857.81s call     tests/functional/test_task_samples.py::TestTaskSamples::test_task_samples_are_valid
09:54 zackf joined #openstack-rally
09:54 rallydev-bot [From Gitter] andreykurilin : 1857.81s == 30 minutes
09:54 rallydev-bot [From Gitter] andreykurilin : O_O
09:54 rallydev-bot [From Gitter] andreykurilin : something went wrong...
09:55 rallydev-bot [From Gitter] andreykurilin : need some more debug messages
09:57 alexchadin joined #openstack-rally
09:57 mvk joined #openstack-rally
10:00 openstackgerrit Andrey Kurilin proposed openstack/rally master: DO NOT MERGE: fail samples test to see full log  https://review.openstack.org/471300
10:03 lpetrut joined #openstack-rally
10:05 abalutoiu joined #openstack-rally
10:09 openstackgerrit Luis Pigueiras proposed openstack/rally master: Add manila extend/shrink scenarios  https://review.openstack.org/469170
10:28 openstackgerrit Andrey Kurilin proposed openstack/rally master: [ci] use latest pytest  https://review.openstack.org/470333
10:29 MatthewLi joined #openstack-rally
10:40 ushkalim_ joined #openstack-rally
10:48 MatthewLi hi guys, recently I see parallel test "concurrency" in rally, how it achieved in openstack?  can u give the links? I can find rally/plugins/common/verification/testr.py
10:48 MatthewLi however I don't know what actually do the parallel after if concurrency == 0 or concurrency > 1:
10:48 MatthewLi self.context["testr_cmd"].append("--parallel")
10:48 MatthewLi if concurrency >= 1:
10:48 MatthewLi self.context["testr_cmd"].extend(
10:48 MatthewLi ["--concurrency", str(concurrency)])
10:48 rallydev-bot [From Gitter] andreykurilin : MatthewLi: hi!
10:49 rallydev-bot [From Gitter] andreykurilin : In future, please use any of paste services for sharing pieces of code
10:49 MatthewLi andreykurilin: ok :)
10:49 rallydev-bot [From Gitter] andreykurilin : as for your question, let's start from common questions
10:50 rallydev-bot [From Gitter] andreykurilin : Are we talking about rally verification component and launching tempest
10:50 rallydev-bot [From Gitter] andreykurilin : am I right?
10:50 MatthewLi andreykurilin: yep
10:50 rallydev-bot [From Gitter] andreykurilin : http://rally.readthedocs.io/en/latest/verification/cli_reference.html#verify-start-concurrency
10:50 MatthewLi such as boot 500 vms at the same time, how the cmd performs and openstack handles it
10:50 rallydev-bot [From Gitter] andreykurilin : The default value (0) auto-detects your CPU count.
10:51 rallydev-bot [From Gitter] andreykurilin : so it is not about verification component and tempest
10:52 rallydev-bot [From Gitter] andreykurilin : the `--concurrency` parameter in verification component takes care about concurrency of launching tests. It is not about launching a single test in a load
10:52 MatthewLi andreykurilin: I am new comers :) I know how to run it in rally but I want to know more the essence
10:52 rallydev-bot [From Gitter] andreykurilin : If you need to generate a real load for your cloud, you should use `Task component`
10:53 rallydev-bot [From Gitter] andreykurilin : it is our inner powerful thing which doesn't relate to tempest at all
10:54 rallydev-bot [From Gitter] andreykurilin : see http://rally.readthedocs.io/en/latest/quick_start/tutorial/step_2_input_task_format.html
10:54 rallydev-bot [From Gitter] andreykurilin : for more details
10:54 rallydev-bot [From Gitter] andreykurilin : It contains an example of "NovaServers.boot_and_delete_server" scenario, which can be used to launch N scenarios in parallel
10:55 rallydev-bot [From Gitter] andreykurilin : "concurrency" option of runner section is about how many iterations of a single scenarios should be launched in parallel and "times" is a total number of these iterations
10:57 MatthewLi andreykurilin: I can understand the contents in the URL, my question is how "concurrency" comes true?
10:58 rallydev-bot [From Gitter] andreykurilin : Rally makes N requests in different threads
10:59 jkilpatr joined #openstack-rally
10:59 MatthewLi andreykurilin: that's what I mean :) do u know how openstack handles the N requests at the same time? FIFO queue  or?
10:59 MatthewLi or can I achieve this by N process rather than threads?
11:01 rallydev-bot [From Gitter] andreykurilin : As for OpenStack, it depends on the each of single service
11:02 MatthewLi andreykurilin: can u give some example?
11:08 rallydev-bot [From Gitter] andreykurilin : it is a hard question and it doesn't relate to Rally at all :) I'm not expert in architecture of other services. In general, most of services implements wsgi and usually they are staying behind apache or something like that. So apache takes care about concurrency at the top level. Then, API of each service doesn't do any serious actions, they validate request, make so
11:08 rallydev-bot me additional work and put request in the queue, so "worker" service will
11:08 rallydev-bot [From Gitter] andreykurilin : able to process it
11:15 rallydev-bot [From Gitter] andreykurilin : @shihai1991 @chenhb-zte folks, please look at https://review.openstack.org/#/c/471265 it can speed up our cli job
11:16 rallydev-bot [From Gitter] shihai1991 : :ok:
11:36 ushkalim joined #openstack-rally
11:53 abalutoiu_ joined #openstack-rally
11:56 yamamoto joined #openstack-rally
12:07 rcernin joined #openstack-rally
12:07 openstackgerrit Liang Cui proposed openstack/rally master: Remove log translations  https://review.openstack.org/447886
12:09 pcaruana joined #openstack-rally
12:15 stpierre_ joined #openstack-rally
12:16 dave-mccowan joined #openstack-rally
12:23 openstackgerrit Andrey Kurilin proposed openstack/rally master: WIP: use verification template for unit tests  https://review.openstack.org/470334
12:30 reveller joined #openstack-rally
12:38 yamamoto joined #openstack-rally
12:42 catintheroof joined #openstack-rally
12:46 rallydev-bot [From Gitter] chenhb-zte : Yep,let us merge it
12:50 rallydev-bot [From Gitter] chenhb-zte : Also, Looks this was not the reason for ci broken
13:00 rallydev-bot [From Gitter] andreykurilin : @chenhb-zte it was not the reason
13:00 rallydev-bot [From Gitter] andreykurilin : but it can help us to unblock the gates
13:00 rallydev-bot [From Gitter] andreykurilin : the real reason - we have too many scenarios now
13:00 rallydev-bot [From Gitter] andreykurilin : and it is hard to validate them at once
13:11 openstackgerrit Luis Pigueiras proposed openstack/rally master: Add allow/deny access scenario to Manila  https://review.openstack.org/471342
13:11 yamamoto joined #openstack-rally
13:21 openstackgerrit Luis Pigueiras proposed openstack/rally master: Add manila extend/shrink scenarios  https://review.openstack.org/469170
13:23 yamamoto joined #openstack-rally
13:26 rallydev-bot [From Gitter] chenhb-zte : could we split them to validate ? we will have more scenarios
13:44 abalutoiu_ joined #openstack-rally
13:47 aojea joined #openstack-rally
13:47 LindaWang joined #openstack-rally
13:48 abalutoiu joined #openstack-rally
13:48 abalutoiu joined #openstack-rally
13:49 rcernin joined #openstack-rally
13:51 pcaruana joined #openstack-rally
13:53 reveller joined #openstack-rally
13:53 itlinux_ joined #openstack-rally
14:00 pcaruana joined #openstack-rally
14:01 rallydev-bot [From Gitter] andreykurilin : Do we have quorum for a meeting?
14:02 openstackgerrit Cedric Savignan proposed openstack/rally master: Add BGP VPN scenarios  https://review.openstack.org/469127
14:03 rallydev-bot [From Gitter] shihai1991 : +1
14:03 rallydev-bot [From Gitter] andreykurilin : @chenhb-zte ping
14:05 rcernin joined #openstack-rally
14:06 rallydev-bot [From Gitter] shihai1991 : Andrey, I just have a question. If we want make plugins based on openstack-infra, do you have any idea now?
14:07 rcernin joined #openstack-rally
14:07 rallydev-bot [From Gitter] andreykurilin : @shihai1991 I think it can be impossible if they do not relate to openstack (infra team can reject adding new non-openstack jobs), but we can try
14:09 rallydev-bot [From Gitter] shihai1991 : So we need communicate with infra team firstly?
14:10 rallydev-bot [From Gitter] andreykurilin : Let's start from a list of plugins you would like to add
14:11 rallydev-bot [From Gitter] chenhb-zte : hi
14:11 rallydev-bot [From Gitter] shihai1991 : Ok, I need some time to consider it.
14:12 rallydev-bot [From Gitter] andreykurilin : good
14:12 rallydev-bot [From Gitter] shihai1991 : can we start our meeting today?
14:12 rallydev-bot [From Gitter] andreykurilin : yup
14:12 rallydev-bot [From Gitter] andreykurilin : let's start
14:12 rallydev-bot [From Gitter] andreykurilin : the first topic - our gates..
14:13 rallydev-bot [From Gitter] andreykurilin : Our CLI job become crazy
14:13 rallydev-bot [From Gitter] andreykurilin : the root issue is validation of samples
14:13 rallydev-bot [From Gitter] andreykurilin : here we have two issues
14:13 rallydev-bot [From Gitter] andreykurilin : First issue - we have too many scenarios now and it takes too much time to validate them at once
14:14 rallydev-bot [From Gitter] andreykurilin : The second issue - I posted a patch for debugging (http://logs.openstack.org/00/471300/1/check/gate-rally-dsvm-cli/212bb0b/console.html#_2017-06-06_10_53_43_726084) and discovered that a lot of samples fails while validation, but the test is not
14:15 rallydev-bot [From Gitter] andreykurilin : so it sounds like test do some really havvy job which are not published even in case of failures
14:15 rallydev-bot [From Gitter] andreykurilin : we need to discuss plan to fix both of these issues
14:15 rallydev-bot [From Gitter] chenhb-zte : sad news
14:16 rallydev-bot [From Gitter] andreykurilin : as @chenhb-zte  already asked, we need to split validation
14:16 rallydev-bot [From Gitter] andreykurilin : Most of failures related to turned off specific service
14:16 rallydev-bot [From Gitter] chenhb-zte : as i said, could we split to validate them?
14:17 rallydev-bot [From Gitter] shihai1991 : Identity y all kinds of plugins?
14:17 rallydev-bot [From Gitter] chenhb-zte :  message is later, ha
14:17 rallydev-bot [From Gitter] andreykurilin : it is impossible to enable all required services in one job (devstack will take more than an hout to start them, lol), so yes we need to have several jobs for validation
14:17 rallydev-bot [From Gitter] andreykurilin : @shihai1991 rephrase please
14:21 rallydev-bot [From Gitter] andreykurilin : ok, so here I see two solutions:
14:21 rallydev-bot [From Gitter] andreykurilin : * have two(maybe we will need more) separate jobs dedicated for validation of samples
14:21 rallydev-bot [From Gitter] andreykurilin : * put validation of samples in other jobs where we already have required services enabled
14:22 rallydev-bot [From Gitter] andreykurilin : both of these solutions s*cks :( they require hardcode names of samples to launch at particular job
14:25 rallydev-bot [From Gitter] andreykurilin : Also, there is one more temporary solution - just increase timeout of CLI job. But it fixes only one of two issues
14:26 rallydev-bot [From Gitter] shihai1991 : Can we split all scenarios?
14:26 rallydev-bot [From Gitter] andreykurilin : yes, we can validate them in different jobs
14:26 rallydev-bot [From Gitter] andreykurilin : but it will require hardcode
14:27 rallydev-bot [From Gitter] andreykurilin : something like - "foo1" plugin should be validated at this job, "foo2" at this...and so on
14:27 rallydev-bot [From Gitter] chenhb-zte : as my thought, the second solution?
14:27 rallydev-bot [From Gitter] andreykurilin : put validation of samples in other jobs where we already have required services enabled ?
14:27 rallydev-bot [From Gitter] andreykurilin : it required hardcode too
14:29 rallydev-bot [From Gitter] andreykurilin : we can try to automate "hardcoding". I mean we can identify  required services and extensions of particular scenario based on validators and make decision at what job to launch it based on that information
14:29 rallydev-bot [From Gitter] andreykurilin : in this we will not have hardcode
14:30 rallydev-bot [From Gitter] andreykurilin : but it requires non clear code
14:32 rallydev-bot [From Gitter] andreykurilin : I'll add this task with all notes to our board, hope our gates will be unblocked for some time and we will able to return to these issues with "fresh mind"
14:33 rallydev-bot [From Gitter] andreykurilin : Ok, let's move to another issue in gates
14:33 rallydev-bot [From Gitter] andreykurilin : our job for verification component - s*cks too
14:33 openstackgerrit Merged openstack/rally master: Revert "[ci] remove pytest-xdist dependency"  https://review.openstack.org/471265
14:33 rallydev-bot [From Gitter] andreykurilin : It doesn't fail in case of failed tests
14:33 rallydev-bot [From Gitter] andreykurilin : and we have situation, when all steps are marked as green - http://logs.openstack.org/66/467066/1/check/gate-rally-dsvm-verify-light-discover-resources/f05ac31/
14:34 rallydev-bot [From Gitter] andreykurilin : But the result is not so green - http://logs.openstack.org/66/467066/1/check/gate-rally-dsvm-verify-light-discover-resources/f05ac31/rally-verify/16_verify_report.html.gz
14:34 rallydev-bot [From Gitter] andreykurilin : ;(
14:34 rallydev-bot [From Gitter] andreykurilin : so we have complitile broken verification component
14:34 rallydev-bot [From Gitter] andreykurilin : and I do not know when it happend
14:35 rallydev-bot [From Gitter] chenhb-zte : yep, i saw this bug at LP :worried:
14:38 rallydev-bot [From Gitter] andreykurilin : ok, I'll try to deep into this issue, since our tempest expert @ylobankov is gone
14:39 rallydev-bot [From Gitter] andreykurilin : As for Rally 0.10.0, I think I'll start writing release notes as soon as we fix all this issues.
14:39 rallydev-bot [From Gitter] andreykurilin : And deployment refactoring will move to the next release
14:41 rallydev-bot [From Gitter] andreykurilin : Any questions or topics to discuss?
14:41 rallydev-bot [From Gitter] chenhb-zte : nothing from me.i will deep into ci issue
14:42 rallydev-bot [From Gitter] andreykurilin : thanks for the help
14:42 rallydev-bot [From Gitter] chenhb-zte : my pleasure :smile:
14:43 rallydev-bot [From Gitter] shihai1991 : About first question, Can we split  all scenarios to different  depository?
14:43 rallydev-bot [From Gitter] andreykurilin : yes, we can move openstack related scenarios to separate repository and they will be still under openstack-infra
14:44 rallydev-bot [From Gitter] shihai1991 : Looks too much repositories~
14:44 rallydev-bot [From Gitter] andreykurilin : so we will have two repositories for now. rally and rally-openstack
14:44 rallydev-bot [From Gitter] andreykurilin : not too much)
14:45 rallydev-bot [From Gitter] andreykurilin : I think it is quite unfriednly to split openstack plugins in several repositories categorizing them by services, like tempest did\
14:46 rallydev-bot [From Gitter] shihai1991 : Yep. Looks no enough person to maintain their repositories.
14:46 rallydev-bot [From Gitter] andreykurilin : yes, it is a hard task
14:47 rallydev-bot [From Gitter] shihai1991 : OK, I have no good idea & question:(
14:48 rallydev-bot [From Gitter] andreykurilin : np
14:48 rallydev-bot [From Gitter] andreykurilin : ok, let's finish!
14:48 rallydev-bot [From Gitter] andreykurilin : have a good evening!
14:48 rallydev-bot [From Gitter] shihai1991 : :ok_hand:
14:48 rallydev-bot [From Gitter] chenhb-zte : bye
15:00 reveller joined #openstack-rally
15:03 LindaWang joined #openstack-rally
15:11 LindaWang joined #openstack-rally
15:59 dpaterson joined #openstack-rally
16:16 tosky__ joined #openstack-rally
16:26 yamamoto joined #openstack-rally
16:29 abalutoiu joined #openstack-rally
16:33 abalutoiu_ joined #openstack-rally
16:42 itlinux_ joined #openstack-rally
16:57 LindaWang joined #openstack-rally
17:06 zackf joined #openstack-rally
17:16 aojea joined #openstack-rally
17:36 itlinux_ joined #openstack-rally
17:50 aojea joined #openstack-rally
18:22 itlinux joined #openstack-rally
18:28 yamamoto joined #openstack-rally
18:32 rallydev-bot [From Gitter] reveller : Hi!  How long do task uuids exist in the 'rally task list'?  It seems that if I don't get either a report or results within a few seconds after the task completes, the task list is empty.
18:34 zackf joined #openstack-rally
18:45 rallydev-bot [From Gitter] reveller : and if I run 'rally task list' from another terminal while a task is executing, I get a python traceback "ERROR rally KeyError: 'sla'"
18:56 pcaruana joined #openstack-rally
19:02 aojea joined #openstack-rally
19:31 rallydev-bot [From Gitter] andreykurilin : @reveller hi! task results store in the database
19:31 yamamoto joined #openstack-rally
19:32 rallydev-bot [From Gitter] andreykurilin : usually it is a persistent storage
19:32 rallydev-bot [From Gitter] andreykurilin : as for `"ERROR rally KeyError: 'sla'"` I identified an issue and it relates mostly to unfinished tasks (I'll propose a fix tomorrow)
19:50 harlowja joined #openstack-rally
20:32 yamamoto joined #openstack-rally
20:35 aojea joined #openstack-rally
20:37 aojea joined #openstack-rally
20:38 jkilpatr joined #openstack-rally
21:29 haukebruno joined #openstack-rally
21:33 yamamoto joined #openstack-rally
21:48 itlinux joined #openstack-rally
22:34 yamamoto_ joined #openstack-rally
22:42 zackf joined #openstack-rally
23:36 yamamoto_ joined #openstack-rally
23:47 jkilpatr joined #openstack-rally
23:53 jkilpatr joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary