Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2014-09-12

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:02 rook boris-42 quick q, will the mock client get real output? or do I need to make up the output it should receive?
00:02 boris-42 rook you mean if you mock osclinets?
00:02 rook well, neutronclient
00:02 boris-42 rook what line?)
00:02 boris-42 rook what file?)
00:03 boris-42 rook so basically if you are mocking something and don't' specify return_value to mock object
00:03 rook https://gist.github.com/anonymous/703aadf9906a2579597c
00:03 boris-42 rook it will return new mock object
00:03 yingjun joined #openstack-rally
00:03 rook what will the neutron-mockclient return ?  if it is real output, then it will be a dict
00:04 boris-42 rook you have a bug in this test
00:04 dpaterson joined #openstack-rally
00:04 boris-42 rook you should do it in another way
00:04 boris-42 rook one sec
00:05 boris-42 rook hm strange
00:05 boris-42 rook one more sec
00:05 rook i would love to know what you are doing?
00:05 rook I am comfortable with coding up solutions to extend rally's usage, but writing the fake tests is where i am limited.
00:06 boris-42 rook =)
00:06 boris-42 rook so that works actually
00:06 boris-42 rook it's just through ass
00:06 boris-42 rook https://github.com/stackforge/rally/blob/master/rally/benchmark/scenarios/base.py#L54
00:06 boris-42 rook scenario accepts directly clients
00:07 boris-42 rook so it makes sense to init NeutronScenario(cients=mock_clients)
00:07 boris-42 rook instead of doing @mock()
00:07 boris-42 rook but both works
00:07 boris-42 rook writing unit test is quite important
00:07 rook not saying it isn't :)
00:07 boris-42 rook we caught already so much mistakes
00:07 rook Just not my cup of tea
00:08 boris-42 rook so just copy paste them =)
00:08 boris-42 rook and replace a bit=)
00:08 boris-42 rook and tests are ready for your benchmark
00:08 rook well this is a new function for neutron
00:08 boris-42 rook and?
00:09 boris-42 rook so one more time what is the question?
00:10 boris-42 rook why we need tests with mocks?
00:10 boris-42 rook for benchmarks?
00:10 boris-42 rook or?
00:10 rook No, when using mock - does a mock client get real output, or do i need to generate the output from a function
00:11 rook when I run mock.clients("neutron").router_connect(router_id, subnet)
00:11 rook and run a assert to see if the mock subnet is attached
00:11 rook how do I validate the fake subnet is attached-- do i generate the return value, or does it stnd up a virtual env and retrieve the output?
00:12 boris-42 rook so basically your replacing "neutron" clinet with mock boject
00:12 boris-42 rook then you are calling your scenario
00:13 boris-42 rook then you are ensuring that router_connect was called with (router_id and subnet)
00:13 boris-42 rook that's how mocks work
00:14 * rook reading over create_port mock code now ;)
00:19 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
00:33 rook boris-42: any thoughts regarding https://gist.github.com/anonymous/7b00b048cb655de8bb8f
00:35 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
00:40 openstackgerrit Lingxian Kong proposed a change to stackforge/rally: Fix some typos and mistakes in the doc string  https://review.openstack.org/120948
00:40 boris-42 rook sooo
00:40 boris-42 rook code please
00:40 boris-42 rook =)
00:43 rook also , MismatchError: set(['VMTasks.network_boot_runcommand']) != set([]): These scenarios don't have samples: set(['VMTasks.network_boot_runcommand'])
00:43 rook lol
00:43 rook i just created samples
00:45 rook let me see if aight
00:45 rook ignore the above, i got tox to stop complaining about that ;)
00:46 rook boris-42: https://review.openstack.org/#/c/120921/3/rally/benchmark/scenarios/neutron/utils.py
00:46 rook that is the code it is complaining about
01:00 boris-42 rook I left a commnet
01:00 boris-42 rook https://review.openstack.org/#/c/120921/
01:01 rook oh, boris-42 i already fixed my test code
01:01 rook but it still fails
01:01 rook with https://gist.github.com/anonymous/7b00b048cb655de8bb8f
01:02 boris-42 rook did you fix it as I said?
01:02 rook lol a little different
01:02 rook let me see if your change fixes what I am seeing
01:03 rook ah, i am sure this is important scenario = utils.NeutronScenario(clients=clients)
01:03 rook i don't have that
01:03 boris-42 rook you need that or mock stuff on top
01:03 boris-42 rook result will be similar
01:04 RainbowBastion joined #openstack-rally
01:09 rook boris-42: seeing the same
01:10 boris-42 rook can you update your patch please
01:10 boris-42 rook so I'll see new test?
01:11 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
01:11 openstackgerrit Joe Talerico proposed a change to stackforge/rally: Patch to add VMTask scenario with networking attributes  https://review.openstack.org/120921
01:16 rook boris-42: wonder if i need to use , mock_clients("neutron")
01:16 mwagner_lap joined #openstack-rally
01:16 shakamunyi joined #openstack-rally
01:17 boris-42 rook nope
01:17 boris-42 rook you should remove them
01:17 boris-42 rook and we should do this for all other tests
01:17 boris-42 rook cause it's really through ass way
01:17 rook i did - most of the tests use that
01:17 boris-42 rook it sux
01:17 boris-42 rook it work but it sux
01:17 boris-42 =)
01:18 rook lol aight
01:19 boris-42 rook ya sometimes it happens
01:19 boris-42 rook so you should rebase your patch..
01:19 boris-42 rook but not sure how that happend
01:20 rook ?
01:20 rook so, you think there is something hairy in my patch causing this?
01:26 boris-42 rook I don't know
01:26 boris-42 rook did you try to rebase it on current master?
01:29 RainbowBastion joined #openstack-rally
01:29 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
01:30 rook hrm
01:30 rook git rebase master
01:30 rook Current branch review/joe_talerico/TOPIC-BRANCH is up to date.
01:31 shakamunyi joined #openstack-rally
01:32 boris-42 rook and git checkout master
01:32 boris-42 rook git remote update
01:32 boris-42 rook git pull
01:32 boris-42 rook git checkout -
01:32 boris-42 rook git rebase master
01:33 rook :/ no difference
01:39 boris-42 rook hmm
01:39 boris-42 rook so sry
01:39 boris-42 rook but i need to sleep
01:39 boris-42 rook it's 5:39 a.m. =)
01:39 RainbowBastion joined #openstack-rally
01:39 boris-42 rook see you tmomorrow
01:40 rook np, ttyl boris-42
01:40 boris-42 rook and will try to play with your patch
01:40 rook thanks - looking forward to figuring this out
01:44 openstackgerrit Joe Talerico proposed a change to stackforge/rally: Patch to add VMTask scenario with networking attributes  https://review.openstack.org/120921
01:51 openstackgerrit A change was merged to stackforge/rally: Fix some typos and mistakes in the doc string  https://review.openstack.org/120948
01:58 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
02:06 yaguang joined #openstack-rally
02:14 yingjun joined #openstack-rally
03:13 openstackgerrit Kui Shi proposed a change to stackforge/rally: Fix "Resource" typo in debug output  https://review.openstack.org/120967
03:17 RainbowBastion joined #openstack-rally
03:27 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
03:28 openstackgerrit Oleh Anufriiev proposed a change to stackforge/rally: Rally cli functional testing  https://review.openstack.org/118714
03:30 kevtsang_ joined #openstack-rally
03:43 yingjun joined #openstack-rally
04:28 openstackgerrit Oleh Anufriiev proposed a change to stackforge/rally: User_stories and feature requests appended to sphinx  https://review.openstack.org/113454
04:28 openstackgerrit Oleh Anufriiev proposed a change to stackforge/rally: Doc samples to rst  https://review.openstack.org/120794
04:46 Poornima joined #openstack-rally
05:34 rediskin joined #openstack-rally
06:10 mmalam joined #openstack-rally
06:10 mmalam boris-42: Hi
06:11 mmalam can any body explain me the real different between tempest and Rally?
06:41 tuvenen joined #openstack-rally
06:44 mkoderer joined #openstack-rally
06:45 k4n0 joined #openstack-rally
06:47 tuvenen_ joined #openstack-rally
07:16 penguinRaider joined #openstack-rally
07:27 mmalam boris-42: Hi
07:32 mmalam Rally Vs. Tempest, difference?
07:32 mmalam|2 joined #openstack-rally
07:32 mmalam|2 boris-42: Hi
07:33 mmalam|2 Can Any body can explain the Rally Vs. Tempest different
07:33 mmalam|2 exactly
07:53 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Jobs with scaling benchmark  https://review.openstack.org/121019
07:54 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Sahara Cluster and EDP contexts  https://review.openstack.org/115962
07:54 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Sahara Cluster and EDP contexts  https://review.openstack.org/115962
07:55 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Sahara Job Execution benchmark  https://review.openstack.org/116881
07:55 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Adding optional parameters to Sahara cluster  https://review.openstack.org/119778
07:55 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Sahara Job sequence benchmark added  https://review.openstack.org/120071
07:55 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Sahara Cluster scaling benchmark  https://review.openstack.org/120430
07:59 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Jobs with scaling benchmark  https://review.openstack.org/121019
08:19 andreykurilin joined #openstack-rally
08:43 aswadr joined #openstack-rally
08:45 boris-42 mmalam ?
08:46 boris-42 mmalam it's not clear for you?
08:46 mmalam|2 Got it what I needed here https://www.mirantis.com/blog/rally-openstack-tempest-testing-made-simpler/
08:46 boris-42 mmalam|2 it's just part of it
08:46 mmalam|2 fine, got it
08:47 mmalam|2 thanks
08:47 boris-42 mmalam|2 but if you try to use tempest scenarios as benchmarks
08:47 mmalam|2 its a bigger set, and tempest is subset
08:47 boris-42 mmalam you'll see the whole difference
08:47 ekarlso- yooo
08:47 ekarlso- :P
08:47 boris-42 ekarlso- hi there
08:47 ekarlso- tempest and rally ? |
08:47 boris-42 ekarlso- ya
08:48 boris-42 ekarlso- I think there is differnece)
08:53 mmalam|2 what is the different
08:53 mmalam|2 difference *
08:55 boris-42 mmalam measuring time is more granular and much precise, there is no overhead (in every time autodiscovering)
08:55 boris-42 mmalam there is validation of everything
08:55 mmalam|2 in Rally?
08:55 boris-42 mmalam|2 yep...
08:56 mmalam|2 So you mean Tempest does measures time?
08:56 mmalam|2 does not *
08:56 boris-42 mmalam it measures
08:56 boris-42 mmalam but only duration of scenario (without setup/cleanup)
08:56 boris-42 mmalam as well you are not able to separate setup/cleanup stuff and iteration
08:56 mmalam|2 ic
08:56 boris-42 mmalam like we have in rally benchmark.context (that are run before and after generating load)
08:57 boris-42 mmalam and billions other stuff
08:58 mmalam|2 billions
08:58 mmalam|2 :)
08:59 boris-42 mmalam|2 ya
08:59 boris-42 mmalam|2 actually there are using unittest framework
08:59 boris-42 mmalam|2 that produce in such case a lot of crap
08:59 boris-42 mmalam|2 that can't be fixed
08:59 mmalam|2 got it.
08:59 boris-42 mmalam|2 and we are using on framework
09:00 boris-42 mmalam|2 that is called python class and methods ..
09:00 mmalam|2 yes, I see, more organized and modular.
09:00 nkhare joined #openstack-rally
09:01 boris-42 mmalam it's not only about organization, it's as well about measuring parts of scenario iteration, and flexibility of control flow and plugablliltiy
09:01 boris-42 mmalam|2 e.g. you can have plugins for almost all parts of rally
09:02 boris-42 mmalam load geneartors/scenarios/context/sla checks/types/validators...
09:02 mmalam|2 ic
09:02 mmalam|2 boris-42: ic
09:02 boris-42 mmalam so the difference is about 12 months of work of a lot of people=)
09:02 Ch00k joined #openstack-rally
09:02 mmalam|2 :)
09:49 yingjun joined #openstack-rally
09:59 openstackgerrit Oleh Anufriiev proposed a change to stackforge/rally: Rally cli functional testing  https://review.openstack.org/118714
10:03 tzabal joined #openstack-rally
10:07 yingjun joined #openstack-rally
10:26 openstackgerrit A change was merged to stackforge/rally: Fix "Resource" typo in debug output  https://review.openstack.org/120967
10:52 tuvenen__ joined #openstack-rally
10:55 nkhare_ joined #openstack-rally
11:08 openstackgerrit Rohan Kanade proposed a change to stackforge/rally: Collect time duration for Context setup/cleanup  https://review.openstack.org/119606
11:10 k4n0 boris-42, ping
11:37 yingjun joined #openstack-rally
12:16 Ch00k joined #openstack-rally
12:17 Ch00k_ joined #openstack-rally
12:19 openstackgerrit satya proposed a change to stackforge/rally: Adds Neutron update Network and subnets benchmarks:  https://review.openstack.org/118552
12:19 andreykurilin joined #openstack-rally
12:21 Ch00k joined #openstack-rally
12:34 openstackgerrit Nikita Konovalov proposed a change to stackforge/rally: Jobs with scaling benchmark  https://review.openstack.org/121019
12:45 Ch00k joined #openstack-rally
12:49 openstackgerrit Mikhail Dubov proposed a change to stackforge/rally: add nova scenarios to rally-neutron.yaml  https://review.openstack.org/112684
12:55 cdent joined #openstack-rally
13:12 mwagner_lap joined #openstack-rally
13:52 Ch00k joined #openstack-rally
15:24 RainbowBastion joined #openstack-rally
15:33 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
15:36 kevtsang_ joined #openstack-rally
15:40 openstackgerrit Rohan Kanade proposed a change to stackforge/rally: Collect time duration for Context setup/cleanup  https://review.openstack.org/119606
16:29 marcoemorais joined #openstack-rally
16:36 rook boris-42: any thoughts on the issues with my patch?
16:51 RainbowBastion joined #openstack-rally
17:00 marcoemorais joined #openstack-rally
17:01 marcoemorais joined #openstack-rally
17:23 RainbowBastion boris-42 The preprocess test is done, but now test_run in tests.benchmark.runners.test_base.py is failing.  Originally, the error was because the {"id": 1} was taken out in the results returned by preprocess.
17:23 RainbowBastion boris-42 but I'm not sure how to fix it
17:28 openstackgerrit Kevin Tsang proposed a change to stackforge/rally: Moved preprocess function from base to types  https://review.openstack.org/120296
17:36 penguinRaider joined #openstack-rally
17:50 marcoemorais joined #openstack-rally
17:50 marcoemorais joined #openstack-rally
17:51 marcoemorais joined #openstack-rally
17:57 RainbowBastion boris-42 https://jenkins03.openstack.org/job/gate-rally-python26/560/console
18:00 jjmb joined #openstack-rally
18:41 openstackgerrit Walter A. Boring IV (hemna) proposed a change to stackforge/rally: Add a cinder volume attachment scenario  https://review.openstack.org/120283
19:21 penguinRaider joined #openstack-rally
19:49 Ch00k joined #openstack-rally
20:04 marcoemorais1 joined #openstack-rally
20:05 marcoemorais1 joined #openstack-rally
20:05 andreykurilin_ joined #openstack-rally
20:53 marcoemorais joined #openstack-rally
20:54 marcoemorais joined #openstack-rally
20:55 marcoemorais joined #openstack-rally
21:10 coolsvap joined #openstack-rally
21:36 boris-42 rook soorrry
21:36 boris-42 rook it was really crazy day today
21:36 boris-42 rook will take a look now
21:38 boris-42 rook hi
21:38 boris-42 RainbowBastion hi*
21:38 boris-42 RainbowBastion so I'll take a look at it
21:50 openstackgerrit Mikhail Dubov proposed a change to stackforge/rally: add nova scenarios to rally-neutron.yaml  https://review.openstack.org/112684
21:53 openstackgerrit Mikhail Dubov proposed a change to stackforge/rally: Add nova scenarios to rally-neutron.yaml  https://review.openstack.org/112684
21:57 RainbowBastion boris-42 Thanks, it would be awesome if you could look at it sooner rather than later since today's my last day working for Cisco, I have to turn in my laptop in a couple of hours.
21:59 boris-42 RainbowBastion so you have misate..
21:59 boris-42 RainbowBastion you need to specify return value of mock_meta
21:59 boris-42 RainbowBastion like I said in my previous coments...
22:00 boris-42 RainbowBastion lemme write one more time
22:02 RainbowBastion boris-42 So it should be: mock_meta.return_value = {"a": 10}?
22:02 boris-42 RainbowBastion nope
22:02 boris-42 RainbowBastion take a look at code...
22:02 boris-42 RainbowBastion https://review.openstack.org/#/c/120296/25/rally/benchmark/types.py
22:02 boris-42 RainbowBastion preprocessors = base.Scenario.meta(cls, method_name=method_name,
22:03 boris-42 RainbowBastion so base.Scenario.meta should return preprocessors
22:03 boris-42 RainbowBastion and take a look at method "set"
22:06 boris-42 RainbowBastion I left comments
22:11 jjmb1 joined #openstack-rally
22:18 rediskin left #openstack-rally
22:21 rook__ joined #openstack-rally
22:22 boris-42_ joined #openstack-rally
22:29 harlowja_ joined #openstack-rally
22:30 afazekas joined #openstack-rally
22:32 openstackgerrit_ joined #openstack-rally
22:33 marcoemorais joined #openstack-rally
22:37 boris-42 joined #openstack-rally
23:06 ilbot3 joined #openstack-rally
23:38 jjmb joined #openstack-rally
23:38 andreykurilin joined #openstack-rally
23:38 davidlenwell joined #openstack-rally
23:38 msdubov joined #openstack-rally
23:38 boris-42 joined #openstack-rally
23:38 marcoemorais joined #openstack-rally
23:38 harlowja_ joined #openstack-rally
23:38 rook__ joined #openstack-rally
23:38 jjmb1 joined #openstack-rally
23:38 penguinRaider joined #openstack-rally
23:38 temujin joined #openstack-rally
23:38 klindgren joined #openstack-rally
23:38 ilyashakhat joined #openstack-rally
23:38 77CAABBIL joined #openstack-rally
23:38 gema joined #openstack-rally
23:38 clee joined #openstack-rally
23:38 zhiyan joined #openstack-rally
23:38 isviridov joined #openstack-rally
23:38 xenolog joined #openstack-rally
23:38 mux joined #openstack-rally
23:38 jseutter joined #openstack-rally
23:38 rmk joined #openstack-rally
23:38 NikitaKonovalov joined #openstack-rally
23:38 Topic for #openstack-rally is now ☁ Rally IRC chat logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  boris-42, rediskin, andreykurilin, k4n0  ☁ Open tasks https://trello.com/b/DoD8aeZy/rally ☁ To publish changes to Rally:  https://wiki.openstack.org/wiki/Rally/Develop#How_to_contribute   ☁ Rally weekly updates:  https://wiki.openstack.org/wiki/Rally/Updates
23:39 mkoderer joined #openstack-rally
23:39 afazekas joined #openstack-rally
23:39 openstackgerrit joined #openstack-rally
23:39 ekarlso- joined #openstack-rally
23:39 msdubov joined #openstack-rally
23:39 afazekas joined #openstack-rally
23:39 marcoemorais joined #openstack-rally
23:39 msdubov joined #openstack-rally
23:39 openstackgerrit Walter A. Boring IV (hemna) proposed a change to stackforge/rally: Add a cinder volume attachment scenario  https://review.openstack.org/120283
23:42 ilbot3 joined #openstack-rally
23:42 coolsvap joined #openstack-rally
23:42 msdubov joined #openstack-rally
23:42 marcoemorais joined #openstack-rally
23:42 afazekas joined #openstack-rally
23:42 ekarlso- joined #openstack-rally
23:42 nikhil_k joined #openstack-rally
23:42 openstackgerrit joined #openstack-rally
23:42 mkoderer joined #openstack-rally
23:42 jjmb joined #openstack-rally
23:42 andreykurilin joined #openstack-rally
23:42 davidlenwell joined #openstack-rally
23:42 boris-42 joined #openstack-rally
23:42 harlowja_ joined #openstack-rally
23:42 rook__ joined #openstack-rally
23:42 penguinRaider joined #openstack-rally
23:42 temujin joined #openstack-rally
23:42 klindgren joined #openstack-rally
23:42 ilyashakhat joined #openstack-rally
23:42 gema joined #openstack-rally
23:42 clee joined #openstack-rally
23:42 zhiyan joined #openstack-rally
23:42 isviridov joined #openstack-rally
23:42 xenolog joined #openstack-rally
23:42 mux joined #openstack-rally
23:42 jseutter joined #openstack-rally
23:42 rmk joined #openstack-rally
23:42 NikitaKonovalov joined #openstack-rally
23:42 Topic for #openstack-rally is now ☁ Rally IRC chat logs http://irclog.perlgeek.de/openstack-rally ☁ Key persons to ask:  boris-42, rediskin, andreykurilin, k4n0  ☁ Open tasks https://trello.com/b/DoD8aeZy/rally ☁ To publish changes to Rally:  https://wiki.openstack.org/wiki/Rally/Develop#How_to_contribute   ☁ Rally weekly updates:  https://wiki.openstack.org/wiki/Rally/Updates
23:44 harlowja joined #openstack-rally
23:58 harlowja_ joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary