Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2016-08-05

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:11 rook The new format seems overly complicated
00:12 rook andreykurilin boris-42 anyone i can chat with about the new schema?
00:14 andreykurilin__ rook you can try to ping ikhudoshin when he will be online
00:14 andreykurilin__ Or just leave comments to patch:)
00:15 rook andreykurilin__ is it just a patch right now?
00:15 rook it hasn't been implemented?
00:16 andreykurilin__ took are you talking about new task format or new db schema?
00:16 rook andreykurilin__ sorry, the VMTask scenario output
00:16 andreykurilin__ Oh
00:16 andreykurilin__ :)
00:16 andreykurilin__ Ok
00:16 rook https://github.com/openstack/rally/blob/master/doc/specs/implemented/improve_scenario_output_format.rst
00:17 andreykurilin__ You should try to ping amaretskiy
00:17 andreykurilin__ He should be online in 7-8 hours
00:17 andreykurilin__ Lol
00:18 rook lol
00:18 rook grand
00:18 rook he hasn't moved over?
00:19 andreykurilin__ No
00:20 andreykurilin__ So amaretskiy was working on proposal and new implementation of scenario output
00:20 rook please don't change the json
00:20 rook :D
00:20 andreykurilin__ ))))
00:24 rook lol does that mean yes?
00:25 andreykurilin__ It means nothing)) I don't use custom scenario output, so I don't know how is it:)
00:26 andreykurilin__ If it so bad, we can raise this topic at Monday's weekly meeting
00:29 andreykurilin__ Ok, I'm not boris-42 , so I need to sleep sometimes:) please, ping tomorrow amaretskiy and he will answer all your questions about scenario output. He should be available till ~16:00 UTC or something like that
00:32 rook :D
00:33 yingjun joined #openstack-rally
00:45 openstackgerrit Merged openstack/rally: Add Senlin plugin for profile and cluster  https://review.openstack.org/301522
00:58 openstackgerrit chenhb proposed openstack/rally: [WIP] Add  NovaServers.boot_server_and_multiple_attach_volume  https://review.openstack.org/351445
01:02 abalutoiu__ joined #openstack-rally
01:04 openstackgerrit chenhb proposed openstack/rally: [WIP] Add  NovaServers.boot_server_and_multiple_attach_volume  https://review.openstack.org/351445
01:14 openstackgerrit chenhb proposed openstack/rally: [WIP] Add  NovaServers.boot_server_and_multiple_attach_volume  https://review.openstack.org/351445
01:28 yanyanhu joined #openstack-rally
01:37 yingjun joined #openstack-rally
01:53 liuyulong joined #openstack-rally
02:17 dave-mcc_ joined #openstack-rally
02:21 openstackgerrit Brooke Trimble proposed openstack/rally: Clarify docs around results report  https://review.openstack.org/351459
02:22 maeca1 joined #openstack-rally
02:47 openstackgerrit chenhb proposed openstack/rally: Add  NovaServers.boot_server_and_multiple_attach_volume  https://review.openstack.org/351445
03:40 openstackgerrit chenhb proposed openstack/rally: Add  NovaServers.boot_server_and_multiple_attach_volume  https://review.openstack.org/351445
04:00 yingjun joined #openstack-rally
04:28 liuyulong joined #openstack-rally
04:29 yingjun joined #openstack-rally
04:53 yingjun joined #openstack-rally
05:30 rcernin joined #openstack-rally
05:31 e0ne joined #openstack-rally
05:37 abalutoiu joined #openstack-rally
05:37 yingjun joined #openstack-rally
06:10 psuriset joined #openstack-rally
06:19 ashishg_ joined #openstack-rally
06:29 kavithas joined #openstack-rally
06:45 psuriset joined #openstack-rally
07:00 yamamot__ joined #openstack-rally
07:16 amaretskiy joined #openstack-rally
07:19 yingjun joined #openstack-rally
07:24 rdas joined #openstack-rally
07:26 amaretskiy joined #openstack-rally
07:45 abalutoiu joined #openstack-rally
08:03 openstackgerrit joined #openstack-rally
08:16 tesseract- joined #openstack-rally
09:12 openstackgerrit Merged openstack/rally: Clarify docs around results report  https://review.openstack.org/351459
09:14 e0ne joined #openstack-rally
09:23 yingjun joined #openstack-rally
09:29 yingjun joined #openstack-rally
09:30 abehl joined #openstack-rally
09:35 sskripnick joined #openstack-rally
10:34 arcimboldo joined #openstack-rally
10:43 tosky joined #openstack-rally
11:19 yamamoto joined #openstack-rally
11:36 rook amaretskiy: ping - question regarding the new format for VMTask scenario outpiut
11:36 rook output
11:38 amaretskiy rook: hi
11:38 amaretskiy rook:  what is the question?
11:39 rook amaretskiy: seems like the new output is built to drive a rally webpage.
11:39 rook amaretskiy: however, what if I don't necessarily care about the webpage, but want the results to be reported within the Rally JSON?
11:40 amaretskiy rook: you can add custom data inside scenario code by calling method add_output()
11:40 rook https://gist.githubusercontent.com/jtaleric/42f8a7fa179fdf16957b759f34a083d1/raw/bf9cd0069a2fda16f663bfefa0be24995ea48de5/result.json
11:40 amaretskiy this method will actually add the data to iteration results
11:40 rook amaretskiy ^ is a example data set i generate
11:41 rook so, could I just send that dict? or do I need to format it?
11:41 amaretskiy data should b ein proper format in order to be correctly displayed in html report Scenario Data tab
11:41 rook it seems it is a list of lists
11:41 amaretskiy however this data exists in result spermanently
11:41 amaretskiy you can run rally task results <uuid> > results.json
11:41 rook as long as the results end up in the Rally JSON as well, I am good :)
11:41 amaretskiy and find this data in the json
11:42 rook good
11:42 amaretskiy rook: the format of "data" differs depending of value of "plugin_name"
11:42 amaretskiy because different charts requires different imput format
11:42 rook amaretskiy so is it a freeform field?
11:43 rook as mentioned I don't care about the charts
11:43 amaretskiy for example pie chart differs from lines and from generic html table
11:43 rook I am shipping the Rally JSON to Elastic, and building dashboards.
11:43 rook i see
11:43 amaretskiy no, this is not a freeform field in a fact, but it is not validated yet (i'm planning to add this validation)
11:44 amaretskiy there will be issues in html if you use "plugin_name": "Pie" but in "data": <data format for StackedArea>
11:44 amaretskiy i will add a validation later
11:45 amaretskiy you can find examples in docs and docstrings about data format for each chart plugin
11:45 amaretskiy rook: https://rally.readthedocs.io/en/latest/plugin/plugin_reference.html#processing-output-charts
11:46 amaretskiy rook: real-code example:  https://github.com/openstack/rally/blob/master/rally/plugins/common/scenarios/dummy/dummy.py#L116-L172
11:47 yamamoto joined #openstack-rally
11:47 amaretskiy rook: this is how it shown in html: http://logs.openstack.org/20/297020/48/check/gate-rally-dsvm-rally/c713f56/rally-plot/results.html.gz#/Dummy.dummy_output/output
11:47 rook amaretskiy: ill check it out
11:48 amaretskiy if you need to find this data only in JSON then you can do not care about format a lot until you try to render HTML - you can expirience issues in report....
11:49 adiantum joined #openstack-rally
11:49 amaretskiy *experience
11:51 rook amaretskiy so addative vs complete?
11:51 amaretskiy additive: this is a common question about reports :)
11:51 amaretskiy additive is a data for generic charts
11:52 amaretskiy these charts are processed for all iterations
11:52 amaretskiy complete is a complete chart - it is shown for this explicit iteration
11:52 amaretskiy in other words, iteration generates complete chart
11:53 rook do i have to use both, or can I just use one?
11:53 rook from the examples I see both being used
11:53 amaretskiy in opposite to providing a value for one point for chart where another points are taken from other iterations
11:53 amaretskiy you can use any :)
11:54 amaretskiy any types, any charts : )
11:54 amaretskiy Scenario Data tab is very flexible :)
11:55 amaretskiy rook: for example, here is only additive: https://github.com/openstack/rally/blob/master/rally/plugins/common/scenarios/dummy/dummy.py#L122-L127
11:55 amaretskiy you can call add_output() many times
11:56 openstackgerrit Merged openstack/rally: [Plugins] Fix vm.utils._run_command_over_ssh  https://review.openstack.org/325189
11:56 amaretskiy all data will be saved :)
12:01 amaretskiy rook: by the way, I remember you asked about Rally-as-a-Service someday, you can take a look at this demo patch: https://review.openstack.org/#/c/336636/
12:08 dave-mccowan joined #openstack-rally
12:21 rook amaretskiy: sure...
12:21 rook amaretskiy: I have a cool plugin that does some complex work.
12:22 rook hence the question regarding addative/complete output
12:23 amaretskiy rook: do not hesitate to contact me about reports :)
12:24 rook https://review.openstack.org/#/c/345522 amaretskiy
12:27 rook amaretskiy plugin creates a jump-host (single fip) and eventually n number of pairs of guests to run things like uperf (netperf but better :D )
12:28 amaretskiy great, that is the time to draw nice charts with results :)
12:31 openstackgerrit Anton Studenov proposed openstack/rally: [spec] New Tasks Configuration section - hook  https://review.openstack.org/350748
12:40 rook amaretskiy well, our framework takes Rally Json's and ships it to ElasticSerach, then we build Kibana dashboards :)
12:40 amaretskiy rook: headshot :)
12:40 rook amaretskiy for historical reasons
12:45 stpierre joined #openstack-rally
13:05 catintheroof joined #openstack-rally
13:08 yamamoto joined #openstack-rally
13:16 matthewli_ joined #openstack-rally
13:32 diogogmt joined #openstack-rally
13:41 maeca1 joined #openstack-rally
13:46 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Doc] Remove stale page miscellaneous/concepts.rst  https://review.openstack.org/351747
14:03 openstackgerrit joined #openstack-rally
14:05 e0ne joined #openstack-rally
14:07 catintheroof joined #openstack-rally
14:14 lutostag joined #openstack-rally
14:31 openstackgerrit Alexander Maretskiy proposed openstack/rally: [Reports] Expand menu if there is only one menu group  https://review.openstack.org/351770
14:35 diogogmt joined #openstack-rally
14:45 yamamoto joined #openstack-rally
14:52 diogogmt joined #openstack-rally
15:11 yamamoto joined #openstack-rally
15:17 e0ne joined #openstack-rally
15:30 klindgren_ joined #openstack-rally
16:04 davideagnello joined #openstack-rally
16:07 KevinE joined #openstack-rally
16:08 KevinE joined #openstack-rally
16:13 davideagnello joined #openstack-rally
16:43 kuladeep joined #openstack-rally
17:13 diogogmt joined #openstack-rally
17:27 davideagnello joined #openstack-rally
17:30 diogogmt joined #openstack-rally
17:44 e0ne joined #openstack-rally
17:45 abehl joined #openstack-rally
17:55 sskripnick joined #openstack-rally
18:07 e0ne_ joined #openstack-rally
18:30 davideagnello joined #openstack-rally
19:16 lutostag joined #openstack-rally
19:34 davideagnello joined #openstack-rally
19:45 dave-mccowan joined #openstack-rally
19:57 dave-mccowan joined #openstack-rally
20:00 liuyulong_ joined #openstack-rally
20:09 sskripnick joined #openstack-rally
20:30 davideagnello joined #openstack-rally
21:09 yamamoto joined #openstack-rally
21:52 davideagnello joined #openstack-rally
21:59 yamamoto joined #openstack-rally
22:11 bkopilov joined #openstack-rally
22:56 yamamoto joined #openstack-rally
23:06 davideagnello joined #openstack-rally
23:41 yamamoto joined #openstack-rally

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary