Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2015-10-02

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:08 akrzos joined #openstack-rally
00:09 cmkirkla joined #openstack-rally
00:19 cmkirkla left #openstack-rally
00:27 jjmb joined #openstack-rally
00:57 exploreshaifali joined #openstack-rally
01:24 amit213 joined #openstack-rally
01:42 arnoldje joined #openstack-rally
01:52 moravec joined #openstack-rally
01:56 puranamr joined #openstack-rally
02:18 puranamr joined #openstack-rally
02:22 puranamr joined #openstack-rally
03:09 puranamr joined #openstack-rally
03:17 puranamr joined #openstack-rally
03:31 puranamr joined #openstack-rally
03:43 puranamr joined #openstack-rally
03:57 ompp joined #openstack-rally
04:07 akrzos joined #openstack-rally
05:38 akrzos joined #openstack-rally
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: servers ext  https://review.openstack.org/229106
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: workload: fix and rename benchmark script  https://review.openstack.org/229104
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: tests: add ContextTestCase that mocks clients  https://review.openstack.org/229105
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: workload: context: introduce utils  https://review.openstack.org/229103
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: workload: fix custom_image cleanup  https://review.openstack.org/229102
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: workload: add customization by multiple commands  https://review.openstack.org/230278
05:42 openstackgerrit Pavel Boldin proposed openstack/rally: vmtasks update  https://review.openstack.org/230279
05:45 e0ne joined #openstack-rally
05:53 openstackgerrit Christian Berendt proposed openstack/rally: verification: set timeout for requests.get when testing for Horizon  https://review.openstack.org/229808
06:00 jose_lausuch joined #openstack-rally
06:22 dmorita joined #openstack-rally
06:26 boris-42 kun_huang: ping
06:29 berendt joined #openstack-rally
06:36 openstackgerrit Kiran proposed openstack/rally: Add Neutron Security Groups scenarios  https://review.openstack.org/229559
06:39 akrzos joined #openstack-rally
06:43 itlinux joined #openstack-rally
07:22 openstackgerrit Endre Karlson proposed openstack/rally: Add Designate client versioning  https://review.openstack.org/229867
07:22 jose_lausuch joined #openstack-rally
07:38 redixin joined #openstack-rally
07:40 cdent joined #openstack-rally
07:41 akrzos joined #openstack-rally
07:41 itlinux joined #openstack-rally
07:46 openstackgerrit joined #openstack-rally
08:03 tosky joined #openstack-rally
08:10 arxcruz joined #openstack-rally
08:42 openstackgerrit Sergey Skripnick proposed openstack/rally: Place config and database files in home  https://review.openstack.org/229824
08:43 akrzos joined #openstack-rally
08:51 karimb joined #openstack-rally
08:52 adiantum joined #openstack-rally
08:54 aix joined #openstack-rally
08:55 psuriset joined #openstack-rally
08:57 e0ne joined #openstack-rally
09:02 openstackgerrit Merged openstack/rally: Fix Rally reports table stats calculation  https://review.openstack.org/228403
09:15 igormarnat_ joined #openstack-rally
09:15 amaretskiy1 joined #openstack-rally
09:16 vponomaryov1 joined #openstack-rally
09:20 jaredrohe joined #openstack-rally
09:22 hughsaunders joined #openstack-rally
09:23 openstack joined #openstack-rally
09:23 openstackstatus joined #openstack-rally
09:31 e0ne joined #openstack-rally
09:43 openstackgerrit Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark  https://review.openstack.org/187643
09:44 akrzos joined #openstack-rally
09:59 fhubik joined #openstack-rally
10:06 exploreshaifali joined #openstack-rally
10:13 pcaruana joined #openstack-rally
10:18 openstackgerrit Illia Khudoshyn proposed openstack/rally: Add task format converter  https://review.openstack.org/211160
10:34 e0ne joined #openstack-rally
10:36 jaypipes joined #openstack-rally
10:41 openstackgerrit Illia Khudoshyn proposed openstack/rally: Add task format converter  https://review.openstack.org/211160
10:43 openstackgerrit Yaroslav Lobankov proposed openstack/rally: Reworked script generating tempest.conf  https://review.openstack.org/226652
10:45 exploreshaifali joined #openstack-rally
10:45 akrzos joined #openstack-rally
10:54 psd joined #openstack-rally
10:55 ig0r_ joined #openstack-rally
11:29 frickler joined #openstack-rally
11:55 openstackgerrit Merged openstack/rally: Add task argument to network wrapper  https://review.openstack.org/224300
11:56 openstackgerrit Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark  https://review.openstack.org/187643
11:56 openstackgerrit Valeriy Ponomaryov proposed openstack/rally: Add possibility to balance usage of users  https://review.openstack.org/229896
11:56 openstackgerrit Igor Degtiarov proposed openstack/rally: Add timestamps and metadata into creating samples  https://review.openstack.org/227343
11:56 openstackgerrit Igor Degtiarov proposed openstack/rally: Creation a list of samples in sample generator  https://review.openstack.org/192130
12:00 openstackgerrit Christian Berendt proposed openstack/rally: Add parameter --filename to 'verify start'  https://review.openstack.org/230087
12:01 e0ne joined #openstack-rally
12:02 akrzos joined #openstack-rally
12:02 openstackgerrit Christian Berendt proposed openstack/rally: Add parameter --tests-filename to 'verify start'  https://review.openstack.org/230087
12:18 tosky joined #openstack-rally
12:19 mwagner_ joined #openstack-rally
12:20 openstackgerrit Valeriy Ponomaryov proposed openstack/rally: [Manila] Add context for Manila with autocreated resources + benchmark  https://review.openstack.org/187643
12:20 openstackgerrit Valeriy Ponomaryov proposed openstack/rally: Rename Manila share network context  https://review.openstack.org/230395
12:22 MaxPC joined #openstack-rally
12:29 fhubik joined #openstack-rally
12:51 ompp joined #openstack-rally
12:55 stpierre joined #openstack-rally
12:56 ekarlso joined #openstack-rally
12:56 ekarlso https://review.openstack.org/#/c/229867/1 < anyone got a clue on that failure ?
12:56 karimb joined #openstack-rally
12:57 dspano joined #openstack-rally
13:09 stpierre ekarlso: something in the post-test hook took a long dang time. try rechecking.
13:15 itlinux joined #openstack-rally
13:23 karimb joined #openstack-rally
13:38 openstackgerrit Sergey Skripnick proposed openstack/rally: Place config and database files in home  https://review.openstack.org/229824
13:45 RafaelChiafarell joined #openstack-rally
13:46 RafaelChiafarell hi guys, I am trying to run two scenario tests into one yaml, something like create_and_delete_snapshot and create_and_delete_volume... can it be done? is there a how to on that subject? thanks
13:47 spyderdyne joined #openstack-rally
13:48 boris-42 RafaelChiafarell: yep
13:48 boris-42 RafaelChiafarell: https://rally.readthedocs.org/en/latest/tutorial/step_2_input_task_format.html
13:49 RafaelChiafarell boris-42: cool! tks! that was exactly what I was looking for!
13:51 boris-42 RafaelChiafarell: as well these tasks are actually jinja2 template
13:52 boris-42 RafaelChiafarell: so this might be interesting for you https://rally.readthedocs.org/en/latest/tutorial/step_5_task_templates.html
13:55 RafaelChiafarell boris-42: yep... that´s cool too! I get to look into it! Another thing, when using the create_and_delete_volume, can I select the volume type? or a set up of the cinder driver being used?
13:55 openstackgerrit Oleh Anufriiev proposed openstack/rally: [Fuel] scenario for add and remove node  https://review.openstack.org/181270
13:55 boris-42 RafaelChiafarell: so basically you can pass all arugments that are accepted by cinder volume create method in cinder python clinet
13:57 RafaelChiafarell boris-42: Understood... I have to configure the cinder with a given volume type, run the benchmark, and then change the cinder config to another driver to run it again....
13:59 openstackgerrit Oleh Anufriiev proposed openstack/rally: [Fuel] scenario for add and remove node  https://review.openstack.org/181270
13:59 boris-42 RafaelChiafarell: yep Rally is just triggering API for now
13:59 RafaelChiafarell boris-42: cool... tks!
14:07 arnoldje joined #openstack-rally
14:22 openstackgerrit Yaroslav Lobankov proposed openstack/rally: Small improvements for `rally verify import`  https://review.openstack.org/230456
14:26 redixin joined #openstack-rally
14:29 exploreshaifali joined #openstack-rally
14:35 openstackgerrit Oleh Anufriiev proposed openstack/rally: [Fuel] scenario for add and remove node  https://review.openstack.org/181270
14:37 openstackgerrit Harsh Shah proposed openstack/rally: Add resource fault detail in exception  https://review.openstack.org/230006
14:54 tosky joined #openstack-rally
14:59 cdent joined #openstack-rally
15:09 psd joined #openstack-rally
15:16 rook joined #openstack-rally
15:18 rook joined #openstack-rally
15:20 davideagnello joined #openstack-rally
15:34 openstackgerrit Chris St. Pierre proposed openstack/rally: Better random resource name generator  https://review.openstack.org/184888
15:34 openstackgerrit Chris St. Pierre proposed openstack/rally: Implement new random name generator for scenario plugins  https://review.openstack.org/226385
15:34 openstackgerrit Chris St. Pierre proposed openstack/rally: Implement new random name generator for wrapper plugins  https://review.openstack.org/226387
15:34 openstackgerrit Chris St. Pierre proposed openstack/rally: Implement new random name generator for context plugins  https://review.openstack.org/226386
15:34 openstackgerrit Chris St. Pierre proposed openstack/rally: Remove old random name generator  https://review.openstack.org/226388
16:11 adiantum joined #openstack-rally
16:16 karimb joined #openstack-rally
16:22 emagana joined #openstack-rally
16:25 emagana_ joined #openstack-rally
16:34 [Aura]MaelStrom joined #openstack-rally
16:39 karmatronic joined #openstack-rally
16:39 karmatronic joined #openstack-rally
16:44 rvasilets ekarlso, hi. I'm here
16:50 RafaelChiafarell boris-42: quick one, is there a way to transfer a task result from one deployment to another?
17:01 harlowja joined #openstack-rally
17:01 davideagnello joined #openstack-rally
17:33 berendt joined #openstack-rally
17:37 rvasilets___ joined #openstack-rally
17:40 ChanServ joined #openstack-rally
17:43 pvaneck joined #openstack-rally
17:49 josdotso joined #openstack-rally
18:01 e0ne joined #openstack-rally
18:13 openstackgerrit Harsh Shah proposed openstack/rally: Add resource fault detail in exception  https://review.openstack.org/230006
18:19 jesusaurus joined #openstack-rally
18:20 jesusaurus are there manual rally installation instructions anywhere? I'm looking for something that doesn't include "curl | bash"
18:21 jesusaurus also, why do the docs all refer to github instead of git.o.o?
18:24 stpierre you can clone it and run install_rally.sh
18:25 stpierre but curl | bash kind of *is* the manual installation path. 'git clone ... && ./install_rally.sh' is just a longer way of writing the same thing
18:29 jesusaurus well, I was expecting to be able to pip install it, but I'm currently reading through the script to see what else needs to be done
18:33 jjmb joined #openstack-rally
18:41 jesusaurus is it the database set-up that requires the install script instead of using a setup.py?
18:43 stpierre i guess that's probably the biggest "requirement"
18:43 stpierre but, of course, the install script does lots of other stuff to make your life easy
18:46 sasha_ joined #openstack-rally
18:48 e0ne joined #openstack-rally
18:50 sasha_ Hey guys, wondering what are the nova client apis behind nova show <serverid> and nova console-log <server id> operations.
18:52 sasha_ I'm guessing for nova console-log operation, it is the get-console-output api (https://github.com/openstack/python-novaclient/blob/master/novaclient/v2/servers.py#L1129)
18:53 sasha_ Is it 'get' api for nova show? https://github.com/openstack/python-novaclient/blob/master/novaclient/v2/servers.py#L542
18:57 jesusaurus is it possible to run rally without an admin role?
19:00 jesusaurus I don't see why samples/tasks/scenarios/nova/boot-and-delete.json would require an admin role
19:01 RafaelChiafarell hey guys, regarding rally output, what are the available formats? I saw HTML.... Is there a CSV or another format that I can read as a spreadsheet?
19:02 stpierre there's JSON
19:02 harshs joined #openstack-rally
19:02 stpierre jesusaurus: it doesn't require an admin role. if you have existing users set up, it should work without admin
19:05 jesusaurus stpierre: hm, I tried creating a deployment from my environment, but all the tasks give me an error about the user not having the admin role
19:06 sasha_ stpierre: Could you pls let me know what are the nova client api's behind SHOW and CONSOLE-LOG operations?
19:08 jesusaurus I guess it assumed the user was an admin, I'll try creating a deployment.json and loading from that
19:09 stpierre if you have a user with an admin role, that's a lot easier. otherwise, you'll need to configure existing users (http://rally.readthedocs.org/en/latest/tutorial/step_3_benchmarking_with_existing_users.html)
19:10 stpierre sasha_: i could RTFS to find out, but you can do that yourself (and it sounds like you already have). i'd suggest you fire up your favorite interactive python interpreter and confirm your suspicions
19:16 sasha_ stpierre: Sure, thanks ;)
19:22 e0ne joined #openstack-rally
19:42 boris-42 jesusaurus: to get stars on project=)
19:43 jesusaurus so I don't think I'm able to run rally at all, because I don't have a user with an admin role
19:43 boris-42 jesusaurus: so the only thing why you need install script is to install bunch of system requriemnts
19:44 jesusaurus I can't create a deployment without an admin, and using a bogus admin causing anything and everything to fail with bad credentials
19:44 jesusaurus boris-42: thanks, yeah i figured that out once i read the script :)
19:44 boris-42 jesusaurus: so basically maybe we shuold maintain as well manual installation
19:44 boris-42 jesusaurus: but it will look like that script LOL more or less
19:48 boris-42 jesusaurus: so about admin user yep you need that
19:48 boris-42 jesusaurus: but if you are DevOps I can help you with hacking rally
19:48 boris-42 jesusaurus: to remove that
19:49 jesusaurus yeah, I was hoping to just run a couple of simple tasks as a user to get a baseline on a cloud before putting heavy load on it
19:56 boris-42 jesusaurus: so yep non-admin mode is still not done ..
19:57 mwagner_ joined #openstack-rally
20:12 boris-42 stpierre: are you around
20:12 stpierre yep
20:12 boris-42 stpierre: why do you don't like the idea of putting DB to ~/.rally/whatever
20:12 boris-42 dir?)
20:12 stpierre i do like that idea, for venv installations
20:12 stpierre for system-wide installations, putting it in someone's home seems at odds with the system-wide installation
20:25 jjmb1 joined #openstack-rally
20:27 jesusaurus i would expect it to go in /var/lib/rally/ for a system-wide installation
20:29 moravec joined #openstack-rally
20:29 boris-42 jesusaurus: stpierre so the thing here is the next
20:29 boris-42 jesusaurus: stpierre if we install rally in system-wide
20:30 boris-42 it means that N users can access it simultaneously
20:30 stpierre yeah, and then it has to be 777
20:30 stpierre which sucks
20:30 stpierre but it at least works
20:30 boris-42 if that happen Rally will crash
20:30 stpierre oh, hah, really?
20:30 boris-42 stpierre: no
20:30 boris-42 stpierre: it's sqlite file
20:30 stpierre hahahaha, sqlite is so terrible
20:31 boris-42 stpierre: not sure that it will work well in such cases
20:31 stpierre it should lock things so that performance suffers, but you don't get out-and-out crashes
20:31 boris-42 like you will have siutation when you need to open N times to write single file
20:32 boris-42 http://stackoverflow.com/questions/5102027/can-sqlite-support-multiple-user
20:32 boris-42 stpierre: ^ hm it can
20:32 stpierre okay, that's what i thought. sqlite is bad, but not *that* bad :)
20:32 jesusaurus it doesn't need to be 777, you can control it with group permissions, but that doesn't do anything about sqlite failing with multiple users
20:33 stpierre yes, if you know what group you want to limit it to. and i know that sqlite uses temp files a lot, so you might need umasks set properly, too
20:33 stpierre obviously if you're doing a multi-user install you *should* be using a real database
20:33 stpierre so as i see it, we can either a) force that, and refuse to do a system-wide install with sqlite; or b) try our best to make a system-wide install work, even if it means doing stupid things
20:33 jesusaurus (a) makes sense to me
20:33 MoD joined #openstack-rally
20:35 Guest397 Hi. Is there any rally test result reference? I ran rally over my infrastructure, but I have not a base to know is my openstack slow or fast?
20:36 stpierre i could be convinced either way, but it'll be harder to convince me that we should do a system-wide install that only works for one user
20:36 stpierre Guest397: it's slow. it's openstack.
20:37 stpierre but seriously, no. although there's a lot of work afoot to do wide-ranging certification of openstack with rally, which will start to achieve some of the same goals
20:39 Guest397 stpierre: I want to know how much it is slow when compared to other deployments!
20:39 stpierre that obviously depends on a *lot* of things. no one else in the history of the universe has ever built openstack on the exact same hardware as you have, for instance.
20:39 MaxPC joined #openstack-rally
20:41 stpierre if i were you, i'd instead focus on using rally for historical trending (e.g., use it to figure out when assigning a floating ip suddently started taking 10x as long); for benchmarking of known trouble areas (e.g., when a user reports that booting an instance is taking "too long"); and for functional testing that's easier than tempest. otherwise you're just comparing bogomips with random people on the internets
20:41 boris-42 stpierre: jesusaurus so let's just do the 777
20:42 boris-42 stpierre: jesusaurus and get it work at least for single user without requiring user to do the post installation chown
20:43 boris-42 Guest397: so it's like enterprise grade system so there is no reason to be fast LOL ;)
20:43 boris-42 Guest397: so about comparing results
20:44 boris-42 Guest397: nobody wants to share results =(
20:44 boris-42 Guest397: however we are working on Rally certification https://github.com/openstack/rally/tree/master/certification/openstack here
20:44 boris-42 Guest397: so some day we will introduce scoring system as well
20:44 stpierre yeah, i'm sure the only way we'd share results is after throwing an ungodly amount of hardware at it so that we could get ZOMG ALL THE FAST results
20:45 stpierre ok, weekend.
20:48 openstackgerrit Merged openstack/rally: Add resource fault detail in exception  https://review.openstack.org/230006
20:56 boris-42 https://twitter.com/PavlovicBoris/status/650047888832139264 lol
21:00 openstackgerrit Boris Pavlovic proposed openstack/rally: Fix the install_rally.sh script to make proper permission to sqlite file  https://review.openstack.org/230642
21:21 jjmb joined #openstack-rally
22:17 openstackgerrit Boris Pavlovic proposed openstack/rally: Fix install_rally.sh set 777 access to sqlite file  https://review.openstack.org/230642
22:18 openstackgerrit Boris Pavlovic proposed openstack/rally: Fix install_rally.sh set 777 access to sqlite file  https://review.openstack.org/230642
22:30 boris-42 kun_huang: ping
22:30 boris-42 redixin: areound?
22:53 itlinux joined #openstack-rally
23:14 itlinux joined #openstack-rally
23:31 akrzos joined #openstack-rally
23:54 openstackgerrit Yaroslav Lobankov proposed openstack/rally: Reworked script generating tempest.conf  https://review.openstack.org/226652

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary