Perl 6 - the future is here, just unevenly distributed

IRC log for #openstack-rally, 2014-11-17

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:29 dmorita joined #openstack-rally
01:30 yaguang joined #openstack-rally
02:36 openstackgerrit Li Yingjun proposed stackforge/rally: Sync oslo-incubator  https://review.openstack.org/134847
02:39 erkules_ joined #openstack-rally
04:36 Poornima joined #openstack-rally
04:43 AlexF joined #openstack-rally
04:50 Dmitry_Savenkov joined #openstack-rally
04:50 mcaulfie joined #openstack-rally
04:52 andreykurilin joined #openstack-rally
05:02 mcaulfie_ joined #openstack-rally
05:17 nkhare joined #openstack-rally
05:20 chandankumar joined #openstack-rally
05:35 neeti joined #openstack-rally
06:02 rdas joined #openstack-rally
06:06 jjmb joined #openstack-rally
06:51 yaguang joined #openstack-rally
08:04 arcimboldo joined #openstack-rally
08:04 arcimboldo Hi all, I wanted to test rally, but why do I need to be root?? Can I install everything on a virtualenv?
08:48 ehaselwanter joined #openstack-rally
08:53 arcimboldo joined #openstack-rally
08:57 oanufriev joined #openstack-rally
09:17 amaretskiy joined #openstack-rally
09:24 rvcehimanshu joined #openstack-rally
09:30 msdubov_ joined #openstack-rally
09:34 arcimboldo hi all: is it possible to install rally without being root?
09:39 openstackgerrit Mikhail Dubov proposed stackforge/rally: Further improvements in rally info  https://review.openstack.org/134666
09:41 rediskin joined #openstack-rally
09:42 oanufriev arcimboldo: Yes. Use virtualenv and don't use /etc/rally/* (use ~/.rally to store config)
09:42 rediskin left #openstack-rally
09:42 oanufriev arcimboldo: are you familiar with virtualenv?
09:42 rediskin joined #openstack-rally
09:55 arcimboldo oanufriev, yes, but the install script and also the setup.py is trying to write to /etc/rally
10:00 pboros joined #openstack-rally
10:00 oanufriev joined #openstack-rally
10:01 arcimboldo oanufriev, have you seen my answer or you were kicked out too soon? :)
10:07 oanufriev arcimboldo: i was kicked
10:20 openstackgerrit Oleh Anufriiev proposed stackforge/rally: add 'rally task list' filters  https://review.openstack.org/131005
10:20 openstackgerrit Oleh Anufriiev proposed stackforge/rally: add ability to refer deployment by uuid or name  https://review.openstack.org/131463
10:30 rvcehimanshu1 joined #openstack-rally
10:33 boris-42 joined #openstack-rally
10:40 arcimboldo oanufriev, I am familiar with virtualenv, but both the install script and setup.py of rally want to write in /etc/rally
10:44 openstackgerrit Mikhail Dubov proposed stackforge/rally: Further improvements in rally info  https://review.openstack.org/134666
10:57 openstackgerrit Oleh Anufriiev proposed stackforge/rally: Added separate log level for Rally debugging  https://review.openstack.org/132815
11:07 boris-42 arcimboldo: yep
11:08 chandankumar joined #openstack-rally
11:08 boris-42 arcimboldo: cause it's the place where we are storing rally.conf file
11:08 arcimboldo boris-42, no way to store the configuration in my home directory?
11:09 boris-42 arcimboldo:  as far as I know no..
11:09 andreykurilin boris-42, arcimboldo : bash completition for rally is stored in /etc too. https://github.com/stackforge/rally/blob/master/setup.cfg#L24-L26
11:09 boris-42 arcimboldo: why it makes sense?
11:10 arcimboldo Well, it defeat the whole purpose of using virtualenvs... I want to create a virtualenv, install packages, and then delete it cleanly
11:11 arcimboldo bash-completion can be installed in home too, and should be optional
11:11 boris-42 arcimboldo: actually virtualenv has a whole other issues with isolating
11:11 boris-42 arcimboldo: and deleting /etc/rally* is not so big deal-)
11:12 oanufriev boris-42, arcimboldo: this issue is with rally bash completion script
11:12 oanufriev not rally.conf
11:12 arcimboldo boris-42, we agree on disagree :) so the answer to my question is: rally cannot be installed as unprivileged user, right?
11:13 oanufriev arcimboldo: rally cannot be installed as unprivileged user, right - > True
11:13 boris-42 arcimboldo: we can try to find the way to do it..
11:13 boris-42 rediskin: ^
11:14 rediskin way to install rally as non-root?
11:15 boris-42 rediskin: arcimboldo has some use cases for that*
11:16 rediskin it may be installed in venv
11:16 rediskin but still have to install some deps
11:16 rediskin like python-dev
11:16 rediskin how to install python-dev by non-root?
11:17 rediskin it is possible to install all toolchain in sandbox
11:17 rediskin and then build all rally deps by this toolchain
11:18 arcimboldo you can't, but python-dev is usually available as a deb/rpm package, and your sysadmin will install it without complaining
11:19 rediskin "ask sysadmin to install rally" == "install rally without root privileges"
11:20 rediskin if you can ask sysadmin to install all required apts/rpms, then you can install rally in venv
11:20 rediskin you may find all this deps in install_rally.sh script
11:20 rediskin see functions install_rally_deps or something similar
11:20 andreykurilin rediskin: rediskin problem in permission to /etc dir
11:21 arcimboldo rediskin, no, it's not the same: a sysadmin usually trusts its distribution, and might not equally trust a software downloaded from github
11:22 arcimboldo if I install something in a virtualenv, i *expect* everything to stay in that virtualenv, not scattered around the filesystem.
11:22 rediskin maybe we should make rally work with alternate config file path, like ~/rally/etc/
11:22 rediskin and store database in ~/rally/db/
11:23 arcimboldo rediskin, ~/.rally/ would probably be more appropriate, or if installed in a virtualenv, $VIRTUALENVPATH/etc/rally
11:24 rediskin we need to file a bug, and find someone to assign this bug to
11:25 boris-42 arcimboldo: ya seems like a valid stuff
11:26 boris-42 arcimboldo: want to help on this?
11:26 boris-42 =)
11:27 rvcehimanshu joined #openstack-rally
11:31 rediskin left #openstack-rally
11:34 rediskin joined #openstack-rally
11:35 arcimboldo boris-42, yes I may
11:35 arcimboldo although I kindly *hate* setuptools
11:35 arcimboldo but I already did something similar, writing stuff in VIRTUALENVPATH/share
11:35 boris-42 arcimboldo: that will be nice! thanks=)
11:35 arcimboldo how can I submit a pull request/patch?
11:36 boris-42 arcimboldo: do you experience with contributing to other stackforge/* openstack/* projects?
11:38 vkmc joined #openstack-rally
11:38 boris-42 arcimboldo: in no => here is manual https://wiki.openstack.org/wiki/Rally/Develop#How_to_contribute
11:39 boris-42 if no*
11:48 arcimboldo boris-42, not really, and I always forget :)
11:49 openstackgerrit joined #openstack-rally
11:49 arcimboldo but I can RTFM
11:49 boris-42 arcimboldo: so it's a bit painful lol for first time...
11:49 boris-42 arcimboldo: =)
11:49 arcimboldo I'll take my time, it's  a very busy week/month/year ...
11:52 boris-42 arcimboldo: =)
12:03 openstackgerrit Merged stackforge/rally: Added separate log level for Rally debugging  https://review.openstack.org/132815
12:10 openstackgerrit Mikhail Dubov proposed stackforge/rally: Further improvements in rally info  https://review.openstack.org/134666
12:18 jaypipes joined #openstack-rally
12:23 nkhare joined #openstack-rally
13:09 boris-42 jlk: hi there
13:10 boris-42 k4n0_: hi there
13:10 k4n0_ boris-42, hi :)
13:10 boris-42 k4n0_: could you please remove workflow https://review.openstack.org/#/c/127392/ here
13:10 k4n0_ boris-42, oops
13:22 AlexF_ joined #openstack-rally
13:40 openstackgerrit Victoria Martínez de la Cruz proposed stackforge/rally: Fix Zaqar's cleanup  https://review.openstack.org/134661
13:50 vkmc I always forget adding check experimental, thanks boris-42
13:50 boris-42 vkmc:  -)
13:50 boris-42 vkmc:  ya we need to find the way to make it automatically =)
13:53 vkmc boris-42, or... have contributors with a better memory :)
13:53 vkmc lol
13:54 boris-42 vkmc: lol=)
13:54 boris-42 vkmc:  I om with current devs;) just need more automation=)
13:54 boris-42 vkmc: btw guys are you going to add rally job to zaqar check pipeline?
14:06 boris-42 vkmc: woot
14:06 boris-42 vkmc: your change works=)
14:06 vkmc !
14:07 vkmc boris-42, regarding the rally job to zaqar check pipeline, I'll bring that up in today's meeting
14:07 vkmc boris-42, we discussed about that during the summit... so :)
14:07 boris-42 vkmc: ok=)
14:07 boris-42 vkmc:  I can make all related to that changes=)
14:08 vkmc boris-42, that would be awesome!
14:08 vkmc boris-42, now that we fixed the client, I'll add other scenarios
14:09 boris-42 vkmc: great=)
14:09 boris-42 vkmc:  so I'll make required patches for zaqar today a bit latter=)
14:09 vkmc boris-42, thanks B :)
14:11 openstackgerrit Oleh Anufriiev proposed stackforge/rally: add 'rally task list' filters  https://review.openstack.org/131005
14:11 openstackgerrit Oleh Anufriiev proposed stackforge/rally: add ability to refer deployment by uuid or name  https://review.openstack.org/131463
14:15 paboldin hi guys. is there anyone working on the fuel-rally interoperability?
14:18 boris-42 paboldin: lol
14:18 boris-42 paboldin:  they work without any issuess..
14:18 paboldin boris-42: uhm, i seem to use an outdated version then
14:18 boris-42 paboldin:  they works togheter for months
14:19 boris-42 work*
14:19 boris-42 paboldin:  I mean almost since begging
14:19 boris-42 paboldin:  services + scale lab are prof
14:19 paboldin hm. but i had troubles with deployment via fuel
14:20 boris-42 rediskin:  amaretskiy ^
14:20 boris-42 paboldin:  share traces/logs anything
14:20 boris-42 paboldin: I have to go but amaretskiy and rediskin can help you
14:20 paboldin see you
14:28 paboldin amaretskiy, rediskin: ping
14:33 amaretskiy pong
14:34 amaretskiy paboldin, hi
14:34 paboldin amaretskiy: is there any howto on fuel deployment schemes?
14:34 amaretskiy paboldin you can ask me about rally/fuel
14:36 amaretskiy paboldin usually this is generic deployment
14:36 paboldin I keep getting these 2014-11-17 16:35:56.339 14833 TRACE rally FuelClientException: FuelClientException. Code: 401 Body: Authentication required
14:36 paboldin (w/o my patches)
14:36 amaretskiy all that you need is netwok connection to your fuel cluster controller
14:36 amaretskiy but
14:37 amaretskiy you cluster must be type of  Multinode
14:37 amaretskiy in case of HA you need to setup additinal routes
14:37 amaretskiy *additional
14:39 paboldin 'cluster controller' -- you mean openstack? or 'fuel master'?
14:39 amaretskiy controller means openstack controller node
14:40 openstackgerrit Merged stackforge/rally: Fix Zaqar's cleanup  https://review.openstack.org/134661
14:40 paboldin so, there is no tested fuel deployment code for rally?
14:40 amaretskiy fuel master plays no role for rally actions
14:41 amaretskiy please make your question clear
14:41 amaretskiy I do not understand the question
14:41 paboldin there is the file doc/samples/deployments/fuel-multinode.json that is supposed to deploy a fuel cluster.
14:41 paboldin and there is the code that uses it rally/deploy/engines/fuel.py.
14:42 paboldin is there any users of that?
14:42 cdent joined #openstack-rally
14:42 amaretskiy yes
14:42 amaretskiy that is working code
14:42 amaretskiy I use only FUEL in my rally development, every day
14:43 amaretskiy oh, sorry
14:44 amaretskiy you are asking about deploying fuel openstack cluster, not "rally deployment for existing cloud"
14:44 amaretskiy now I understand
14:44 paboldin yep
14:44 paboldin "(16:34:56) paboldin: amaretskiy: is there any howto on fuel deployment schemes?"
14:45 paboldin ok, i need that so it seems like i will have to fix support for this
14:46 amaretskiy the json configuration that you have mentioned was tested and should work well, hoverer I usually deploy FUEL manually.
14:46 amaretskiy for now I do not know any specific HOWTO for these json samples, however these HOWTOs seem to be not required for people who plays with fuel - everything in JSONs is just a reflection of configuration in WEB UI
14:47 amaretskiy the HOWTO you requested is almost the howto to FUEL UI
14:47 jjmb1 joined #openstack-rally
14:51 mcaulfie joined #openstack-rally
14:51 paboldin amaretskiy: the only thing that is missing in the code for now is the authorization on Fuel
14:54 rvcehimanshu joined #openstack-rally
14:54 paboldin amaretskiy: so I don't see how can it work at all.
14:55 amaretskiy paboldin, finally, I've caught your question :)
14:55 amaretskiy paboldin, please wait, I'm trying to get this
14:56 paboldin "(16:34:56) paboldin: amaretskiy: is there any howto on fuel deployment schemes?" "(16:36:37) paboldin: I keep getting these 2014-11-17 16:35:56.339 14833 TRACE rally FuelClientException: FuelClientException. Code: 401 Body: Authentication required"
14:57 mcaulfie joined #openstack-rally
15:02 nkhare joined #openstack-rally
15:11 amaretskiy paboldin, I think your question is reasonable
15:11 amaretskiy https://github.com/stackforge/fuel-web/blob/master/fuelclient/fuelclient/client.py#L41
15:11 paboldin amaretskiy: is that the code that is being used in the rally? I don't see so.
15:12 amaretskiy maybe the defaults from fuelclient should be overriden from JSON
15:12 amaretskiy paboldin, I remember this code was tested (not by me)
15:13 amaretskiy paboldin, please, just create the bug report for that - this will be wery helpful
15:13 amaretskiy *very
15:13 paboldin amaretskiy: i think I will create a pull request. Current version of rally uses internal FuelClient not the one from here.
15:14 amaretskiy rediskin ping
15:14 amaretskiy paboldin, yes
15:14 msdubov_ joined #openstack-rally
15:17 aswadr joined #openstack-rally
15:20 msdubov_ joined #openstack-rally
15:21 openstackgerrit Sergey Murashov proposed stackforge/rally: Add benchmarks for murano  https://review.openstack.org/127491
15:21 rediskin paboldin: seems rally's fuel client was created before client from fuel-web
15:22 rediskin paboldin: are you about to rewrite fuel engine in order to use client from fuel-web?
15:22 paboldin rediskin: i'm thinking about it. but for now it is working without a dependency on fuel-web.
15:22 paboldin i dunno if we had to add this dependency for the rally
15:23 rediskin paboldin: it is still working? amazing =)
15:23 rediskin haven't use it for ages
15:23 paboldin rediskin: the only missing part is authentication but it was done via keystoneclient.seesion
15:23 paboldin *session
15:24 openstackgerrit Oleh Anufriiev proposed stackforge/rally: Fix defect of 'separate log level for Rally'  https://review.openstack.org/134968
15:28 openstackgerrit Oleh Anufriiev proposed stackforge/rally: add 'rally task list' filters  https://review.openstack.org/131005
15:39 mcaulfie joined #openstack-rally
16:14 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Base HTML templates and improvements for task report  https://review.openstack.org/131844
16:16 jlk boris-42: I think I figured out (part) of my problem from last week. I had confused my admin port for my standard access port. Once I filled in the correct port I was able to check my deployment successfully.
16:18 boris-42 Jlk nice
16:20 openstackgerrit Mikhail Dubov proposed stackforge/rally: Further improvements in rally info  https://review.openstack.org/134666
16:25 fandi joined #openstack-rally
16:27 rvcehimanshu joined #openstack-rally
16:34 chandankumar joined #openstack-rally
16:44 AlexF_ joined #openstack-rally
17:02 paboldin rediskin: so, should I use a fuelclient from fuel-web or write it myself? it does not seems to hard to use old one and it works except for the keystone auth
17:02 paboldin boris-42: also, fuel deployment is *not* working as for now :P
17:13 ehaselwanter joined #openstack-rally
17:15 boris-42 paboldin: okk
17:15 boris-42 paboldin: so you should talk with lukasz
17:16 boris-42 paboldin:  he is rewriting fuel client as far as I know
17:17 boris-42 jlk:  okay nice so it works agaisnt havana lol
17:17 boris-42 jlk:  that's nice=)
17:23 paboldin boris-42: is lukasz here?
17:23 boris-42 paboldin: I don't think so=)
17:23 boris-42 paboldin: but he shoud joing this chat
17:23 boris-42 paboldin:  I tried to ping him
17:24 paboldin boris-42: is he rewriting fuel client for rally or for fuel itself?
17:26 marcoemorais joined #openstack-rally
17:27 boris-42 paboldin:  he tried to start working on testing Fuel with Rally
17:27 boris-42 paboldin:  and made some patch
17:27 paboldin boris-42: okay. so, i'm not first one here too :-(
17:27 boris-42 paboldin: https://review.openstack.org/#/c/127955/
17:27 boris-42 paboldin:  and then he faced billions of issues
17:28 boris-42 paboldin:  when we get normal fuel client
17:29 boris-42 paboldin:  we will get easy way to write benchmarks/functional tests for fuel
17:29 paboldin oh, he is trying to get fuel scenarios
17:29 paboldin that's not exactly what I need
17:30 jlk boris-42: well, I haven't gotten it to pass anything yet, still working on that. But that could be that this test cloud is janky.
17:30 boris-42 jlk: heh
17:30 boris-42 jlk:  if authenticate benchmarks?
17:31 boris-42 even*
17:31 jlk yeah, it succeeds in a few calls, then starts getting 503s back, and once the 503s start, even deployment check fails, for a period of time. Then it starts working again. So I think I'm hitting a rate limit or some other thing in our cloud.
17:32 shakamunyi joined #openstack-rally
17:34 jjmb joined #openstack-rally
17:38 chandankumar joined #openstack-rally
17:41 jjmb joined #openstack-rally
17:42 salmon_ joined #openstack-rally
17:42 boris-42 salmon_: you man
17:42 boris-42 yo*
17:42 salmon_ yo boris-42
17:42 boris-42 paboldin: hi so salmon_ is Lukasz=)
17:43 paboldin salmon_: hi. how is your patch for testing fuel is going?
17:44 salmon_ paboldin: which patch?
17:44 salmon_ for rally?
17:44 paboldin this one https://review.openstack.org/#/c/127955/
17:44 paboldin is there any other patches for different places?
17:44 salmon_ paboldin: it's blocked because of missing fuel-python-client
17:44 paboldin salmon_: ? there is no separate fuel client for python?
17:45 salmon_ paboldin: not yet, but it will be in 6.1
17:45 paboldin salmon_: oh, ok, so it will be a long wait
17:46 salmon_ or rather after 6.0 release, we are in soft freze now
17:46 salmon_ 6.0 should be relsease in december and after this we will start working on client
17:47 salmon_ *released
17:51 salmon_ paboldin:  Roman Prykhodchenko will work on it, you can contact him. If you can start working on it earlier that's ok. We can join you later
17:52 paboldin salmon_: you mean fuel client for python?
17:52 paboldin my aim is to think of a semi-automatic performance testing and tuning
17:53 salmon_ paboldin: yes, fuel client
17:54 salmon_ paboldin: if you want to use this https://review.openstack.org/#/c/127955/ locally it's possible. Ccurrent client doesn't require many changes to run this tests
17:54 paboldin salmon_: nope, this is a fuel-testing but I only need fuel-deployment for now
17:54 echoingumesh joined #openstack-rally
17:55 salmon_ paboldin: rally can already deploy OS with fuel
17:55 paboldin nope
17:55 salmon_ ah, ok. It can use deployed env
17:55 paboldin salmon_: at least it was not working for me
17:56 paboldin and i kinda it a deployment
17:57 salmon_ Ok, I see. So in january/february we will have something to share
18:01 marcoemorais joined #openstack-rally
18:04 openstackgerrit Alexander Maretskiy proposed stackforge/rally: Base HTML templates and improvements for task report  https://review.openstack.org/131844
18:08 jjmb joined #openstack-rally
18:09 AlexF joined #openstack-rally
18:39 AlexF joined #openstack-rally
18:40 openstackgerrit Igor Pavlovic proposed stackforge/rally: Changes in getting image id from image name functionality  https://review.openstack.org/127878
18:54 AlexF joined #openstack-rally
19:06 marcoemorais joined #openstack-rally
19:07 marcoemorais joined #openstack-rally
19:13 vkmc boris-42, https://review.openstack.org/#/c/103825/ sweet!
19:15 boris-42 vkmc: =) it had actually 2 x +2
19:15 boris-42 vkmc: but =(
19:15 vkmc oh you will get the other +2 soon
19:16 vkmc zhiyan shared it to me earlier today
19:16 vkmc I'm checking how we can integrate it with Zaqar
19:16 boris-42 vkmc: nope
19:16 boris-42 vkmc: it's abondoned=)
19:17 vkmc w00t?
19:17 vkmc oh noes
19:17 boris-42 vkmc: life
19:17 boris-42 vkmc: party hard
19:17 boris-42 vkmc:  openstack=)
19:17 boris-42 vkmc:  it's now here https://review.openstack.org/#/c/134839/
19:17 vkmc cool
19:19 marcoemorais joined #openstack-rally
19:33 AlexF joined #openstack-rally
19:34 marcoemorais joined #openstack-rally
19:37 marcoemorais joined #openstack-rally
19:38 jjmb joined #openstack-rally
19:39 marcoemorais joined #openstack-rally
19:45 boris-42 vkmc: so what is the issue with integration of osprofiler to zaqar?
19:46 boris-42 vkmc:  it should be actually quite simple-)
19:46 vkmc boris-42, no issue at all
19:46 boris-42 vkmc:  =)
19:46 vkmc boris-42, I think it would be fairly easy to add
19:46 boris-42 vkmc:  http://m.memegen.com/6vu5mf.jpg +)
19:47 vkmc Zaqar only does HTTP calls and DB API calls, adding the required confs and headers shouldn't be a problem
19:47 vkmc lol
19:47 vkmc impossibru!
19:52 boris-42 vkmc: )
20:00 echoingumesh joined #openstack-rally
20:01 echoingumesh joined #openstack-rally
20:45 jjmb joined #openstack-rally
20:49 openstackgerrit joined #openstack-rally
22:32 openstackgerrit Igor Pavlovic proposed stackforge/rally: Changes in getting image id from image name functionality  https://review.openstack.org/127878
22:34 marcoemorais joined #openstack-rally
22:36 marcoemorais joined #openstack-rally
22:37 marcoemorais joined #openstack-rally
22:57 jjmb joined #openstack-rally
23:03 marcoemorais joined #openstack-rally
23:04 marcoemorais joined #openstack-rally
23:20 leeantho joined #openstack-rally
23:21 openstackgerrit Anthony Lee proposed stackforge/rally: Add a servers context and a cinder stress scenario  https://review.openstack.org/127392

| Channels | #openstack-rally index | Today | | Search | Google Search | Plain-Text | summary