Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster-dev, 2017-05-15

| Channels | #gluster-dev index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:48 ilbot3 joined #gluster-dev
01:48 Topic for #gluster-dev is now Gluster Development Channel - http://gluster.org | For general chat go to #gluster | Patches - http://review.gluster.org/ | Channel Logs - https://botbot.me/freenode/gluster-dev/ & http://irclog.perlgeek.de/gluster-dev/
02:07 wushudoin joined #gluster-dev
02:16 BlackoutWNCT1 joined #gluster-dev
02:16 BlackoutWNCT1_ joined #gluster-dev
02:39 BlackoutWNCT1_ Hey guys, chasing some assistance with a potentailly dead process.
02:40 BlackoutWNCT1_ I've got 2 processes on ym arbiter machine (replica 3 arbiter 1 setup) which have 235 and 180 hours of uptime and are using 600% and 350% CPU respectively.
02:40 BlackoutWNCT1_ I pretty much need to know if it's ok for me to kill these processes
02:40 BlackoutWNCT1_ Or if there's something else I need to look into for this.
02:40 BlackoutWNCT1_ I'm still pretty new to Gluster Administration.
02:40 BlackoutWNCT1_ thanks in advance!
02:43 vbellur BlackoutWNCT1_: seems like self-healing is in progress? can you monitor healing statistics by looking at volume heal info commands?
02:45 prasanth joined #gluster-dev
02:51 BlackoutWNCT1_ vbellur so a gluster volume heal info returns a metric shit tonne of gfid files. a gluster volume heal inof split-brain is currently hung
03:14 vbellur BlackoutWNCT1_: check glustershd.logs on busy nodes and the heal info commands to get a better hang of what's happening. not sure why info split-brain hangs.
03:24 BlackoutWNCT1_ glustershd.log shows the following error
03:24 BlackoutWNCT1_ [2017-05-15 03:10:19.601201] E [MSGID: 114058] [client-handshake.c:1534:client_query_portmap_cbk] 0-gv1mel-client-2: failed to get the port number for remote subvolume. Please run 'gluster volume status' on server to see if brick process is running.
03:24 BlackoutWNCT1_ I've checked all bricks, and all bricks are online
03:24 BlackoutWNCT1_ all gluster volume status's show that there's a rebalance in progress though
03:24 BlackoutWNCT1_ But a gluster volume info rebalance shows that the rebalances are all completed.
03:25 BlackoutWNCT1_ Also, in case it's relevanmt, the only usy node currently is the arbiter node.
03:26 BlackoutWNCT1_ unless "busy node" in a term im not familiar with and means something else?
03:30 BlackoutWNCT1_ Should a gluster volume heal inofo be listing like thousands of files?
03:33 BlackoutWNCT1_ ok just got a return on my heal info
03:33 BlackoutWNCT1_ says transport endpoint not connected for one of my bricks
03:33 BlackoutWNCT1_ But everything else shows it in good health and onloine
03:34 Shu6h3ndu joined #gluster-dev
03:41 nigelb kkeithle: 3.10.2 it is :)
03:42 nbalacha joined #gluster-dev
03:45 atinm joined #gluster-dev
03:46 BlackoutWNCT1_ ok, more revelations. I also get a hang when I try and do a ls on either of the bricks
03:47 BlackoutWNCT1_ But I can do a ls on the bricks from the other nodes in the replica
03:47 BlackoutWNCT1_ So it appears to be just the arbiter machine
03:47 BlackoutWNCT1_ So, real question time. Is it likely to break anything is I reboot the arbiter machine?
03:48 BlackoutWNCT1_ Not that I want to, but I feel it may be the fastest solution here
03:48 BlackoutWNCT1_ As time is something I don't have
03:51 pranithk1 joined #gluster-dev
04:03 itisravi joined #gluster-dev
04:13 riyas joined #gluster-dev
04:21 sthakkar joined #gluster-dev
04:45 hgowtham joined #gluster-dev
04:53 skoduri joined #gluster-dev
04:57 BlackoutWNCT1_ ok so, update for anyone interested.
04:57 BlackoutWNCT1_ I rebooted the arbiter machine, and now everything's functioning correctly.
04:58 BlackoutWNCT1_ @vbellur thanks for all your help mate, highly appreciated.
05:00 kdhananjay joined #gluster-dev
05:02 ankitr joined #gluster-dev
05:04 jiffin joined #gluster-dev
05:05 skumar joined #gluster-dev
05:10 itisravi BlackoutWNCT1_: just curious, what version of gluster are you running?
05:12 BlackoutWNCT1_ This one is apparently on 3.8.8
05:21 ndarshan joined #gluster-dev
05:22 chawlanikhil24 joined #gluster-dev
05:22 chawlanikhil24 Hi people, anyone here from gdeploy ?
05:23 jiffin sac`: ^^
05:23 jiffin devyani7: ^^
05:24 apandey joined #gluster-dev
05:24 aravindavk joined #gluster-dev
05:25 chawlanikhil24 sac`, Hi !
05:25 chawlanikhil24 jiffin, thanks :)
05:25 sona joined #gluster-dev
05:26 chawlanikhil24 devyani7, Hi!
05:36 pkalever joined #gluster-dev
05:43 ankitr joined #gluster-dev
05:43 jiffin chawlanikhil24: I guess they are not yet online, please ping them after an hour or so
05:51 atinm joined #gluster-dev
05:51 kotreshhr joined #gluster-dev
05:54 lalatenduM joined #gluster-dev
05:55 ankitr joined #gluster-dev
05:55 msvbhat joined #gluster-dev
05:57 apandey_ joined #gluster-dev
06:02 itisravi joined #gluster-dev
06:06 sanoj joined #gluster-dev
06:08 ppai joined #gluster-dev
06:09 susant joined #gluster-dev
06:15 chawlanikhil24 joined #gluster-dev
06:19 chawlanikhil24 jiffin, Okay !
06:21 ankitr joined #gluster-dev
06:29 gyadav joined #gluster-dev
06:32 jiffin1 joined #gluster-dev
06:35 chawlanikhil24 joined #gluster-dev
06:47 kotreshhr joined #gluster-dev
06:58 fam_away joined #gluster-dev
06:59 rastar joined #gluster-dev
07:13 poornima_ joined #gluster-dev
07:18 devyani7 chawlanikhil24, hello, pong.
07:19 jiffin1 joined #gluster-dev
07:27 sthakkar_ joined #gluster-dev
07:33 apandey__ joined #gluster-dev
07:34 poornima_ joined #gluster-dev
07:44 kotreshhr joined #gluster-dev
07:48 itisravi_ joined #gluster-dev
08:07 sthakkar_ joined #gluster-dev
08:07 atinm joined #gluster-dev
08:13 chawlanikhil24 devyani7, I was going through the code of gdeploy on github, and there is a function named  "check_ansible_installation()"
08:13 chawlanikhil24 devyani7, Currently that function, return if ansible is not installed or ansible version is < 2.2,
08:15 chawlanikhil24 devyani7, I was thinking, instead of returning or interrupting the process, if an installation of ansible or upgrade of ansible package is executed !! Is is suppose to sounds good ?
08:18 aravindavk joined #gluster-dev
08:20 ndevos chawlanikhil24: I think it should be a dependency on the packaging/installation of gdeploy
08:21 ndevos chawlanikhil24: installing it afterwards might be difficult, what package manager should you use, and do other repositories need to be enabled?
08:21 chawlanikhil24 ndevos, package manager is rpm
08:22 ndevos chawlanikhil24: not on debian?
08:22 ndevos chawlanikhil24: and would you use dnf or yum?
08:22 chawlanikhil24 nops!. since gdeploy is for RHEL 6 and above
08:22 ndevos or whatever opensuse uses?
08:23 ndevos chawlanikhil24: is think it should work on fedora etc too?
08:23 chawlanikhil24 ndevos, dnf can also be used, but the idea is to decrease the vulnerabilities in running gdeploy
08:24 chawlanikhil24 ndevos, I tested "rpm" on fedora 23 , it was working well
08:24 ndevos chawlanikhil24: what is the problem with normal dependencies, gdeploy should just have a dependendency in its rpm on ansible >= 2.2
08:25 chawlanikhil24 ndevos, so yes, compatible for fedora as well.
08:25 ndevos chawlanikhil24: installing packages directly with 'rpm' is frowned upon, and where do you get the rpm from?
08:25 chawlanikhil24 https://github.com/gluster/gdeploy/blob/master/gdeploy/gdeploy
08:26 chawlanikhil24 ndevos, on line 85 there is a function, to check only ansible dependency
08:27 ndevos chawlanikhil24: sure, but the correct approach for making sure ansible is installed, is through a package dependency
08:27 chawlanikhil24 ndevos, I tested on fedora:23 container
08:27 ndevos chawlanikhil24: checking the version should probably be done like 'ansible --version' and parsing the output?
08:29 ndevos chawlanikhil24: if ansible was missing, then the dependency in the .spec needs to be added, when you create a gdeploy container, the dependency will automatically be installed
08:29 chawlanikhil24 ndevos, only ansible version is not checked here, whatif there is no ansible installed? .. using rpm is better because it will return a blank string if ansible is not installed
08:29 ndevos chawlanikhil24: maybe add the dependency in setup.py too
08:30 ndevos chawlanikhil24: if ansible is not installed, you will get an error trying to execute it
08:31 ndevos chawlanikhil24: and that will work on any distribution, now the version check is just skipped on non 'redhat' onces
08:31 chawlanikhil24 ndevos, makes sense!
08:32 chawlanikhil24 ndevos, setup.py is better place than, this script right ?
08:32 ndevos chawlanikhil24: actually, if install the rpms the dependency should be there already: https://github.com/gluster/gdeploy/blob/master/gdeploy/gdeploy
08:32 ndevos uh, wrong link - https://github.com/gluster/gdeploy/blob/master/gdeploy.spec#L14
08:33 chawlanikhil24 ndevos, if its already mentioned , then why another function is created
08:34 chawlanikhil24 ndevos, do you think , it should be removed ?
08:36 ndevos chawlanikhil24: I think it is good to have a version check, but would suggest to only try and run 'ansible --version', nothing too fancy
08:36 ndevos chawlanikhil24: is it possible to run gdeploy directly from a git-cloned repository? if so, the runtime check will be quite useful
08:38 chawlanikhil24 ndevos, no idea, about the direct git-clone! :/, i guess sac` and devyani7 would answer it well !
08:40 chawlanikhil24 ndevos, so I should drop the idea to install ansible from that script if ansible not installed!
08:40 * devyani7 reads. was gone for lunch.
08:44 sanoj joined #gluster-dev
08:50 ndevos chawlanikhil24: yes, it is not normal for packages to try and install dependencies if they are missing, and it will most likely be forbidden to get included in most distributions too
08:50 ndevos chawlanikhil24: the installation process (rpm dependencies or setup.py) should take care of the needed runtime packages
08:52 sathees joined #gluster-dev
08:53 devyani7 ndevos, hi, yes gdeploy can be run after a direct clone of the github repo.
08:53 chawlanikhil24 devyani7, how ?
08:53 sthakkar__ joined #gluster-dev
08:53 devyani7 chawlanikhil24, hi. I agree with ndevos here. doing an rpm installation of a dependency package wouldn't be a good idea.
08:56 devyani7 we have the dependencies listed in the spec file. but let me get back to you on this.
09:06 devyani7 chawlanikhil24, hey, the "check_ansible_installation" function is specific to rhel 6 alone, since we don't ship ansible along with rhel6.
09:06 sona joined #gluster-dev
09:07 devyani7 and we do not encourage customers to install from epel repos,
09:08 devyani7 We do not suggest to customers from where to install. We just error out with a message to install ansible from where ever they please.
09:10 chawlanikhil24 joined #gluster-dev
09:16 itisravi joined #gluster-dev
09:17 chawlanikhil24 devyani7, Ok, and thanks for the help!
09:17 chawlanikhil24 ndevos, thanks for the help
09:21 pkalever joined #gluster-dev
09:23 pkalever joined #gluster-dev
09:29 gyadav_ joined #gluster-dev
09:39 gem joined #gluster-dev
09:49 kotreshhr joined #gluster-dev
09:51 chawlanikhil24 joined #gluster-dev
10:11 kshlm joined #gluster-dev
10:12 msvbhat joined #gluster-dev
10:18 rastar joined #gluster-dev
10:19 gyadav__ joined #gluster-dev
10:29 apandey_ joined #gluster-dev
10:31 apandey__ joined #gluster-dev
10:33 ankitr joined #gluster-dev
10:41 gyadav_ joined #gluster-dev
10:47 atinm joined #gluster-dev
11:07 kotreshhr joined #gluster-dev
11:10 gem joined #gluster-dev
11:17 ankitr joined #gluster-dev
11:19 aravindavk joined #gluster-dev
11:19 kkeithle nigelb: ping. what's your availability to walk through packaging of 3.10.2?  If not convenient we can try again in a couple weeks for 3.10.3
11:19 skumar_ joined #gluster-dev
11:21 kkeithle nh2: I believe that is fixed in 3.10.2. Packages will be available soon.
11:25 chawlanikhil24 joined #gluster-dev
11:33 gyadav__ joined #gluster-dev
11:56 skumar joined #gluster-dev
12:01 nh2 kkeithle: thanks
12:16 pkalever joined #gluster-dev
12:22 prasanth joined #gluster-dev
12:23 atinm joined #gluster-dev
12:29 chawlanikhil24 joined #gluster-dev
12:32 kkeithle nigelb: ping ping ping
12:33 ppai joined #gluster-dev
12:37 vbellur joined #gluster-dev
12:41 msvbhat joined #gluster-dev
12:51 ankitr joined #gluster-dev
13:02 prasanth joined #gluster-dev
13:08 sanoj joined #gluster-dev
13:08 susant left #gluster-dev
13:31 msvbhat joined #gluster-dev
13:32 kotreshhr joined #gluster-dev
13:49 shaunm joined #gluster-dev
14:17 glustin joined #gluster-dev
14:21 nh2 joined #gluster-dev
14:40 aravindavk joined #gluster-dev
14:52 wushudoin joined #gluster-dev
14:57 wushudoin joined #gluster-dev
14:58 nbalacha joined #gluster-dev
15:01 gyadav__ joined #gluster-dev
15:06 nh2 joined #gluster-dev
15:13 msvbhat joined #gluster-dev
15:34 jiffin joined #gluster-dev
15:47 riyas joined #gluster-dev
15:55 ankitr joined #gluster-dev
16:51 gyadav__ joined #gluster-dev
17:51 rastar joined #gluster-dev
18:06 bwerthmann joined #gluster-dev
18:36 gyadav__ joined #gluster-dev
18:38 ashiq joined #gluster-dev
18:46 gyadav__ joined #gluster-dev
19:00 gyadav__ joined #gluster-dev
20:36 shyam joined #gluster-dev
21:33 ashiq joined #gluster-dev
23:44 nh2 joined #gluster-dev

| Channels | #gluster-dev index | Today | | Search | Google Search | Plain-Text | summary