Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2016-08-09

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:06 keiviw joined #gluster
00:10 keiviw In glusterfs xlators, fd was an parameter for client_open().....But, fd is a returned value for open(path). How to get the real filename via fd
00:10 keiviw joined #gluster
00:11 om joined #gluster
00:32 keiviw In gluster client_args struct, there were three names, linkname, name and basename, which one was the filename??
00:47 shyam joined #gluster
00:53 shdeng joined #gluster
00:55 plarsen joined #gluster
01:07 Alghost_ joined #gluster
01:10 om joined #gluster
01:31 cliluw joined #gluster
01:46 hagarth joined #gluster
01:46 xavih joined #gluster
01:48 ilbot3 joined #gluster
01:48 Topic for #gluster is now Gluster Community - http://gluster.org | Documentation - https://gluster.readthedocs.io/en/latest/ | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
01:51 muneerse2 joined #gluster
02:16 Jacob843 joined #gluster
02:17 Alghost joined #gluster
02:21 Alghost joined #gluster
02:27 Alghost_ joined #gluster
02:56 aspandey joined #gluster
03:06 Gambit15 joined #gluster
03:13 harish joined #gluster
03:14 Lee1092 joined #gluster
03:19 magrawal joined #gluster
03:31 ic0n joined #gluster
03:32 atinm joined #gluster
03:38 rafi joined #gluster
03:39 itisravi joined #gluster
03:46 mchangir joined #gluster
03:51 Peppard joined #gluster
03:57 ppai joined #gluster
04:01 ramky joined #gluster
04:05 nbalacha joined #gluster
04:11 skoduri joined #gluster
04:18 RameshN joined #gluster
04:21 poornimag joined #gluster
04:28 rastar joined #gluster
04:46 sanoj joined #gluster
04:52 aravindavk joined #gluster
04:56 jiffin joined #gluster
04:58 karnan joined #gluster
05:01 kshlm joined #gluster
05:03 skoduri joined #gluster
05:06 karthik_ joined #gluster
05:13 nehar joined #gluster
05:16 aspandey joined #gluster
05:20 kdhananjay joined #gluster
05:24 prasanth joined #gluster
05:27 itisravi joined #gluster
05:27 Bhaskarakiran joined #gluster
05:27 ashiq joined #gluster
05:30 mchangir joined #gluster
05:34 hgowtham joined #gluster
05:37 aspandey joined #gluster
05:38 shdeng joined #gluster
05:39 satya4ever joined #gluster
05:41 ppai joined #gluster
05:44 Muthu joined #gluster
05:45 Manikandan joined #gluster
05:47 ashiq joined #gluster
05:47 keiviw joined #gluster
05:54 msvbhat joined #gluster
06:11 Siavash joined #gluster
06:11 Siavash joined #gluster
06:15 rafi joined #gluster
06:18 [diablo] joined #gluster
06:28 jtux joined #gluster
06:32 kotreshhr joined #gluster
06:36 jtux joined #gluster
06:36 ashiq joined #gluster
06:38 eMBee joined #gluster
06:38 Pupeno joined #gluster
06:47 sandersr joined #gluster
06:54 rafi joined #gluster
07:02 ankitraj joined #gluster
07:06 rastar joined #gluster
07:17 gvandeweyer joined #gluster
07:18 hackman joined #gluster
07:24 rastar joined #gluster
07:36 fsimonce joined #gluster
07:37 Saravanakmr joined #gluster
07:38 Manikandan joined #gluster
07:38 aj__ joined #gluster
07:39 rafi1 joined #gluster
07:42 jri joined #gluster
07:46 karthik_ joined #gluster
07:46 kovshenin joined #gluster
07:53 ashiq joined #gluster
07:54 kotreshhr joined #gluster
07:59 aj__ joined #gluster
08:02 aspandey joined #gluster
08:10 harish_ joined #gluster
08:12 arcolife joined #gluster
08:13 kshlm joined #gluster
08:18 anil_ joined #gluster
08:21 Slashman joined #gluster
08:23 deniszh joined #gluster
08:24 hackman joined #gluster
08:28 coreping joined #gluster
08:31 atalur joined #gluster
08:34 ahino joined #gluster
08:37 rastar joined #gluster
08:40 pur joined #gluster
08:52 poornimag joined #gluster
09:17 itisravi joined #gluster
09:20 itisravi joined #gluster
09:23 itisravi joined #gluster
09:24 Philambdo joined #gluster
09:33 Saravanakmr joined #gluster
09:33 jiffin1 joined #gluster
09:33 hchiramm joined #gluster
09:40 devyani7_ joined #gluster
09:42 atalur joined #gluster
09:48 devyani7_ joined #gluster
09:49 Saravanakmr joined #gluster
09:51 msvbhat joined #gluster
09:52 aj__ joined #gluster
10:02 atinm joined #gluster
10:06 ebbex joined #gluster
10:11 telius I'm trying to create a new volume
10:11 telius And it keeps failing saying the one host is not in peer in cluster state
10:12 telius When gluster peer status on all hosts says it is
10:12 telius What might be causing that?
10:12 telius If I remove that host it becomes another
10:13 telius Actually seems to just be that one host now
10:17 hchiramm joined #gluster
10:18 ankitraj http://gluster.readthedocs.io/en/la​test/Quick-Start-Guide/Quickstart/
10:18 glusterbot Title: Quick start Guide - Gluster Docs (at gluster.readthedocs.io)
10:19 ankitraj telius: follow steps given in abhove link
10:19 rastar joined #gluster
10:21 telius I've done all the steps in there
10:22 telius All hosts show the other two when I run gluster peer status, with their state as "Peer in Cluster (connected)", and can ping each other
10:22 telius atm the volume has two bricks, and I'm trying to add the third
10:23 telius "volume add-brick: failed: Pre Validation failed on xxx.  Please check the log file for details."
10:23 telius When I tried to add all at time of volume creation, it said host xxx was not in Peer in Cluster state
10:28 ebbex I'm trying to have apache2/httpd on various debian/centos have writepermissions for the same files, is there a way to remap uid/gid for this, or do I need to get those sorted/in-sync on both hosts?
10:30 sunnikri joined #gluster
10:48 jiffin1 joined #gluster
10:59 bfoster joined #gluster
11:00 poornimag joined #gluster
11:01 pa9tv is there a way to start bitrot scrubbing at a predetermined time?
11:04 rastar joined #gluster
11:12 yawkat joined #gluster
11:27 jiffin pa9tv: kotreshhr ^^
11:27 pa9tv kotreshhr: is there a way to start bitrot scrubbing at a predetermined time?
11:28 Philambdo joined #gluster
11:30 jiffin ebbex: within gluster I guess there is no service to do that, but if you are using volume via nfs, you can try NIS or LDAP
11:34 jiffin I have tried with NIS before
11:42 msvbhat joined #gluster
11:45 ashiq joined #gluster
11:46 bagualistico joined #gluster
11:47 julim joined #gluster
11:49 mchangir joined #gluster
11:54 jiffin joined #gluster
11:56 kotreshhr pa9tv: No, as of now, it is not there. With 3.9, we are coming up ondemand scrubbing where u can start the scrubbing immediately.
11:57 rastar joined #gluster
12:01 kotreshhr left #gluster
12:02 pa9tv joined #gluster
12:05 johnmilton joined #gluster
12:19 ebbex jiffin: mount it as a nfs volume instead of glusterfs in fstab? Any overhead or downside to doing this?
12:20 jiffin if u are in build nfs server with gluster,
12:20 jiffin the high availability provided by native mount(glusterfs ) will lost
12:21 ndevos jiffin: maybe nfs-ganesha has a way to configure uids used on a client, to map to other uids on the server?
12:21 cloph hmm. geo-replication is transferring a file twice? (master gets the file via rsync, so it is first create as .foobar, then moved to foobar) - what I see now on the geo-repl slave is some files ".foobar" being initially created, with zero size. But some already with "foobar" name, wiz size 0.
12:21 jiffin the native client is connected to all the gluster servers(bricks)
12:21 shyam joined #gluster
12:22 jiffin ndevos: hmm need to look, I am not sure
12:22 cloph Those then grow (they are iso images, so 3-4 GB in size), but after having transferred ~everything, it starts over, starting at 0 bytes..
12:23 jiffin incase of ganesha, even if uid/gids are different on nodes
12:23 ndevos jiffin: yeah, me neither, but it is a standard feature of knfsd, I expect Ganesha to have it
12:23 jiffin it does not required to sync I guess
12:23 hchiramm joined #gluster
12:24 jiffin ebbex: for ex, if usera has uid 1000 on nfs client machine and 2000 on nfs-server machine
12:25 jiffin all the operations works based on name
12:26 ndevos ebbex: right, what jiffin says is true for NFSv4, you can mount Gluster volumes through Ganesha that way
12:26 jiffin from ganesha to gluster bricks it will send uid/gid(even if usera is not created on brick, value 2000 persisted on the backebd)
12:26 ndevos ebbex: the username then gets resolved to a uid/gid on the NFS-Ganesha system, which passes the uid/gid to Gluster
12:27 chirino_m joined #gluster
12:29 * ndevos high fives _o/ jiffin
12:33 ebbex jiffin, ndevos : Thanks! I'll check that out.
12:35 jiffin \o ndevos
12:36 unclemarc joined #gluster
12:41 kdhananjay joined #gluster
12:41 pa9tv joined #gluster
12:42 kovshenin joined #gluster
12:42 baojg joined #gluster
12:44 side_control i read a thread on doing an OS reinstall, but it hasnt been confirmed that it works... is /etc/glusterd /var/lib/glusterd + gluster data all i need to restore?
12:52 aj__ joined #gluster
12:54 Pupeno joined #gluster
12:59 baojg joined #gluster
13:02 luis_silva joined #gluster
13:07 Philambdo joined #gluster
13:10 atinm joined #gluster
13:19 pa9tv joined #gluster
13:23 rwheeler joined #gluster
13:31 jiffin1 joined #gluster
13:32 skoduri_ joined #gluster
13:33 skylar joined #gluster
13:40 kdhananjay1 joined #gluster
13:41 cloph argh. and geo-rep just restarted over with the file after >3GB have been transferred. :-/
13:42 kdhananjay joined #gluster
13:45 derjohn_mob joined #gluster
13:54 pa9tv joined #gluster
13:55 hackman joined #gluster
13:57 julim joined #gluster
13:58 bowhunter joined #gluster
13:58 Bhaskarakiran joined #gluster
14:00 jiffin joined #gluster
14:02 dnunez joined #gluster
14:03 jiffin joined #gluster
14:04 Siavash joined #gluster
14:12 shyam joined #gluster
14:19 Pupeno joined #gluster
14:22 dnunez joined #gluster
14:28 nbalacha joined #gluster
14:33 itisravi joined #gluster
14:40 Philambdo joined #gluster
14:43 Pupeno joined #gluster
14:48 ankitraj joined #gluster
14:50 shyam joined #gluster
15:01 aravindavk joined #gluster
15:07 wushudoin joined #gluster
15:10 Siavash joined #gluster
15:11 portante joined #gluster
15:13 jiffin joined #gluster
15:14 msvbhat joined #gluster
15:21 kpease joined #gluster
15:23 harish_ joined #gluster
15:26 eclay joined #gluster
15:28 ankitraj joined #gluster
15:29 eclay I've run into what I believe to be a big problem.  I ran the gluster command to remove a brick and change to a 2 replica volume from a 3.  The command seemed to work but then the server (not the one I ran gluster command to remove) seems to be non functioning.  glusterd won't start.
15:29 eclay http://pastebin.ubuntu.com/22810729/
15:29 glusterbot Title: Ubuntu Pastebin (at pastebin.ubuntu.com)
15:29 Lee1092 joined #gluster
15:29 eclay these are the commands I ran http://pastebin.ubuntu.com/22810729/
15:29 glusterbot Title: Ubuntu Pastebin (at pastebin.ubuntu.com)
15:29 eclay sorry for adding the url twice for the pastebin.
15:31 eclay glusterd on san2 fails to start because it can't find the file for the brick removed in /var/lib/glusterd/vols/gv1/bricks/
15:32 poornimag joined #gluster
15:33 hchiramm joined #gluster
15:34 guhcampos joined #gluster
15:35 eclay http://pastebin.ubuntu.com/22811455/
15:35 glusterbot Title: Ubuntu Pastebin (at pastebin.ubuntu.com)
15:35 Gambit15 Hey all, I need to upgrade our congested 1Gbit network to 10Gbit & am looking for suitable new kit. We're a South American uni, so bang for our buck is a very big consideration. Any suggestions on lines or models for 10Gbit L3 switches?
15:36 eclay This is the the etc-glusterfs-glusterd.vol.log entries that seem to be from the time I ran the remove brick command.
15:37 shyam joined #gluster
15:50 eclay My thought is that the remove only partially took.  Somehow the server I ran the command on thinks it's supposed to be removed by entries still exist for this brick in /var/lib/glusterd/
15:52 Pupeno joined #gluster
15:54 eclay not sure what my next step is since in order to get glusterd running again and things working I need to resolve this.  on the other two servers that where originally holding bricks in this setup still thin each other are peers and hold bricks.
15:54 eclay http://pastebin.ubuntu.com/22813165/
15:54 glusterbot Title: Ubuntu Pastebin (at pastebin.ubuntu.com)
15:55 eclay All servers that use this gluster volume are currently connect to il-san2 where glusterd won't start.
15:57 Siavash_ joined #gluster
15:58 om joined #gluster
15:58 msvbhat joined #gluster
16:04 skoduri joined #gluster
16:04 keiviw joined #gluster
16:14 eclay So I've recreated /var/lib/glusterd/vols/gv1/bricks​/10.4.16.11:-glusterfs-data1-gv1 which was missing only on the server I ran the remove brick command on and it still seemed to think this file should exist.  I'm thinking that I should reboot this server because glusterd seems to fail to start now because it thinks it's ports are already being used.  http://pastebin.ubuntu.com/22815541/
16:14 glusterbot Title: Ubuntu Pastebin (at pastebin.ubuntu.com)
16:50 eclay fyi rebooting the affected san after recreating the file seemed to make glusterd happy.  Still not sure things are 100% happy since the san/brick I was trying to remove doesn't show when I do a "gluster volume heal gv1 info"
16:51 eclay not sure how to get this brick removed or added back.  at this point I would settle for either.
16:53 pdrakeweb joined #gluster
16:56 eclay and  lady luck must be on my side.  I was able to remove the brick I initially was trying to remove.
16:59 Philambdo joined #gluster
17:11 Slashman joined #gluster
17:12 Pupeno joined #gluster
17:29 kovshenin joined #gluster
17:30 jiffin joined #gluster
17:38 bowhunter joined #gluster
17:53 hagarth joined #gluster
18:02 Philambdo joined #gluster
18:21 Pupeno joined #gluster
18:38 DaKnOb joined #gluster
18:45 kovshenin joined #gluster
18:47 om joined #gluster
18:59 sputnik13 joined #gluster
18:59 sputnik13 is there a way to force gluster to use only IPs rather than hostnames when doing peer probe?
19:00 sputnik13 I probe host B from host A by IP, and host B tries to connect to host A via hostname
19:01 sputnik13 when I subsequently peer probe from host B to host A by IP, the IP is added to "Other names" for host A on host B
19:01 sputnik13 but host B never connects properly to host A
19:01 Gambit15 Use hostnames configured in /etc/hosts
19:02 sputnik13 can't, the hostname that host B sees for host A isn't the actual hostname of host A
19:03 sputnik13 is there no way to force gluster to use IPs?
19:04 gem joined #gluster
19:06 Gambit15 sputnik13, why does it have to be the actual hostname?
19:06 sputnik13 because I could have multiple hosts claiming the same hostname
19:07 sputnik13 I'm trying to run this inside kubernetes
19:07 social joined #gluster
19:07 sputnik13 but that has nothing to do with whether gluster can be made to use just IPs and not try to resolve hostname of the initiating peer
19:07 sputnik13 is this not possible?
19:07 Gambit15 If you set the hostname in the hosts file, the server will conenct over the corresponding IP
19:08 JoeJulian I didn't used to resolve the hostname if you specified the ip. What's indicating it does?
19:08 sputnik13 so...  are you saying there's no way to get the behavior I'm talking about?
19:09 Gambit15 Never needed or considered it
19:09 sputnik13 JoeJulian yeah that's what I found odd, so on host B I do peer status and it shows there's a disconnected host
19:09 sputnik13 and in hostname it shows some hostname that is not the actual hostname of host A
19:10 sputnik13 but when I peer probe host A from host B using IP it just adds the IP to "Other names" under that disconnected peer
19:10 sputnik13 I actually saw something similar while testing on VMs
19:10 JoeJulian Ah, that's why. You cloned an already initialized installation.
19:10 JoeJulian They all have the same /var/lib/glusterd/glusterd.info file.
19:10 sputnik13 JoeJulian actually no, I didn't clone anything
19:10 JoeJulian Thus the same uuid.
19:11 JoeJulian ... let me check that. So two hosts with the same hostname in /etc/hostname, right?
19:11 JoeJulian That's it?
19:11 sputnik13 no, so the hostname I'm seeing for host A from host B (which I'm saying is wrong) is the hostname of the container host
19:12 sputnik13 the containers (host A and host B) have their own unique hostnames and IPs
19:12 sputnik13 so I don't know how host B even sees that other hostname
19:12 JoeJulian interesting
19:12 ahino joined #gluster
19:13 JoeJulian rdns maybe?
19:13 sputnik13 but network weirdness aside, if I can force gluster to stop trying to resolve hostnames I should be able to get things working fine
19:13 sputnik13 JoeJulian that's what I figured it was
19:13 sputnik13 other daemons like sshd have options for turning rdns off, I was wondering if a similar thing exists in gluster
19:13 JoeJulian no, there's no way to disable rnds resolution that I've seen.
19:13 sputnik13 ugh
19:14 JoeJulian but I'll double check.
19:14 JoeJulian What version?
19:14 johnmilton joined #gluster
19:14 sputnik13 3.8.1
19:14 sputnik13 hmm I thought I installed 3.7, oops
19:25 Slashman joined #gluster
19:25 JoeJulian Yep, it does a getnameinfo on the ip address specified...
19:27 JoeJulian No, wait... that function is only used in io-stats.
19:32 johnmilton joined #gluster
19:41 om joined #gluster
19:41 JoeJulian sputnik13: If you "gluster --xml peer status" I bet all the alternate hostnames are under one single peer which is defined to be unique by uuid.
19:41 kovshenin joined #gluster
19:42 JoeJulian I suspect that all the peer probes are, indeed, being caught by one single peer or by peers that somehow have the same uuid in /var/lib/glusterd/glusterd.info
19:43 repnzscasb joined #gluster
19:52 ehermes joined #gluster
19:54 kovsheni_ joined #gluster
20:03 sputnik13 JoeJulian right all the alternates show up under a single peer like you say, but host B seeing the wrong hostname for host A is the crux of my problem
20:04 JoeJulian Not according to the source.
20:05 sputnik13 ok, I'm not understanding something or I'm not sufficientily explaning my situation
20:08 kovshenin joined #gluster
20:08 JoeJulian I feel it's the former. You probe an ip address. glusterd connects to that ip address (port 24007) and requests its uuid. If the uuid is its own, it ignores it. If it's a uuid of a host already in it's pool, it adds it to the peer info file in /var/lib/glusterd/peers/{uuid}.
20:13 sputnik13 http://pastebin.com/ynWiNKGE
20:13 glusterbot Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils.
20:14 sputnik13 that roughly shows the sequence of events
20:14 sputnik13 the two nodes do not have the same uuid
20:14 sputnik13 they have distinct UUIDs and IPs and hostnames
20:15 sputnik13 uhh, ok I'll repaste to fpaste :-|
20:15 sputnik13 https://paste.fedoraproject.org/405064/47077374/
20:15 glusterbot Title: #405064 Fedora Project Pastebin (at paste.fedoraproject.org)
20:20 JoeJulian Ok, do that again with debug logging on glusterd and include both logs.
20:21 kovshenin joined #gluster
20:22 sputnik13 hmm
20:22 sputnik13 ok
20:27 kovshenin joined #gluster
20:37 kovshenin joined #gluster
20:40 kovshenin joined #gluster
20:41 sputnik13 gluster0 log https://paste.fedoraproject.org/405073/14707751/
20:41 glusterbot Title: #405073 Fedora Project Pastebin (at paste.fedoraproject.org)
20:41 sputnik13 gluster1 log https://paste.fedoraproject.org/405074/14707752/
20:41 glusterbot Title: #405074 Fedora Project Pastebin (at paste.fedoraproject.org)
20:42 JoeJulian looking...
20:44 theron joined #gluster
20:54 Siavash_ joined #gluster
20:55 sputnik13 so gluster1 sees the container host hostname in line 99, then keeps trying to talk to that hostname
20:55 sputnik13 which resolves to a different IP than what gluster0 actually is
20:55 JoeJulian Right, I'm trying to find out where that'
20:55 JoeJulian that's coming from.
20:56 JoeJulian It's got to be rdns on it's own ip address, afaict.
20:58 sputnik13 one sec, it could be that rdns is broken
21:02 kovshenin joined #gluster
21:02 sputnik13 actually no reverse dns doesn't give me that hostname
21:05 JoeJulian Is anything natted in this network?
21:05 sputnik13 no
21:05 JoeJulian Who has 10.247.82.116 ?
21:05 sputnik13 it's a flannel overlay network, but from each container's perspective the network should be flat
21:05 sputnik13 that's the container host
21:06 sputnik13 I don't get why gluster1 even sees that IP
21:07 sputnik13 oh wait
21:07 sputnik13 i misspoke, there probably is nat going on
21:08 sputnik13 (╯°□°)╯︵ ┻━┻
21:09 sputnik13 so, gluster won't work in nat'd environments?
21:10 JoeJulian It's theoretically possible, but I've never figured out how to do it.
21:10 JoeJulian I'd rather set up vxlan than figure that out.
21:11 sputnik13 well this sucks
21:11 sputnik13 blew a couple days on this
21:11 sputnik13 :(
21:12 sputnik13 JoeJulian thank you for your help
21:12 JoeJulian You're welcome.
21:16 kovshenin joined #gluster
21:21 kovsheni_ joined #gluster
21:39 derjohn_mob joined #gluster
21:40 julim joined #gluster
21:47 hackman joined #gluster
21:52 Gambit15 Hey all, I know this isn't officially the place, but no one's around in the xfs channel. Anyone here got much knowledge about configuring XFS block sizes & the like?
21:53 Gambit15 Given it's supported by RH, thought I might find someone here...
22:03 pdrakeweb joined #gluster
22:05 rwheeler joined #gluster
22:07 JoeJulian I've never found a need to stray from the defaults.
22:27 Gambit15 JoeJulian, I'm already predicting a bottleneck in my network (dedicated Gbit switch, 10Gbit kit on order), so I'm trying to mitigate it in other ways as much as possible first. I'm reading that hosting random I/O heavy VMs on top of volumes which are misaligned can cause I/O problems, so I need to get the XFS blocks aligned with the LV blocks, aligned with the RAID & HD blocks.
22:36 JoeJulian They're all supposed to do that automatically.
22:37 Gambit15 Yeah, well looks like LVM isn't...
22:38 Gambit15 It's either not configured correctly (given I've followed the docs to the T, it's either a bug or a typo), or it's not reporting its geometry correctly
22:39 JoeJulian Bummer. :(
22:39 JoeJulian Sorry I haven't had problems with that so I don't have the first idea what to look for.
22:40 Gambit15 Right, will pick it up again tomorrow :/
22:40 Gambit15 Cheers anyway!
22:54 kovshenin joined #gluster
23:00 pdrakeweb joined #gluster
23:02 om joined #gluster
23:32 ws2k3 joined #gluster
23:41 Jacob843 joined #gluster
23:47 masuberu joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary