Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2015-08-18

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:23 ira joined #gluster
00:46 plarsen joined #gluster
00:52 dlambrig joined #gluster
01:01 victori joined #gluster
01:55 harish joined #gluster
01:58 ding2go joined #gluster
01:59 ding2go Hey guys I am currently struggling with a slow gluster setup
01:59 ding2go just got a new setup with a volume with 2 briks which are replicating good but responding slow to user request through apache
02:00 ding2go a website load time with glusterfs is arround 7 seconds without glusterfs 2 to 3
02:01 ding2go any magically tuning that can be advisable ? I already tried  performance.cache-size 256MB
02:03 ding2go by the way running ssd
02:05 nangthang joined #gluster
02:06 haomaiwa_ joined #gluster
02:06 Telsin look for in on gluster mounts vs NFS mounts
02:06 Telsin for lots of small files, nfs mounted gluster backed vols are often better
02:06 Telsin although 3.6 & 3.7 are workign to close the gap
02:08 Telsin php type sites expecially, as they tend to have a lot of includes, etc...
02:08 DV__ joined #gluster
02:08 ding2go thanks
02:08 ding2go but when I shutdown one of the bricks its fast I see now
02:09 Telsin what's your network between them?
02:09 Telsin you're seeing the latency as it waits to confirm writes between the two
02:10 ding2go outside of the network
02:10 ding2go let me see the vps
02:11 ding2go 1gb
02:11 ding2go both vpses
02:11 Telsin your gluster servers are vpses?
02:16 ding2go jes
02:16 ding2go yes
02:17 ding2go if I shutdown 1 vps its fast doesn't matter which one page load time gets 3 seconds
02:20 Telsin if the two vpses are your gluster servers, where's your web server? one of the same two?
02:20 ding2go there isn't even a write session when it happends
02:20 ding2go yes
02:21 ding2go both are webserver :S
02:21 Telsin mounting the web server how?
02:21 ding2go bot webserver are having a mount point
02:21 Telsin fuse or nfs mount?
02:21 ding2go fuse
02:22 ding2go there isn't even a write session when it happends
02:22 Telsin try it as nfs first
02:22 Telsin the directory caching helps a lot
02:22 ding2go mounting gluster through nfs?
02:22 Telsin with the fuse mount, you're checking both servers to make sure you have the newest copy (so if the
02:22 Telsin yeap
02:23 Telsin (as I understand it), so when it one is done it doesn't check it, and you're getting a more local read
02:23 Telsin better test would be a 3rd vps as your web server
02:23 Telsin at least for seeing the traffic happen :)
02:23 ding2go let me trie it then will be back
02:24 Telsin and mount noatime if you can, otherwise you're writing even if you dont' think you are, directory updates
02:26 Telsin mostly for nfs moutns that
02:26 Telsin these are still valid, I think: http://www.jamescoyle.net/how-to/559-glusterfs-performance-tuning
02:31 baojg joined #gluster
02:36 ding2go ok nfs dropped the speed back to 3 seconds
02:36 ding2go nice!!
02:36 ding2go however I will not be redundant right?
02:37 ding2go if one of the servers is down the mount will not work
02:39 ding2go (speed) = load time
02:40 Telsin depends on how you mount it, lots of us cdtb (from samba) to provide some shared IPs to mount from
02:40 Telsin you can use keepalived too, but ctdb is a bit more flexible and can help you load share between the two
02:41 Telsin or even mount off local host, would work in your current scenario where each host is a web server
02:47 ding2go I tried mounting from local host but this prevents the sync between them
02:48 Telsin shouldn't, if you get it mounted via gluster and not the brick directory
02:48 ding2go can you show me an example?
02:48 Telsin but ctdb (I see I had it backwards) is probably the way to go
02:49 Telsin mount -t nfs localhost:/glustershare /mnt
02:49 Telsin should do it
02:49 Telsin if your gluster vol is named glustershare, of course
02:49 ding2go yeah got that
02:49 ding2go thanks let me try
02:52 nangthang joined #gluster
02:58 RobertLaptop joined #gluster
02:58 bharata-rao joined #gluster
03:00 ding2go I cant really mounted
03:00 ding2go do I need to put something special in the /etc/exports?
03:02 haomaiwang joined #gluster
03:03 Telsin no, just make sure nfs isn't disabled for teh gluster volumes
03:03 Telsin and that you don't have the system's nfs services running
03:05 kshlm joined #gluster
03:13 RobertLaptop joined #gluster
03:15 baojg joined #gluster
03:25 ding2go @Telsin
03:26 ding2go I cant mount it without the following option " mountproto=tcp"
03:26 ding2go when I use it it again slows down
03:28 RobertLaptop joined #gluster
03:32 shubhendu joined #gluster
03:32 victori joined #gluster
03:37 TheSeven joined #gluster
03:37 RobertLaptop joined #gluster
03:40 DV joined #gluster
03:42 nthomas joined #gluster
03:46 itisravi joined #gluster
03:46 RobertLaptop joined #gluster
03:47 ding2go just a quick update something really nasty it does not make any sense :( after using the nfs mount found out that the first mount is always fast while the second mount is slow
03:48 kanagaraj joined #gluster
03:48 ding2go both hosts are mounted to local
03:49 atinm joined #gluster
03:51 gem joined #gluster
03:55 ashiq joined #gluster
03:57 sakshi joined #gluster
04:02 haomaiwang joined #gluster
04:02 nbalacha joined #gluster
04:03 dlambrig joined #gluster
04:05 neha joined #gluster
04:08 kkeithley1 joined #gluster
04:09 ppai joined #gluster
04:12 victori joined #gluster
04:13 RobertLaptop joined #gluster
04:16 baojg joined #gluster
04:20 kkeithley1 joined #gluster
04:21 yazhini joined #gluster
04:22 hgowtham joined #gluster
04:22 dusmant joined #gluster
04:23 arcolife joined #gluster
04:24 atinm joined #gluster
04:25 Manikandan joined #gluster
04:35 deepakcs joined #gluster
04:35 rafi joined #gluster
04:36 RobertLaptop joined #gluster
04:39 nbalacha joined #gluster
04:41 jiffin joined #gluster
04:45 ndarshan joined #gluster
04:45 kotreshhr joined #gluster
04:47 RedW joined #gluster
04:53 Gugge joined #gluster
04:54 vimal joined #gluster
04:56 overclk joined #gluster
05:01 rafi1 joined #gluster
05:02 haomaiwang joined #gluster
05:02 Bhaskarakiran joined #gluster
05:05 sakshi joined #gluster
05:06 meghanam joined #gluster
05:08 dlambrig joined #gluster
05:10 RobertLaptop joined #gluster
05:15 nbalacha joined #gluster
05:16 skoduri joined #gluster
05:18 rjoseph joined #gluster
05:27 RobertLaptop joined #gluster
05:30 RameshN joined #gluster
05:33 RobertLaptop joined #gluster
05:40 RobertLaptop joined #gluster
05:45 atalur joined #gluster
05:46 ramky joined #gluster
05:47 vmallika joined #gluster
06:01 Saravana_ joined #gluster
06:02 haomaiwa_ joined #gluster
06:03 monotek joined #gluster
06:05 overclk joined #gluster
06:12 ramteid joined #gluster
06:13 ding2go joined #gluster
06:17 nthomas joined #gluster
06:19 TvL2386 joined #gluster
06:19 shubhendu joined #gluster
06:21 ndarshan joined #gluster
06:26 gildub joined #gluster
06:27 skoduri joined #gluster
06:32 jtux joined #gluster
06:37 jiku joined #gluster
06:38 maveric_amitc_ joined #gluster
06:41 anil joined #gluster
06:44 rafi joined #gluster
06:45 anil joined #gluster
06:46 dlambrig joined #gluster
06:46 jtux joined #gluster
06:49 atalur joined #gluster
06:49 arcolife joined #gluster
06:51 Manikandan joined #gluster
06:52 dusmant joined #gluster
06:57 nbalacha joined #gluster
06:59 nangthang joined #gluster
06:59 kotreshhr joined #gluster
07:02 haomaiwa_ joined #gluster
07:04 jwd joined #gluster
07:17 18WAAHXU9 joined #gluster
07:23 gem joined #gluster
07:24 TvL2386 joined #gluster
07:25 shubhendu joined #gluster
07:26 ndarshan joined #gluster
07:28 arcolife joined #gluster
07:29 ctria joined #gluster
07:30 gem joined #gluster
07:32 aravindavk joined #gluster
07:32 nthomas joined #gluster
07:34 deniszh joined #gluster
07:34 dusmant joined #gluster
07:35 fsimonce joined #gluster
07:35 yazhini joined #gluster
07:38 cppking joined #gluster
07:40 cppking Hello guys , I need help https://bpaste.net/show/3662de39c712
07:40 glusterbot Title: show at bpaste (at bpaste.net)
07:42 cppking well , I think I've got the answer
07:45 tanuck joined #gluster
07:46 kovshenin joined #gluster
07:48 ctria joined #gluster
07:48 Slashman joined #gluster
07:49 Trefex joined #gluster
07:54 Norky joined #gluster
07:58 social joined #gluster
08:02 haomaiwa_ joined #gluster
08:02 gletessier joined #gluster
08:05 LebedevRI joined #gluster
08:20 overclk joined #gluster
08:26 Xtreme joined #gluster
08:28 yazhini joined #gluster
08:30 Saravana_ joined #gluster
08:38 c0m0 joined #gluster
08:42 meghanam joined #gluster
08:44 Alex-31 anybody use GlusterFS and samba share for a windows environment ?
08:44 Alex-31 I have some lag /time access when I browse the directory
08:45 Alex-31 create an empty directory need more of 8 secondes ...
08:45 TvL2386 joined #gluster
08:45 rafi rastar: anoopcs ^
08:50 rastar Alex-31: which version of glusterfs and samba?
08:50 rastar rafi: Thanks!
08:50 cppking joined #gluster
08:51 Trefex dear all, dear rafi, i face now the following problem when i want to stop the gluster volume https://paste.fedoraproject.org/256163/87860143/
08:51 glusterbot Title: #256163 Fedora Project Pastebin (at paste.fedoraproject.org)
08:51 Alex-31 rastar:  3.5.2-2
08:52 n-st joined #gluster
08:52 rastar Alex-31: and samba?
08:52 Alex-31 rastar: samba 4.1.17
08:52 Alex-31 i'm on Debian Jessie
08:53 mikedep333 joined #gluster
08:54 rastar Alex-31: and you are using the vfs plugin?
08:54 rastar or fuse mount?
08:55 Lee1092 joined #gluster
08:55 Alex-31 fuse moint. I don't vfs (i'm going to read on now :) )
08:55 Alex-31 i don't know vfs *
08:57 rastar Alex-31: This is a good how-to and using gluster vfs plugin with Samba
08:57 rastar https://lalatendumohanty.wordpress.com/2014/02/11/using-glusterfs-with-samba-and-samba-vfs-plugin-for-glusterfs-on-fedora-20/
08:57 rastar For now, looks like the directory under which you are creating a new empty directory already has many files..
08:57 Trefex anybody got some ideas how i can stop my volume? :)
09:00 meghanam joined #gluster
09:00 rastar Alex-31: If that is true, you could a.Tune some smb.conf params depending on what features you don't require b.change the directory structure to have less files/dirs under it.
09:01 Alex-31 rastar: this How-to seem to be perfect and specific for an enduser endpoint
09:01 Alex-31 rastar: yes, the root directory shared byu samba is not empty
09:02 haomaiwa_ joined #gluster
09:02 Alex-31 there is more less 150 files/directory and moreless 1GB of data, but, It's only for test... in a production environment, my users are going to create  more folders
09:08 cppking can I update "ctype module" of python 2.6.6  ,   because It can't use   libgfapi module
09:09 cppking ctyps has no attribute  c_ssize_t
09:13 rastar Alex-31: 150 files is not a problem...
09:14 rastar Alex-31: there must be something else going on
09:16 rastar Alex: would you try the vfs plugin first? we can debug then if it has the same problems..
09:19 arcolife joined #gluster
09:20 skoduri joined #gluster
09:21 meghanam joined #gluster
09:28 KennethDejonghe joined #gluster
09:28 jordie joined #gluster
09:31 marbu joined #gluster
09:31 yazhini joined #gluster
09:33 Alex-31 rastar: do you know if samba 4 comes with the VFS support ?
09:34 msciciel_ joined #gluster
09:37 rastar Alex-31: Yes it does
09:42 rastar Alex-31: if gluster vfs plugin is installed then you should be able to find a glusterfs.so under lib folder of samba
09:45 anil joined #gluster
09:48 Alex-31 rastar:  zob ..... Error loading module '/usr/lib/x86_64-linux-gnu/samba/vfs/glusterfs.so'
09:53 Alex-31 i think i'm on a bug with debian ...
09:58 overclk joined #gluster
09:59 mbukatov joined #gluster
10:00 Alex-31 rastar:  are you on centos/fedora or debian ?
10:02 haomaiwa_ joined #gluster
10:06 baojg joined #gluster
10:06 hagarth joined #gluster
10:07 baojg joined #gluster
10:07 baojg joined #gluster
10:14 TvL2386 joined #gluster
10:16 kotreshhr joined #gluster
10:18 baojg joined #gluster
10:18 Saravana_ joined #gluster
10:26 schandra joined #gluster
10:31 ira_ joined #gluster
10:33 shyam joined #gluster
10:36 aravindavk joined #gluster
10:39 kanarip joined #gluster
10:42 elico joined #gluster
10:49 skoduri joined #gluster
10:57 bfoster joined #gluster
10:57 DV__ joined #gluster
10:58 autoditac_ joined #gluster
11:03 meghanam joined #gluster
11:03 Saravana_ joined #gluster
11:05 rjoseph joined #gluster
11:06 kotreshhr1 joined #gluster
11:07 overclk_ joined #gluster
11:08 aravindavk joined #gluster
11:11 tanuck joined #gluster
11:14 plarsen joined #gluster
11:15 ndarshan joined #gluster
11:17 nthomas joined #gluster
11:19 jrm16020 joined #gluster
11:19 shubhendu joined #gluster
11:24 Saravana_ joined #gluster
11:24 kotreshhr joined #gluster
11:33 poornimag joined #gluster
11:42 overclk joined #gluster
11:51 doekia joined #gluster
11:52 autoditac_ joined #gluster
11:55 chirino joined #gluster
11:56 overclk joined #gluster
11:58 meghanam joined #gluster
11:58 rafi1 joined #gluster
12:00 jiku joined #gluster
12:01 rafi joined #gluster
12:06 poornimag joined #gluster
12:08 rastar Alex-31: I was afk
12:08 meghanam joined #gluster
12:08 rastar Alex-31: I use fedora
12:09 Alex-31 ok ... i have install one fedora 22 for see if better before trying to compile samba :)
12:09 rastar rastar: I will try spinning up a debian vm and try this out..
12:09 rastar Alex-31: that is good :)
12:09 itisravi joined #gluster
12:11 DV joined #gluster
12:11 jtux joined #gluster
12:12 rastar Alex-31: I would suggest sending this as mail on gluster-users@gluster.org as it would be easier to track
12:16 Lee1092 joined #gluster
12:16 twisted` joined #gluster
12:21 shubhendu joined #gluster
12:27 Alex-31 rastar: yes, i'm going to because it's seem to work better on fedora
12:27 rjoseph joined #gluster
12:27 gildub joined #gluster
12:28 Alex-31 rastar: now i have an error "Failed to initialize volume" when i try to browse de vfs glusterfs share.
12:28 rastar Alex-31: that means glusterfs.so is not installed
12:28 Alex-31 haa ? mhmm
12:29 rastar in fedora it comes with a package samba-vfs-glusterfs.x86_64
12:29 Alex-31 yep, i have install it:
12:29 Alex-31 [root@drbd05 samba]# find /usr/ -iname glusterfs.so
12:29 Alex-31 /usr/lib64/samba/vfs/glusterfs.so
12:29 rastar hmm
12:30 rastar Alex-31: do you have a log in /var/log/samba/ with name starting with glusterfs-*?
12:30 Alex-31 i want to share with samba, a glusterfs volume wich is on another server
12:31 arcolife joined #gluster
12:32 rastar Then you need to have an entry in smb.conf under [share] which something like this glusterfs:volfile_server:IPofOtherServer
12:32 unclemarc joined #gluster
12:33 B21956 joined #gluster
12:33 plarsen joined #gluster
12:33 rastar s/glusterfs:volfile_server:IPofOtherServer/glusterfs:volfile_server = IPofOtherServer
12:33 rastar Alex-31: ^^
12:34 Alex-31 yep, i have it... i'm going to do a pastebin
12:35 rastar ok
12:36 Alex-31 rastar: here the smb.conf
12:36 Alex-31 http://pastebin.com/CEt59e4D
12:36 glusterbot Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils.
12:36 ashiq joined #gluster
12:37 Alex-31 rastar:  here, the log of samba-vfs: http://pastebin.com/dwc047bf
12:37 glusterbot Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils.
12:38 Pintomatic joined #gluster
12:38 Alex-31 rastar:  here, the log VFS of samba: http://fpaste.org/256234/39901487/
12:38 glusterbot Title: #256234 Fedora Project Pastebin (at fpaste.org)
12:38 frankS2 joined #gluster
12:39 Alex-31 rastar: here, the smb.conf: http://fpaste.org/256237/39901533/
12:39 glusterbot Title: #256237 Fedora Project Pastebin (at fpaste.org)
12:39 Alex-31 rastar: and here, the log.smbd: http://fpaste.org/256239/14399015/
12:39 glusterbot Title: #256239 Fedora Project Pastebin (at fpaste.org)
12:39 lezo joined #gluster
12:39 jcastill1 joined #gluster
12:40 rastar Alex-31: you have performed volume sets to allow insecure , right?
12:40 rastar gluster volume set volname server.allow-insecure on
12:40 Alex-31 rastar: i think to pb is here:  [name.c:447:client_bind] 0-gfapi: cannot bind inet socket (62) to port less than 1024 (Permission non accordée)
12:41 rastar and changes in etc/glusterfs/glusterd.vol
12:44 jcastillo joined #gluster
12:50 Alex-31 rastar: is possible to force a connection port from samba vfs to glusterfs server ?
12:50 kotreshhr left #gluster
12:50 Alex-31 my gluster server listen on 49152
12:50 Alex-31 an it seem, samba try to connect on 24007
12:51 rastar Alex-31: glusterd on your server listens on 24007
12:51 rastar and glusterfsd(brick processes) listens on 49152
12:51 Alex-31 ok, i was thinking, samba directly connect on the brick
12:52 rastar when Samba tries to initialize a volume, it first  talks to glusterd on server at 24007, gets a volfile and then starts talking to brick at 49152
12:53 ashiq joined #gluster
12:57 Alex-31 mhmm :-/ rastar, do you have anything in this file : /proc/sys/net/ipv4/ip_local_reserved_ports ?
12:57 Alex-31 i have a warning message: W [common-utils.c:2544:gf_get_reserved_ports] 0-glusterfs: could not open the file /proc/sys/net/ipv4/ip_local_reserved_ports for getting reserved ports info (Permission non accordée)
12:58 rastar Alex-31: ignore that
12:59 rastar it is a feature where Samba/gfapi does not bind to those ports on the client machine which are listed there
12:59 rastar But I have a question
12:59 rastar How did you start Samba?
12:59 Alex-31 systemctl restart smb
13:00 rastar I hope you did a systemctl start smb as root
13:00 Alex-31 yep
13:00 rastar ok
13:00 rastar then firewall on server
13:00 rastar ?
13:00 rastar is it set to accept packets and reply to them for port 24007
13:00 cyberswat joined #gluster
13:01 plarsen joined #gluster
13:02 Alex-31 i have flush all rules on the fedora server
13:02 Alex-31 on debian, the default is all accept
13:03 haomaiwa_ joined #gluster
13:03 Alex-31 this is the log og the samba vfs: http://fpaste.org/256246/99027741/
13:03 glusterbot Title: #256246 Fedora Project Pastebin (at fpaste.org)
13:04 rastar Alex-31: did you make the changes in /etc/glusterfs/glusterd.vol and restart glusterd?
13:04 Alex-31 this is the conf of the gluster volume: http://fpaste.org/256251/39903040/
13:04 glusterbot Title: #256251 Fedora Project Pastebin (at fpaste.org)
13:05 rastar Alex-31: fpaste the /etc/glusterfs/glusterd.vol file too
13:06 Alex-31 rastar: http://fpaste.org/256255/90319914/
13:06 glusterbot Title: #256255 Fedora Project Pastebin (at fpaste.org)
13:07 rastar Alex-31: that is right too. so you did a systemctl restart glusterd after that change?
13:08 overclk joined #gluster
13:09 aravindavk joined #gluster
13:09 Alex-31 yes
13:09 Alex-31 i have do it again to be sure :)
13:10 rastar Alex-31: Please try :) The logs say that glusterd is not accepting packets from Samba.
13:13 pdrakeweb joined #gluster
13:14 Alex-31 rastar: no better. I a do a mount directly, this work fine:  mount.glusterfs drbd01:/GFSVOLNEW /data_local/
13:15 rastar Alex-31: from the same server where Samba is running?
13:18 rafi joined #gluster
13:20 Alex-31 rastar: yes
13:20 Alex-31 so, the port are
13:20 Alex-31 open*
13:20 dusmant joined #gluster
13:21 rastar Alex-31: also, what version of gluster is installed on Samba server and what version is installed on gluster volfile server?
13:21 rastar Alex-31: ok..
13:22 rastar Alex-31: Does "Permission non accordée" mean Permission denied? I am not sure why bind is failing on client machine.. Debug line "cannot bind inet socket (39) to port less than 1024 (Permission non accordée)"
13:24 mpietersen joined #gluster
13:24 Alex-31 rastar:  yes, it is
13:24 julim joined #gluster
13:24 Alex-31 on the samba server, no gluster server... only samba-vfs-glusterfs-4.2.2-1
13:24 Alex-31 and samba samba-4.2.2-1
13:25 rastar Alex-31: yes, but some gluster bits would be pulled in by samba-vfs-glusterfs
13:26 rastar rpm -qa | grep gluster would show the gluster packages version
13:28 DV joined #gluster
13:28 nbalacha joined #gluster
13:28 rastar Alex-31: One last thing...selinux :(...We need to figure out why smb process on server is not getting all rights...
13:34 Alex-31 i'm not a gourou on fedora
13:34 Alex-31 how io disable selinux ?.
13:35 rastar Alex-31: setenforce 0
13:35 Alex-31 rastar: thks :)
13:35 rastar you should get a message saying SELinux is disabled
13:35 Alex-31 Google is my friend too :D
13:35 rastar Now try one last time :)
13:38 Pupeno joined #gluster
13:39 aaronott joined #gluster
13:40 bennyturns joined #gluster
13:40 Alex-31 rastar:
13:40 Alex-31 bingo !
13:40 Alex-31 :D
13:42 Alex-31 it's very slow, but it work !!! :D
13:42 rastar Alex-31: :)
13:42 Alex-31 thanks you for your time !
13:42 rastar Alex-31:  please don't completely disable selinux
13:42 Alex-31 why ?
13:42 rastar there are selinux options to allow smb process to do all things that were denied in first rount
13:42 rastar *round
13:43 rastar Alex-31: Better security ;)
13:43 Alex-31 ah, yes, but, for the moment, it's only for a  test environnment
13:43 Alex-31 so, not very important
13:43 rastar for tests you can keep it disabled
13:44 rastar Alex-31: as for slow, you can tune it to get good speeds
13:44 Alex-31 ok, do you know where I can find a good documentation ?
13:44 rastar but unfortunately it has to be done keeping in mind very specific needs of your prod environment
13:45 rastar Alex-31: no good documentation for smb-gluster combo
13:45 rastar you will have to look into smb.conf and into gluster set help to get a good fit
13:46 rastar Alex-31: I am working on getting a documentation done and it would be use if we could work together to identify good set of changes
13:46 rastar *useful
13:48 Alex-31 rastar: Yes, no problem, with pleasure
13:48 spcmastertim joined #gluster
13:49 Pintomatic joined #gluster
13:49 frankS2 joined #gluster
13:49 rastar Alex-31: Thanks! You can mail me at rtalur  at redhat.com
13:50 lezo joined #gluster
13:51 rastar Alex-31: as a start perform "gluster vol set VOLNAME io-cache off"
13:51 Alex-31 for the moment, listing a directory from a windows server share by a samba server whose mount the Gluster volume from debian server take more of 25 seconds
13:51 Alex-31 :-/
13:51 Alex-31 listing the same file directly from the glusterFS server take 2 secondes
13:52 eljrax The trashcan feature.. the documentation mentions 'pattern' for features.trash-eliminate-path, which made me think "aha, regex". But that doesn't seem to work. Am I'm doing something wrong or did I read too much into the word "pattern"?
13:52 rastar Alex-31: Ah..you did not tell me what version of gluster is running on samba server and gluster server
13:53 rastar Alex-31: if gluster server is debian then it has gluster 3.5.x and samba server is fedora then it has 3.7.x
13:53 rastar sorry, 3.6.x
13:53 dlambrig joined #gluster
13:54 rastar Alex-31: it is recommended to have same versions on both gluster server and Samba server.
13:54 rastar you can find deb and rpm for all versions from download.gluster.org
13:55 Alex-31 rastar: I haven't configure the gluster server on the samba server. It mount directly the volume with VFS
13:55 rastar Alex-31: yes, but Samba loads VFS plugin and it loads many gluster xlators..
13:55 Alex-31 I have 3 servers: A glusterFS server (debian), a samba server (fedora) and a windows server for test
13:55 rastar Alex-31: if you do a "rpm -qa | grep gluster" on fedora then you will see gluster packages that are installed
13:56 Alex-31 glusterfs-libs-3.6.4-1.fc22.x86_64
13:56 Alex-31 samba-vfs-glusterfs-4.2.2-1.fc22.x86_64
13:56 Alex-31 glusterfs-server-3.6.4-1.fc22.x86_64
13:56 Alex-31 glusterfs-fuse-3.6.4-1.fc22.x86_64
13:56 Alex-31 glusterfs-api-3.6.4-1.fc22.x86_64
13:56 Alex-31 glusterfs-3.6.4-1.fc22.x86_64
13:56 Alex-31 glusterfs-cli-3.6.4-1.fc22.x86_64
13:56 rastar Alex-31: Yes, fedora is your Samba server + gluster client
13:56 Alex-31 and, on the debian server:
13:56 Alex-31 ii  glusterfs-client               3.5.2-2                       amd64        clustered file-system (client package)
13:56 Alex-31 ii  glusterfs-common               3.5.2-2                       amd64        GlusterFS common libraries and translator modules
13:56 Alex-31 ii  glusterfs-server               3.5.2-2                       amd64        clustered file-system (server package)
13:57 rastar Alex-31: clustering intelligence and some other features in gluster are in the gluster client packages (glusterfs-libs)
13:57 arcolife joined #gluster
13:58 rastar Alex-31: so as I mentioned, for your tests I would recommend you to install same version of gluster packages on both fedora and debian. Get it from download.gluster.org
13:58 dlambrig_ joined #gluster
13:58 rastar Go with latest in 3.6
14:00 rastar Alex-31: So fedora is fine. Upgrade gluster packages on debian to have 3.6.4. Here is the link http://download.gluster.org/pub/gluster/glusterfs/3.6/3.6.4/Debian/
14:00 glusterbot Title: Index of /pub/gluster/glusterfs/3.6/3.6.4/Debian (at download.gluster.org)
14:01 Alex-31 rastar: mayeb for Fedora, but i'm a sysadmin on Debian since 10 years ... very difficult for me to accept to go on fedora now :D
14:01 dusmant joined #gluster
14:02 Alex-31 i'm going to test in a fedora environnment, and compil for debian ahaha
14:02 haomaiwa_ joined #gluster
14:02 rastar Alex-31: :) that should not be a problem...Gluster should work well on debian too. We build even the latest for debian..
14:04 leucos joined #gluster
14:04 rastar Alex-31: I will try getting the same setup on debian by tomorrow with gluster 3.7
14:05 rastar Alex-31: It would be good if we could use the same debian server you have as both gluster and samba server.
14:05 rastar Alex-31: With gluster 3.7 enhancements and some tuning we can fix performance.
14:07 Alex-31 perfect !
14:08 janegil joined #gluster
14:09 overclk joined #gluster
14:09 pdrakeweb joined #gluster
14:10 rastar Alex-31: I will be going away for now
14:10 lezo joined #gluster
14:10 rastar Alex-31: do mail me or find me here on irc when ever you are free for perf changes
14:11 Alex-31 rastar: ok, thanks you for your time. im going to upgrade my debian server in 3.6
14:13 dgandhi joined #gluster
14:14 mckaymatt joined #gluster
14:21 kshlm joined #gluster
14:21 jvandewege joined #gluster
14:36 hagarth joined #gluster
14:39 jvandewege_ joined #gluster
14:40 neofob joined #gluster
14:41 n-st joined #gluster
14:43 plarsen joined #gluster
14:45 dusmant joined #gluster
14:51 julim_ joined #gluster
14:54 TheCthulhu joined #gluster
14:54 neoice_ joined #gluster
14:54 ws2k3_ joined #gluster
14:54 overclk joined #gluster
14:55 chirino_m joined #gluster
14:57 dastar_ joined #gluster
14:59 klaas_ joined #gluster
15:00 chirino joined #gluster
15:00 mbukatov joined #gluster
15:02 haomaiwa_ joined #gluster
15:04 julim joined #gluster
15:04 yosafbridge joined #gluster
15:05 nthomas joined #gluster
15:06 TheCthulhu joined #gluster
15:07 twx joined #gluster
15:07 prg3 joined #gluster
15:10 shyam joined #gluster
15:11 codex joined #gluster
15:12 mdavidson joined #gluster
15:12 ndevos joined #gluster
15:12 ackjewt joined #gluster
15:12 cholcombe joined #gluster
15:12 Alex-31 joined #gluster
15:12 malevolent joined #gluster
15:12 mckaymatt joined #gluster
15:14 cyberbootje joined #gluster
15:15 _maserati joined #gluster
15:18 dgandhi joined #gluster
15:18 m0le_ left #gluster
15:23 kdhananjay joined #gluster
15:25 mckaymatt joined #gluster
15:36 mckaymatt joined #gluster
15:39 Pupeno_ joined #gluster
15:41 victori joined #gluster
15:42 ipmango joined #gluster
15:46 bennyturns joined #gluster
15:47 vimal joined #gluster
15:51 _shaps_ joined #gluster
15:54 arcolife joined #gluster
15:59 Pintomatic joined #gluster
15:59 Gill joined #gluster
15:59 frankS2 joined #gluster
16:00 overclk joined #gluster
16:01 lezo joined #gluster
16:01 haomaiwa_ joined #gluster
16:04 hagarth joined #gluster
16:07 kovshenin joined #gluster
16:07 jdossey joined #gluster
16:13 leucos joined #gluster
16:22 overclk joined #gluster
16:25 calavera joined #gluster
16:33 ilbot3 joined #gluster
16:33 Topic for #gluster is now Gluster Community - http://gluster.org | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
16:35 skoduri joined #gluster
16:40 mckaymatt joined #gluster
16:49 Rapture joined #gluster
16:54 timotheus1 joined #gluster
16:55 jcastill1 joined #gluster
16:56 overclk joined #gluster
16:57 victori joined #gluster
17:00 jcastillo joined #gluster
17:06 kovsheni_ joined #gluster
17:09 kovshenin joined #gluster
17:10 mckaymatt I am working on using gluster as the DFS for an offline multi-host system that will need to store less than 4TB of data. I don'
17:11 mckaymatt ... I don't think I can fully control the systems that the system runs on. is it okay to store my bricks on the host file system (ext4) using the "force" option?
17:12 mckaymatt In the examples I see, everyone uses a separate block device and they format it with XFS
17:13 mckaymatt From what I can see in the documentation, it looks like a mounted block device is preferred because the server won't start unless the device mounts properly
17:16 poornimag joined #gluster
17:21 techsenshi joined #gluster
17:24 rwheeler joined #gluster
17:38 jdossey joined #gluster
18:00 techsenshi what would cause the nfs server on some of our peers to show as N/A ?  these are new nodes to the volume for somereason NFS has always shown as N/A for them
18:01 XpineX joined #gluster
18:04 mpietersen if you have NFS packages installed on the system it can conflict with the version that is bundled with glusterd
18:05 mpietersen the gluster daemon starts it's own NFS process, and can't start if the system is trying to start it itself
18:05 techsenshi nfs is installed but disabled, found some links regarding rpcbind service creating a conflic
18:05 mpietersen rpcbind should be running, kernel nfs should not
18:06 mpietersen i would remove the NFS package entirely
18:06 mpietersen i guess i have nfs-utils installed
18:06 mpietersen but that is the only package
18:06 mpietersen i would assume if you run gluster volume status it shows NFS as N
18:07 techsenshi yea its weird the other peers which also have NFS installed but disabled show as online
18:07 mpietersen so it's disabled from rc.* from starting then?
18:08 mpietersen i had a PILE of issues with that same issue, but only after installing and trying to use kernel level NFS to serve the gluster volume
18:08 techsenshi yea its centos7 so sytemctl shows as disabled
18:08 social joined #gluster
18:09 mpietersen it would start sometimes, wouldn't start sometimes
18:09 squizzi_ joined #gluster
18:09 mpietersen rpc bind had conflicts because it wanted to use kernel NFS but couldn't start it because it was starting with gluster
18:09 mpietersen all sorts of dumb stuf
18:09 mpietersen stuff*
18:10 techsenshi hmm
18:11 mpietersen indeed
18:11 mpietersen i never really found a proper resolution
18:12 coredump joined #gluster
18:16 deniszh joined #gluster
18:21 techsenshi heh so never done this before but if I restart glusterfsd one one of the nodes, can i cause split brain or anything?
18:23 mpietersen i think it should just drop it out of the volume
18:23 mpietersen and when it comes back it should sync
18:24 mpietersen the only way I know you can get a split brain is if you modify the brick directly
18:24 mpietersen but I haven't had too much experience with it, so I have no idea
18:28 techsenshi interesting so just a restart of rpcbind and then restart glusterfsd on the nodes brought glusterfs nfs server online
18:29 techsenshi google keeps saying this is related to a -w option thrown to rpcbind during a server reboot
18:34 mpietersen yeah
18:34 mpietersen i actually had to do that earlier today
18:34 mpietersen stop glusterfs
18:34 mpietersen restart rpcbind
18:34 mpietersen start glusterfs
18:34 mpietersen and my nfs share came back online
18:49 techsenshi okay so i did create some split brain issues, i'm not really clear on how to heal/fix
18:49 autoditac__ joined #gluster
18:54 shaunm joined #gluster
18:57 mckaymatt joined #gluster
19:06 mpietersen i think there is a heal command
19:07 jwd joined #gluster
19:07 gletessier__ joined #gluster
19:14 ctria joined #gluster
19:14 TheCthulhu2 joined #gluster
19:16 techsenshi anyone give me a little more info on getfattr command when trying to resolve split brain
19:16 techsenshi i'm not clear on what digits are related to what for the trusted.afr value
19:18 techsenshi found the link nvm
19:27 _Bryan_ joined #gluster
19:28 uebera|| joined #gluster
19:28 capri joined #gluster
19:54 techsenshi how should I resolve split-brain for a Directory
19:54 klaxa joined #gluster
19:58 calavera joined #gluster
20:07 calavera joined #gluster
20:07 pdrakeweb joined #gluster
20:10 veonik left #gluster
20:34 ding2go joined #gluster
20:47 mckaymatt joined #gluster
21:16 tertiary joined #gluster
21:18 tertiary I deleted an old volume and am trying to rebuild a new one. I gte "Brick may be containing or be contained by an existing brick" when trying to create the new volume. What do I need to delete to get this to work?
21:27 dyasny joined #gluster
21:30 calavera joined #gluster
21:48 cyberswat joined #gluster
21:52 trav408 joined #gluster
22:00 badone_ joined #gluster
22:07 DV_ joined #gluster
22:13 XpineX joined #gluster
22:28 dgbaley joined #gluster
22:35 chan5n joined #gluster
22:38 niknakpaddywak joined #gluster
22:39 shyam joined #gluster
22:40 chan5n I have a pair of boxes with a replicated volume. Each box has a cifs share that works perfectly via samba-vfs-glusterfs. I need to listen via inotify for changes to that share, but assume we still lack inotify support (at least via libgfapi). Would it be an (interim) option to point inotify at the mounted brick directly (xfs in my case), on each box? Or rather, would I risk running into any pitfalls by doing this?
22:59 elico joined #gluster
23:15 the-me joined #gluster
23:18 jatb joined #gluster
23:29 ira joined #gluster
23:30 coredump|br joined #gluster
23:31 coredump|br joined #gluster
23:34 mckaymatt joined #gluster
23:49 spcmastertim joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary