Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2014-01-26

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:15 jporterfield joined #gluster
00:27 tryggvil joined #gluster
00:41 geewiz joined #gluster
00:44 qdk joined #gluster
01:26 mkzero joined #gluster
01:27 jporterfield joined #gluster
01:42 geewiz joined #gluster
01:42 armiller joined #gluster
02:11 jporterfield joined #gluster
02:16 cfeller I'm tarring up a large directory (274 G) that resides on a Gluster 3.4.2 volume (native FUSE mount), and I keep seeing these sporadic "tar: ... file changed as we read it" messages scroll by.  maybe once every 50 files.
02:16 cfeller there are no errors in the gluster mount log.
02:17 cfeller I've verified that nothing else is accessing these files (via lsof), so I'm a bit puzzled.
02:17 cfeller is gluster reporting info that is confusing tar?
02:17 TrDS left #gluster
02:18 cfeller should I be concerned?
02:18 cfeller I saw on old bug report on this: https://bugzilla.redhat.com/show_bug.cgi?id=762345
02:18 glusterbot Bug 762345: high, low, 3.1.1, aavati, CLOSED CURRENTRELEASE, tar keeps reporting "file changed as we read it" on random files on glfs/replicate
02:19 cfeller gluster client and servers in my case are EL 6, gluster version is 3.4.2 on both.
02:27 Frankl joined #gluster
02:29 Frankl joined #gluster
02:42 geewiz joined #gluster
02:48 dusmant joined #gluster
02:55 jporterfield joined #gluster
03:07 Frankl who could help look at my issue of the cluster (3.3 glusterfs) used in production enverioment?
03:07 Frankl I have sent a email to gluster-users list with title: ntresting issue of replication and self-heal
03:07 Frankl I have sent a email to gluster-users list with title: intresting issue of replication and self-heal
03:24 jporterfield joined #gluster
03:43 geewiz joined #gluster
04:33 jporterfield joined #gluster
04:44 geewiz joined #gluster
04:52 JonnyNomad joined #gluster
05:00 dblack joined #gluster
05:11 vpshastry joined #gluster
05:15 tryggvil joined #gluster
05:36 tryggvil joined #gluster
05:42 wica joined #gluster
05:42 jkroon joined #gluster
05:45 geewiz joined #gluster
05:48 ujjain joined #gluster
05:54 Gugge joined #gluster
05:55 jporterfield joined #gluster
06:02 jporterfield joined #gluster
06:08 jporterfield joined #gluster
06:17 vpshastry left #gluster
06:20 jporterfield joined #gluster
06:46 geewiz joined #gluster
07:31 Frankl joined #gluster
07:33 davinder joined #gluster
07:46 geewiz joined #gluster
07:47 jporterfield joined #gluster
08:23 jporterfield joined #gluster
08:47 geewiz joined #gluster
08:51 vpshastry joined #gluster
09:15 jporterfield joined #gluster
09:23 geewiz joined #gluster
09:24 vpshastry left #gluster
09:33 ngoswami joined #gluster
09:46 jporterfield joined #gluster
10:04 jmarley joined #gluster
10:14 purpleidea Frankl: it would probably be best if you just asked your question, or if you really want to refer to something, to include the link to it.
10:20 Frankl Thanks purpleidea, I am a newbie of IRC and glusterfs. here is my http://supercolony.gluster.org/pipermail​/gluster-users/2014-January/038801.html & http://supercolony.gluster.org/pipermail​/gluster-users/2014-January/038731.html
10:20 glusterbot Title: [Gluster-users] could I delete stale files in .glusterfs/indicies/xattrop (at supercolony.gluster.org)
10:46 jporterfield joined #gluster
10:51 jporterfield joined #gluster
10:56 jporterfield joined #gluster
11:21 jporterfield joined #gluster
11:26 purpleidea Frankl has dissappeared...
11:26 purpleidea if you see this, you need to stay in channel if you want a response
11:32 jporterfield joined #gluster
11:58 swaT30 joined #gluster
12:04 harish joined #gluster
12:26 jporterfield joined #gluster
12:32 Peanut Eeks, gluster won't start up again on one of my two servers. I get 'Initialization of volume 'management' failed, review your volfile again' :-(
12:36 mick27 joined #gluster
12:36 mick27 howdy folks
12:36 Peanut howdy
12:41 mick27 I was tasked to setup a last minute install of gluster, and I am still trying to figure out one step, I will have two gluster servers serving loads (up to 1mil) of small files (images - less than 800kb each) to several web servers. I don't recall what is the best practices here, using the gluster client or nfs ? the images will not be server more thant 3-4 times each, so I am not sure I will be putting some cache server on my side
12:47 quillo joined #gluster
12:48 klaxa samppah: we upgraded our servers to glusterfs 3.4.2 today with ip over infiniband (tcp instead of rdma) and we got 80 mb/s writing even on fusemount :)
12:49 klaxa semiosis: we installed the new packages on our servers and the api header was included :)
12:53 TrDS joined #gluster
13:17 samppah klaxa: great, i'm happy to hear that :)
13:26 RedShift joined #gluster
13:39 johnmilton joined #gluster
13:43 barnim joined #gluster
14:02 saltsa joined #gluster
14:06 geewiz joined #gluster
14:35 dbruhn mick27 here is a link to a blog article on the subject. http://joejulian.name/blog/nfs-mount-for-glusterf​s-gives-better-read-performance-for-small-files/
14:35 glusterbot Title: NFS mount for GlusterFS gives better read performance for small files? (at joejulian.name)
14:54 flrichar am i crazy or does gluster use nfs3?
14:54 flrichar seriously, I may be crazy
14:55 purpleidea flrichar: no
14:55 flrichar no I'm not crazy?
14:56 purpleidea flrichar: well you might be :P but gluster does use nfs v3 last time i checked nfsv4 is in the works.... or maybe i'm wrong about all of this
14:56 flrichar hehe
14:57 purpleidea flrichar: http://gluster.org/community/documentation/index​.php/Gluster_3.1:_NFS_Frequently_Asked_Questions old docs but apparently both
14:57 glusterbot Title: Gluster 3.1: NFS Frequently Asked Questions - GlusterDocumentation (at gluster.org)
15:07 geewiz joined #gluster
15:15 atrius joined #gluster
15:36 johnmilton joined #gluster
15:38 geewiz joined #gluster
15:38 TrDS left #gluster
15:59 vpshastry joined #gluster
16:11 davinder joined #gluster
16:18 atrius joined #gluster
16:36 vpshastry left #gluster
16:38 geewiz joined #gluster
16:51 d-fence joined #gluster
16:59 dneary joined #gluster
17:09 rotbeard joined #gluster
17:10 NigeyUK joined #gluster
17:10 NigeyUK evening :)
17:13 NuxRo evening
17:14 NigeyUK soo i have quite a simple question, that appears to pose multiple answers depending on who i speak to :|
17:16 hagarth NigeyUK: go ahead, we might give you more diverse answers :)
17:17 NigeyUK would certainly be appreciated, i've been asked to draw up a new web cluster plan, 3 http nodes, replicated FS, RDS, and an ldap auth server for the lot, from what ive read, glusterfs does not perform terribly well with the type of operations the fs will be doing (lots of small files, served as web pages) .. is this still the case ?
17:19 hagarth what is the small file size that you are referring to?
17:21 NigeyUK most of the web sites files are a few K
17:21 NigeyUK php to .. if that makes any difference, we have few sites that host large files, over a few hundred MB
17:21 hagarth what would be the number of files per directory?
17:22 NigeyUK in general, a maximum of 100, we do have a few sites which have an uploads directory that can hold hundreds of subdirs, with hundreds of files, but again, most of those are small images, maybe a few hundred KB each
17:24 hagarth typically operations like readdir are slow when there are a large number of small files in the directory
17:25 NigeyUK actually let me check our stats, we currently have nfs stats for how many readdir calls are being made..
17:27 hagarth in any case, it would be better to run your application with glusterfs to determine how it behaves. Eventually the sequence of calls performed by your application on the FS is what determines the overall performance.
17:27 hagarth some folks have seen better performance with small files when NFS is the access protocol for a gluster volume. So that might be something you could try too.
17:28 NigeyUK that was my next point, we currently use NFS, and would like to keep doing so, as opposed to FUSE
17:29 NigeyUK seems our stats for readdir are weird, average of 10.13u and a max of 23.00m .. according to munin
17:30 hagarth wow, what is the size of the directory that took 23m for a readdir operation to complete?
17:31 NigeyUK trying to find that specific dir now, afaik there is no directory that big lol !
17:32 hagarth lol ok
17:33 hagarth NigeyUK: have to run now, good luck with your testing.
17:33 NigeyUK ohh, that seems to be an eroneous entry, we had a nfs issue a few weeks back where it locked access to an upload dir, im guessing that is it.
17:34 NigeyUK thanks! and appreciate the advice :)
17:39 geewiz joined #gluster
17:45 _NiC joined #gluster
18:07 davinder joined #gluster
18:36 delhage joined #gluster
18:40 geewiz joined #gluster
18:42 glusterbot New news from newglusterbugs: [Bug 1058046] glusterd stop exit with non zero code when should exit with zero <https://bugzilla.redhat.co​m/show_bug.cgi?id=1058046>
19:34 mick27 joined #gluster
19:41 geewiz joined #gluster
20:26 mick27 dbruhn: thx !
20:41 mick272 joined #gluster
20:42 geewiz joined #gluster
20:48 jporterfield joined #gluster
20:52 ricky-ti1 joined #gluster
20:59 DV joined #gluster
21:19 jporterfield joined #gluster
21:22 davinder joined #gluster
21:32 plarsen joined #gluster
21:41 ells joined #gluster
21:42 geewiz joined #gluster
21:44 jporterfield joined #gluster
21:47 ells_ joined #gluster
21:50 ells__ joined #gluster
22:05 sroy_ joined #gluster
22:14 fidevo joined #gluster
22:15 ells_ joined #gluster
22:25 cyberbootje joined #gluster
22:28 ells_ joined #gluster
22:28 ells_ left #gluster
22:29 ells__ joined #gluster
22:30 cyberbootje1 joined #gluster
22:43 geewiz joined #gluster
22:45 badone joined #gluster
23:04 StarBeast joined #gluster
23:08 ells joined #gluster
23:11 jporterfield joined #gluster
23:13 ells_ joined #gluster
23:29 sroy_ joined #gluster
23:37 ells joined #gluster
23:44 geewiz joined #gluster
23:50 overclk joined #gluster
23:54 diegows joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary