Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2017-04-05

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:17 kramdoss_ joined #gluster
00:46 rafi joined #gluster
00:50 ahino joined #gluster
00:59 ahino joined #gluster
01:14 shdeng joined #gluster
01:29 arpu joined #gluster
01:48 ilbot3 joined #gluster
01:48 Topic for #gluster is now Gluster Community - http://gluster.org | Documentation - https://gluster.readthedocs.io/en/latest/ | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
01:49 kramdoss_ joined #gluster
02:27 kramdoss_ joined #gluster
02:41 skoduri joined #gluster
03:09 Gambit15 joined #gluster
03:20 magrawal joined #gluster
03:23 rafi joined #gluster
03:24 prasanth joined #gluster
03:25 sanoj joined #gluster
03:50 riyas joined #gluster
03:55 dominicpg joined #gluster
03:56 masber joined #gluster
04:00 Shu6h3ndu_ joined #gluster
04:01 krink joined #gluster
04:03 msvbhat joined #gluster
04:10 itisravi joined #gluster
04:20 rafi joined #gluster
04:30 MrAbaddon joined #gluster
04:31 nbalacha joined #gluster
04:32 sanoj joined #gluster
04:42 ankitr joined #gluster
04:50 apandey joined #gluster
04:53 karthik_us joined #gluster
04:54 ankitr joined #gluster
04:55 nishanth joined #gluster
04:59 ankitr joined #gluster
05:02 susant joined #gluster
05:04 devyani7 joined #gluster
05:06 Prasad joined #gluster
05:08 jiffin joined #gluster
05:17 rafi joined #gluster
05:17 skumar joined #gluster
05:18 poornima joined #gluster
05:18 susant left #gluster
05:19 rafi1 joined #gluster
05:24 Saravanakmr joined #gluster
05:25 sbulage joined #gluster
05:26 kotreshhr joined #gluster
05:27 Vaelatern joined #gluster
05:30 ryanolson joined #gluster
05:30 ryanolson good evening everyone
05:30 ppai joined #gluster
05:30 ryanolson I was wondering if someone was here who has experience using Gluster as a multi-node file storage for an nginx or apache web clister
05:30 ashiq joined #gluster
05:30 ryanolson cluster*
05:31 ryanolson it has been a few years since I used GlusterFS and I remember back in the day there were performance concerns
05:32 jiffin1 joined #gluster
05:40 magrawal joined #gluster
05:41 ndarshan joined #gluster
05:48 ryanolson joined #gluster
05:50 Saravanakmr joined #gluster
05:51 zoja joined #gluster
05:54 gyadav_ joined #gluster
05:55 jwd joined #gluster
06:00 prasanth joined #gluster
06:04 apandey_ joined #gluster
06:11 aravindavk joined #gluster
06:16 buvanesh_kumar joined #gluster
06:16 derjohn_mob joined #gluster
06:17 rafi ryanolson: i think, you can also ask this question in gluster-users mailing list , i'm sure you will get more eyes for this question from gluster-users mailing list
06:21 Saravanakmr joined #gluster
06:22 kdhananjay joined #gluster
06:23 ryanolson joined #gluster
06:23 sbulage joined #gluster
06:27 jtux joined #gluster
06:28 jtux left #gluster
06:30 hgowtham joined #gluster
06:38 ryanolson joined #gluster
06:38 jtux joined #gluster
06:39 jtux left #gluster
06:44 apandey joined #gluster
06:46 ppai joined #gluster
06:50 R0ok_ joined #gluster
06:55 kramdoss_ left #gluster
06:56 Karan joined #gluster
06:57 ivan_rossi joined #gluster
06:58 ivan_rossi left #gluster
06:59 nixpanic joined #gluster
06:59 nixpanic joined #gluster
07:01 Vaelatern joined #gluster
07:03 msvbhat joined #gluster
07:07 mbukatov joined #gluster
07:14 ryanolson joined #gluster
07:19 ryanolson joined #gluster
07:25 rastar joined #gluster
07:26 Philambdo joined #gluster
07:33 jiffin joined #gluster
07:34 jiffin joined #gluster
07:39 skoduri joined #gluster
07:43 jiffin joined #gluster
07:47 ryanolson joined #gluster
07:47 apandey_ joined #gluster
07:51 ryanolson_ joined #gluster
07:54 bartden joined #gluster
07:55 kramdoss_ joined #gluster
07:56 bartden Hi, from time to time when i try to unzip a newly written file on a distributed gluster environment with one node directly after the write of the zip file, i get a Java EOF exception. When i try to unzip it manually afterwards it works. It seems that the file is not ready yet. Any idea why this could occur and how i should handle this?
07:56 ryanolson_ joined #gluster
07:59 sona joined #gluster
07:59 itisravi joined #gluster
08:00 ahino joined #gluster
08:03 Saravanakmr joined #gluster
08:04 ryanolson_ joined #gluster
08:05 LuGervasi joined #gluster
08:07 LuGervasi Hallo. Is "gluster volume top" bugged? it seems that I read like 10k files (or are they blocks?) in a second for some files. after a vlume top clear. I think that the clear is not correctly clearing the stats.
08:07 ryanolson joined #gluster
08:11 flying joined #gluster
08:12 ryanolson_ joined #gluster
08:14 arif-ali joined #gluster
08:17 arif-ali joined #gluster
08:19 ryanolson_ joined #gluster
08:22 ryanolson joined #gluster
08:23 Wizek_ joined #gluster
08:25 kramdoss_ joined #gluster
08:30 Saravanakmr joined #gluster
08:35 ahino joined #gluster
08:35 sbulage joined #gluster
08:48 bartden Hi, from time to time when i try to unzip a newly written file on a distributed gluster environment with one node directly after the write of the zip file, i get a Java EOF exception. When i try to unzip it manually afterwards it works. It seems that the file is not ready yet. Any idea why this could occur and how i should handle this? I disable write-behind and enabled direct-io mode on client an direct-o-mode on server.
08:56 karthik_us joined #gluster
08:57 kdhananjay joined #gluster
09:04 jiffin1 joined #gluster
09:06 MrAbaddon joined #gluster
09:14 ankitr joined #gluster
09:21 apandey joined #gluster
09:22 Saravanakmr joined #gluster
09:23 jkroon joined #gluster
09:28 alezzandro joined #gluster
09:29 susant joined #gluster
09:38 jiffin1 joined #gluster
09:39 n0b0dyh3r3 joined #gluster
09:47 kramdoss_ joined #gluster
10:02 Saravanakmr joined #gluster
10:11 zoja joined #gluster
10:11 kramdoss_ joined #gluster
10:23 msvbhat joined #gluster
10:27 prasanth joined #gluster
10:31 kdhananjay joined #gluster
10:36 susant joined #gluster
10:39 Saravanakmr joined #gluster
10:40 kramdoss_ joined #gluster
10:40 susant left #gluster
10:57 tonyalbers joined #gluster
10:58 nh2 joined #gluster
10:58 tonyalbers hi guys, I have a q abt hadoop on gluster. Is it still possible? I see that RH mentions that support for the plugin is deprecated
11:22 ndevos tonyalbers: existing versions of the plugin will probably still work, it just does not get any bugfixes or feature updates
11:23 ndevos tonyalbers: I do not expect it to support disperse volumes, or volumes with sharding enabled - it may work, just less optimal
11:24 bartden joined #gluster
11:24 bartden Hi, from time to time when i try to unzip a newly written file on a distributed gluster environment with one node directly after the write of the zip file, i get a Java EOF exception. When i try to unzip it manually afterwards it works. It seems that the file is not ready yet. Any idea why this could occur and how i should handle this? I disable write-behind and enabled direct-io mode on client an direct-o-mode on server.
11:25 ndevos tonyalbers: what is your particular use-case? if you explain what you want to do on the gluster-users@gluster.org list, maybe other gluster+hadoop users reply with their experience
11:25 tonyalbers hmm.. so is there a replacement. I'd like to use gluster as the underlying filesystem for our hadoop cluster so that we have POSIX functionality when ingesting data
11:25 tonyalbers ?
11:27 ndevos tonyalbers: maybe there is a hadoop-on-nfs plugin? that should just work with gluster/fuse mounts too
11:28 ndevos bartden: the process that did the creation of the zip archive should make sure to flush the data, anything opening+reading the archive after that should get the complete file
11:29 tonyalbers ndevos: hmm. ok. we're trying to replace GPFS. so we have nodes with large disks that we'd like to use. going through nfs is probably not the best option.
11:30 aravindavk joined #gluster
11:31 ndevos tonyalbers: no, I meant that any hadoop environment that can work with nfs, should be able to work with glusterfs too, the behaviour of the two are very similar for applications
11:33 susant joined #gluster
11:33 susant left #gluster
11:36 tonyalbers ndevos: ok, you have me confused here :)  sorry.  the idea is to use gluster instead of gpfs, so that hadoop talks "hdfs" to gluster and thinks it's a local filesystem like gpfs seems to be.
11:38 tonyalbers ndevos: as far as I know, gluster and gpfs are very similar at least seen from a application point of view
11:38 ndevos tonyalbers: right, hadoop talks "hdfs" and plugins for hdfs can do the conversion to other backend filesystems, if you configure a plugin to use a local (or NFS) filesystem, that plugin should give you the oppertunity to use gluster
11:41 sona joined #gluster
11:41 tonyalbers ndevos: right, but won't i lose the data locality feature in hdfs/hadoop then (the thing that makes sure that jobs are run on the nodes having the appropriate pieces of data)?
11:42 ndevos tonyalbers: yes, for that you would need to use the hdfs/gluster plugin, and it should still work for normal distribute+replicated volumes
11:43 ndevos tonyalbers: well, I'm not sure about the Hadoop version that was used with the plugin, if newer hadoop versions need an updated plugin, it'll need some work :-/
11:44 tonyalbers ok. that clarifies it. Yeah, that's exactly my concern. I guess I'll have to use pure hdfs then.
11:44 tonyalbers but hdfs now supports NFS shares, so ingest is still possible though not as fast.
11:46 ndevos there were a few hadoop users running on Gluster, not sure what versions they were on though, and if they are still using it (updated?)
11:47 tonyalbers yeah, but all mentions of hadoop is gone in the gluster 3.2 admin guide from RH
11:47 tonyalbers are gone, sorry
11:48 ndevos yeah, I guess too few customers were interested in it
11:49 ndevos it only came up recently (dont remember who/where), that Gluster is an interesting storage solution for archiving Hadoop ...<something>...
11:51 Saravanakmr joined #gluster
11:51 tonyalbers allright. thanks for helping me out ndevos.
11:52 ndevos np, I hope it helped at least a little bit
11:54 apandey joined #gluster
12:01 kotreshhr left #gluster
12:04 shdeng joined #gluster
12:13 sona joined #gluster
12:27 kpease joined #gluster
12:39 ira joined #gluster
12:39 baber joined #gluster
12:43 shyam joined #gluster
13:10 pkoro joined #gluster
13:10 Shu6h3ndu_ joined #gluster
13:14 Klas in /var/log/glusterfs/bricks/ I'm getting a bunch of the following message:
13:14 Klas https://paste.ubuntu.com/24320216/
13:14 glusterbot Title: Ubuntu Pastebin (at paste.ubuntu.com)
13:15 Klas it's on a slave replica node
13:15 Klas anyone know what this means?
13:16 Klas to my head, it sounds like it tries to modify a file before the inode is allocated?
13:16 Klas -access-control: inode is NULL
13:23 DV joined #gluster
13:23 riyas_ joined #gluster
13:26 skylar joined #gluster
13:28 riyas_ joined #gluster
13:30 jiffin joined #gluster
13:32 riyasna joined #gluster
13:36 jwd joined #gluster
13:37 riyasna joined #gluster
13:39 squizzi joined #gluster
13:42 Perifrasi joined #gluster
13:46 riyas_ joined #gluster
13:46 jwd joined #gluster
13:51 riyas_ joined #gluster
13:56 Asako joined #gluster
13:58 skoduri joined #gluster
14:01 mb_ joined #gluster
14:05 mb_ joined #gluster
14:09 mb_ joined #gluster
14:17 shyam joined #gluster
14:18 humblec joined #gluster
14:23 MrAbaddon joined #gluster
14:25 dfgrs joined #gluster
14:27 Asako does gluster have a way for a client to mount a subdirectory?
14:27 Asako I have our file server exporting dirs through nfs but it would be nice to use a native gluster mount
14:34 jiffin1 joined #gluster
14:35 JoeJulian Asako: not yet
14:37 JoeJulian Klas: "posix_acl_ctx_get" would be trying to read the acl context. Probably yes, before the file exists would be my guess.
14:40 Asako nfs-ganesha might work but I'd need to translate the current exports file
14:40 Asako and we have a lot of exports, which means it's a pain
14:47 jwd joined #gluster
14:50 susant joined #gluster
14:54 subscope joined #gluster
14:54 rafi joined #gluster
14:55 farhorizon joined #gluster
14:56 jwd joined #gluster
15:05 ahino1 joined #gluster
15:05 shyam joined #gluster
15:07 krink joined #gluster
15:08 ankitr joined #gluster
15:18 buvanesh_kumar joined #gluster
15:18 oajs joined #gluster
15:36 avati joined #gluster
15:36 * avati is backkk
15:39 snehring joined #gluster
15:44 ahino joined #gluster
15:57 gem joined #gluster
15:59 farhorizon joined #gluster
16:04 ahino joined #gluster
16:06 jwaibel joined #gluster
16:09 mlg9000 joined #gluster
16:10 buvanesh_kumar joined #gluster
16:15 krink joined #gluster
16:17 JoeJulian Avati!!!!
16:17 JoeJulian How's life?
16:20 Shu6h3ndu_ joined #gluster
16:24 Gambit15 joined #gluster
16:26 farhorizon joined #gluster
16:26 ankitr joined #gluster
16:36 jwd joined #gluster
16:50 Saravanakmr joined #gluster
16:53 squizzi joined #gluster
16:58 ctria joined #gluster
16:59 vbellur joined #gluster
16:59 humblec joined #gluster
16:59 vbellur joined #gluster
16:59 krink joined #gluster
17:00 vbellur joined #gluster
17:00 vbellur joined #gluster
17:01 vbellur joined #gluster
17:02 vbellur joined #gluster
17:02 vbellur joined #gluster
17:03 farhorizon joined #gluster
17:03 vbellur joined #gluster
17:03 vbellur joined #gluster
17:06 jwd joined #gluster
17:07 Acinonyx joined #gluster
17:07 anoopcs joined #gluster
17:10 jwd joined #gluster
17:14 jwd joined #gluster
17:15 chawlanikhil24 joined #gluster
17:23 vbellur joined #gluster
17:24 baber joined #gluster
17:30 Saravanakmr joined #gluster
17:34 msvbhat joined #gluster
17:39 ankitr joined #gluster
17:41 sona joined #gluster
18:04 subscope joined #gluster
18:04 R0ok_ joined #gluster
18:10 rafi joined #gluster
18:15 derjohn_mob joined #gluster
18:16 jwd joined #gluster
18:17 nathwill joined #gluster
18:18 msvbhat joined #gluster
18:21 nathwill joined #gluster
18:27 R0ok_ joined #gluster
18:31 prasanth joined #gluster
18:35 baber joined #gluster
18:39 jiffin joined #gluster
18:42 rafi joined #gluster
18:50 rafi joined #gluster
18:51 saduser joined #gluster
18:54 rafi joined #gluster
18:55 ahino joined #gluster
18:56 rafi joined #gluster
19:14 nathwill joined #gluster
19:16 jwd joined #gluster
19:47 alezzandro joined #gluster
19:58 jiffin joined #gluster
20:05 ndevos joined #gluster
20:21 baber joined #gluster
20:22 farhorizon joined #gluster
20:26 jiffin1 joined #gluster
20:35 shyam joined #gluster
20:58 vbellur joined #gluster
20:58 vbellur joined #gluster
20:59 vbellur joined #gluster
21:00 vbellur joined #gluster
21:00 vbellur joined #gluster
21:22 squizzi joined #gluster
21:25 baber joined #gluster
21:31 farhoriz_ joined #gluster
21:54 baber joined #gluster
22:01 farhorizon joined #gluster
22:12 mlg9000 joined #gluster
22:19 absolutejam joined #gluster
22:27 shyam joined #gluster
22:58 farhorizon joined #gluster
23:02 MrAbaddon joined #gluster
23:33 Peppard joined #gluster
23:38 vbellur joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary