Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2016-10-11

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:14 Guest29251 joined #gluster
00:21 kimmeh joined #gluster
00:26 Alghost_ joined #gluster
01:06 shdeng joined #gluster
01:47 ilbot3 joined #gluster
01:47 Topic for #gluster is now Gluster Community - http://gluster.org | Documentation - https://gluster.readthedocs.io/en/latest/ | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
02:15 prth joined #gluster
02:16 harish joined #gluster
02:18 daMaestro joined #gluster
02:22 kimmeh joined #gluster
02:35 shdeng joined #gluster
02:55 Alghost joined #gluster
02:59 Alghost joined #gluster
03:05 Gambit15 joined #gluster
03:05 skoduri joined #gluster
03:49 Alghost joined #gluster
04:04 Alghost joined #gluster
04:23 kimmeh joined #gluster
04:23 gevatter joined #gluster
04:26 eryc joined #gluster
04:26 wistof joined #gluster
04:26 gem joined #gluster
04:28 Alghost_ joined #gluster
04:52 eMBee joined #gluster
04:57 kramdoss_ joined #gluster
05:05 Lee1092 joined #gluster
05:08 jiffin joined #gluster
05:11 jiffin joined #gluster
05:57 derjohn_mob joined #gluster
05:58 mhulsman joined #gluster
06:00 mhulsman joined #gluster
06:01 mhulsman1 joined #gluster
06:13 Alghost joined #gluster
06:17 prth joined #gluster
06:22 jtux joined #gluster
06:23 ahino joined #gluster
06:24 kimmeh joined #gluster
06:25 [diablo] joined #gluster
06:28 mhulsman joined #gluster
06:31 jtux joined #gluster
06:32 mhulsman1 joined #gluster
06:34 msvbhat joined #gluster
06:43 Pupeno joined #gluster
06:46 ahino joined #gluster
06:59 mhulsman joined #gluster
07:00 mhulsman1 joined #gluster
07:06 prth joined #gluster
07:06 jri joined #gluster
07:06 derjohn_mob joined #gluster
07:11 msvbhat joined #gluster
07:28 kxseven joined #gluster
07:32 kshlm joined #gluster
07:34 fsimonce joined #gluster
07:51 kimmeh joined #gluster
08:02 ivan_rossi joined #gluster
08:04 hackman joined #gluster
08:08 cholcombe joined #gluster
08:11 derjohn_mob joined #gluster
08:11 ron-slc joined #gluster
08:15 jbrooks joined #gluster
08:18 Slashman joined #gluster
08:18 harish joined #gluster
08:19 muneerse joined #gluster
08:31 natarej joined #gluster
08:36 delhage_ joined #gluster
08:39 riyas joined #gluster
08:40 arif-ali_ joined #gluster
08:41 Marbug joined #gluster
08:42 lkoranda joined #gluster
08:44 shdeng joined #gluster
08:49 hackman joined #gluster
08:49 kimmeh joined #gluster
08:49 Lee1092 joined #gluster
08:49 gevatter joined #gluster
08:49 snehring joined #gluster
08:49 overclk joined #gluster
08:49 AppStore joined #gluster
08:49 telius joined #gluster
08:49 Ulrar joined #gluster
08:49 al joined #gluster
08:49 sankarshan_away joined #gluster
08:49 pasik joined #gluster
08:50 prth joined #gluster
08:51 yawkat joined #gluster
08:51 BitByteNybble110 joined #gluster
08:53 primusinterpares joined #gluster
08:53 flying joined #gluster
08:57 scubacuda_ joined #gluster
08:58 AppStore joined #gluster
09:00 mhulsman joined #gluster
09:12 mhulsman joined #gluster
09:14 msvbhat joined #gluster
09:16 Dasiel joined #gluster
09:19 f0rpaxe joined #gluster
09:45 Marbug I have glusterfs installed on a new node, (3.7.14) all the other nodes have 3.7.11, the node is connected and it has a brick, but NFS and self-healing doesn't work :/
09:45 Marbug the setup of that server is almost the same as the other ones, so I don't know what could still be something playing a role here :/
09:51 derjohn_mob joined #gluster
10:01 mhulsman1 joined #gluster
10:05 mhulsman joined #gluster
10:06 klaas joined #gluster
10:16 mattmcc_ joined #gluster
10:31 mhulsman1 joined #gluster
10:35 mhulsman joined #gluster
10:40 kimmeh joined #gluster
10:50 arif-ali joined #gluster
10:55 bfoster joined #gluster
10:56 derjohn_mob joined #gluster
11:02 mhulsman1 joined #gluster
11:03 mhulsman joined #gluster
11:03 muneerse2 joined #gluster
11:23 kkeithley Bug Triage in ~40 minutes in #gluster-meeting
11:28 muneerse joined #gluster
11:41 johnmilton joined #gluster
11:56 kkeithley joined #gluster
11:57 kkeithley Bug Triage in 5 minutes in #gluster-meeting
11:58 unclemarc joined #gluster
12:02 mhulsman1 joined #gluster
12:03 bfoster joined #gluster
12:04 mhulsman joined #gluster
12:14 ira_ joined #gluster
12:16 robb_nl joined #gluster
12:33 mhulsman1 joined #gluster
12:34 mhulsman joined #gluster
12:41 msvbhat joined #gluster
12:41 bfoster joined #gluster
12:46 bfoster joined #gluster
12:53 Sebbo2 joined #gluster
12:54 Sebbo2 Hey, is that a problem from my side or the server of PPA? W: GPG error: http://ppa.launchpad.net/gl​uster/glusterfs-3.8/ubuntu xenial InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 13E01B7B3FE869A9
12:54 glusterbot Title: Index of /gluster/glusterfs-3.8/ubuntu (at ppa.launchpad.net)
12:55 shyam joined #gluster
13:05 msvbhat joined #gluster
13:07 adminxor joined #gluster
13:12 ebbex joined #gluster
13:28 ju5t joined #gluster
13:33 mhulsman1 joined #gluster
13:35 mhulsman joined #gluster
13:40 skylar joined #gluster
13:45 alvinstarr I am having some geo-replication problems.  I can get a small volume to replicate but when I try with a larger volume with lots of small files it looks like it transfers 8191 files and then stops. I have tried the replication log files but have not seen anything that makes the light go on.  Any suggestions of where to start looking?
13:59 k4n0 joined #gluster
14:01 edong23 joined #gluster
14:10 bwerthmann joined #gluster
14:21 Slashman hello, is it a problem to use a newer gluster client with older gluster node? (3.7.x client with 3.6.x nodes)
14:24 JoeJulian A client is also a node so that question is unclear. The word "node" means any endpoint.
14:25 JoeJulian You should upgrade servers before you upgrade clients.
14:25 hagarth joined #gluster
14:29 abyss^_ ooo JoeJulian ;)
14:30 abyss^_ I have a question about your tool.
14:30 JoeJulian I might even have an answer to match it.
14:31 abyss^_ sorry I'm looking ;) I asked a few day about it ;)
14:31 abyss^_ https://joejulian.name/blog/gluster​fs-split-brain-recovery-made-easy/ - this is still valid tool?
14:31 glusterbot Title: GlusterFS Split-Brain Recovery Made Easy (at joejulian.name)
14:31 JoeJulian It should still work, but as of 3.7 it's unnecessary. There are split-brain tools built-in.
14:32 abyss^_ I have a lot of split-brain unfortunately all of them have issue with directories, so I need to repair them manualy
14:32 abyss^_ JoeJulian: yes, but that tool works only for files :(
14:33 abyss^_ I'd like to use your tool, and delete all folders from replica;)
14:33 JoeJulian A few days back I was in Berlin at the gluster developer summit (and vacationing there as well).
14:33 JoeJulian Nah, just delete the trusted.afr attributes from the directories. It's easier.
14:34 abyss^_ could you explain this a little more?
14:34 abyss^_ after when I use your tool or I can do that without your tool?;)
14:34 JoeJulian This would be directly on the bricks.
14:35 JoeJulian Pick a directory that's split-brain and examine it's ,,(extended attributes) on all the servers.
14:35 glusterbot (#1) To read the extended attributes on the server: getfattr -m .  -d -e hex {filename}, or (#2) For more information on how GlusterFS uses extended attributes, see this article: http://pl.atyp.us/hekafs.org/index.php/​2011/04/glusterfs-extended-attributes/
14:35 abyss^_ oooh, so you mean I should go on replica server found all directories that I'd like to heal and then delete that attribute?
14:36 JoeJulian You'll find trusted.afr.* attributes that will be non-zero for some other brick and on that other brick, non-zero attributes for the 1st brick. Either reset one to zero or just delete the attribute.
14:39 abyss^_ JoeJulian: sorry my english is not good... I'm trying to understand;)
14:39 abyss^_ I have 7k directories in split brain
14:39 ebbex joined #gluster
14:39 abyss^_ I'd like to do in as much automated way as I can
14:39 abyss^_ *it
14:42 abyss^_ I don't get it;) I have 4 servers. 1 is replica 2 and 3 is replica 4... Now I should go to replica 2, find each files from list and reset trusted.afr.* atrributes to 0?
14:52 abyss^_ JoeJulian: Uhmm, probably I get it;) I've had to read this 10 times;) I have to compare brick and it's replica find which trusted.afr attribute is different and then set it to zero for one brick?
14:53 JoeJulian abyss^_: I usually just brute-force it. I write a python script that reads xattrs and deletes any that start with trusted.afr.
14:53 JoeJulian If a directory really is split-brain, I seldom care.
14:56 hagarth abyss^_: can you check if the metadata of the directories differ on the replicated bricks?
14:57 JoeJulian That's why I brute-force it. I've never seen them differ.
14:58 abyss^_ JoeJulian: sorry but now I don't understand at all;) Each directory has trsted.afr attribute;) You just delete all directories in split-brain on replica server? What about .glusterfs folder and it's links then?
14:58 JoeJulian No, I only delete the attribute.
14:58 JoeJulian setfattr -x
14:58 hagarth abyss^_: are the gfids on the directories the same everywhere?
14:58 Lee1092 joined #gluster
15:02 wushudoin joined #gluster
15:03 abyss^_ I've checked for the first dir and metadata are different
15:05 abyss^_ hagarth: yes, I've checked for the first directory and have the same gfid
15:06 abyss^_ JoeJulian: so I can setfattr -x for each file listed by glusterfs command (split-brain info) and then glusterfs will recover and set appriopriate attribute for that dirs?
15:07 dgandhi joined #gluster
15:11 dgandhi joined #gluster
15:13 shyam joined #gluster
15:19 dgandhi joined #gluster
15:19 farhorizon joined #gluster
15:19 kpease joined #gluster
15:23 JoeJulian abyss^_: if the gfids differ, then you actually have split-brain and it's not the more common "everything's the same but they're still marked as split".
15:23 JoeJulian Fixing this is complex.
15:25 JoeJulian If I was going to fix this, I would probably choose one to be "healthy", crawl the directory tree collecting gfids, then use a script to replace the gfids on any directories that differ (using that same script to remove the broken symlink under the .glusterfs tree).
15:25 JoeJulian Unless, of course, hagarth has a simpler way.
15:30 kxseven joined #gluster
15:38 shyam joined #gluster
16:02 omasek joined #gluster
16:04 ju5t joined #gluster
16:11 BitByteNybble110 joined #gluster
16:18 raghu` joined #gluster
16:21 ron-slc joined #gluster
16:24 semiosis joined #gluster
16:24 semiosis joined #gluster
16:30 Gambit15 joined #gluster
16:32 MidlandTroy joined #gluster
16:39 bwerthma1n joined #gluster
16:41 ivan_rossi left #gluster
16:42 Pupeno joined #gluster
16:50 shaunm joined #gluster
16:56 omasek joined #gluster
17:03 plarsen joined #gluster
17:11 jri joined #gluster
17:15 ashp left #gluster
17:16 JoeJulian Storage Day Seattle - October 18th - http://bit.ly/2dtKYhy
17:16 glusterbot Title: Red Hat Technical Event Series (at bit.ly)
17:18 derjohn_mob joined #gluster
17:20 kimmeh joined #gluster
17:29 kpease joined #gluster
17:47 farhorizon joined #gluster
17:50 farhorizon joined #gluster
17:53 akanksha_ joined #gluster
18:33 jbrooks joined #gluster
18:44 msvbhat joined #gluster
18:45 cliluw joined #gluster
18:46 cliluw joined #gluster
18:49 farhoriz_ joined #gluster
18:53 robb_nl joined #gluster
19:21 kpease joined #gluster
19:21 hackman joined #gluster
19:23 newdave joined #gluster
19:24 Philambdo joined #gluster
19:28 omasek joined #gluster
19:28 PaulCuzner joined #gluster
19:40 johnmilton joined #gluster
19:45 johnmilton joined #gluster
19:57 abyss^_ JoeJulian: that why I thought using your tool to mount each replica and then delete all directory from one of them and then run heal on gluster sounds easier...
19:58 abyss^_ *your tool
20:00 abyss^_ *all directories in split brain
20:00 farhorizon joined #gluster
20:08 Philambdo joined #gluster
20:20 kpease joined #gluster
20:22 kimmeh joined #gluster
20:30 arc0 joined #gluster
20:46 JoeJulian abyss^_: You might as well just wipe the brick then and start over. I'm just trying to save you heal time.
20:51 kpease joined #gluster
21:30 plarsen joined #gluster
21:33 tdasilva joined #gluster
22:02 hagarth joined #gluster
22:23 kimmeh joined #gluster
22:34 jeremyh joined #gluster
23:26 ic0n_ joined #gluster
23:55 gevatter joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary