Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2017-01-23

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 cacasmacas joined #gluster
00:06 victori joined #gluster
00:07 alvinstarr joined #gluster
00:24 alvinstarr joined #gluster
00:40 haomaiwang joined #gluster
01:06 nh2_ joined #gluster
01:10 victori joined #gluster
01:13 Wizek joined #gluster
01:14 ankit joined #gluster
01:16 alvinstarr joined #gluster
01:24 Caveat4U joined #gluster
01:39 vbellur joined #gluster
01:39 victori joined #gluster
01:43 alvinstarr joined #gluster
01:54 nthomas_ joined #gluster
02:02 victori joined #gluster
02:05 Gambit15 joined #gluster
02:19 aj__ joined #gluster
02:27 haomaiwang joined #gluster
02:29 gluytium joined #gluster
02:30 BlackoutWNCT joined #gluster
02:46 victori joined #gluster
02:48 ilbot3 joined #gluster
02:48 Topic for #gluster is now Gluster Community - http://gluster.org | Documentation - https://gluster.readthedocs.io/en/latest/ | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
02:58 cacasmacas joined #gluster
03:04 DK2 joined #gluster
03:04 victori joined #gluster
03:04 Gambit15 joined #gluster
03:13 haomaiwang joined #gluster
03:19 Lee1092 joined #gluster
03:26 Caveat4U joined #gluster
03:36 yosafbridge joined #gluster
03:36 devyani7 joined #gluster
03:50 farhorizon joined #gluster
03:56 atinm joined #gluster
04:00 gluytium joined #gluster
04:03 Shu6h3ndu joined #gluster
04:05 Shu6h3ndu joined #gluster
04:07 victori joined #gluster
04:09 itisravi joined #gluster
04:11 gyadav_ joined #gluster
04:13 haomaiwang joined #gluster
04:14 jiffin joined #gluster
04:23 nirokato joined #gluster
04:28 nbalacha joined #gluster
04:31 sbulage joined #gluster
04:32 buvanesh_kumar joined #gluster
04:34 nirokato joined #gluster
04:34 gluytium joined #gluster
04:34 Karan joined #gluster
04:38 gyadav_ joined #gluster
04:44 kdhananjay joined #gluster
04:45 nirokato joined #gluster
04:51 mb_ joined #gluster
04:51 susant1 joined #gluster
04:52 Prasad joined #gluster
04:54 jiffin joined #gluster
05:00 RameshN joined #gluster
05:00 ankit_ joined #gluster
05:02 jiffin joined #gluster
05:06 nirokato joined #gluster
05:06 skumar joined #gluster
05:09 gyadav__ joined #gluster
05:11 Humble joined #gluster
05:13 haomaiwang joined #gluster
05:18 ndarshan joined #gluster
05:26 skoduri joined #gluster
05:28 gyadav_ joined #gluster
05:29 Caveat4U joined #gluster
05:31 nirokato joined #gluster
05:36 hgowtham joined #gluster
05:40 victori joined #gluster
05:42 ppai joined #gluster
05:46 k4n0 joined #gluster
05:47 hgowtham joined #gluster
05:48 prasanth joined #gluster
05:48 apandey joined #gluster
06:04 riyas joined #gluster
06:07 sona joined #gluster
06:08 rafi joined #gluster
06:10 victori joined #gluster
06:12 TFJensen joined #gluster
06:13 haomaiwang joined #gluster
06:13 kdhananjay joined #gluster
06:14 skumar_ joined #gluster
06:17 rafi joined #gluster
06:24 skoduri joined #gluster
06:27 riyas joined #gluster
06:29 sbulage joined #gluster
06:31 skumar__ joined #gluster
06:33 bwerthmann joined #gluster
06:34 jiffin joined #gluster
06:36 jiffin joined #gluster
06:50 bbooth joined #gluster
06:50 Saravanakmr joined #gluster
06:51 Caveat4U joined #gluster
06:53 sanoj joined #gluster
06:54 TBlaar joined #gluster
06:57 apandey joined #gluster
07:08 mhulsman joined #gluster
07:13 haomaiwang joined #gluster
07:16 jkroon joined #gluster
07:16 sanoj joined #gluster
07:17 Debloper joined #gluster
07:24 social joined #gluster
07:27 ashiq joined #gluster
07:27 devyani7 joined #gluster
07:31 unlaudable joined #gluster
07:31 skoduri joined #gluster
07:34 jtux joined #gluster
07:44 ivan_rossi joined #gluster
07:45 [diablo] joined #gluster
07:58 MikeLupe joined #gluster
08:00 DV__ joined #gluster
08:03 Philambdo joined #gluster
08:06 sona joined #gluster
08:11 jtux joined #gluster
08:13 haomaiwang joined #gluster
08:15 mb_ joined #gluster
08:23 BlackoutWNCT joined #gluster
08:25 jamese_ joined #gluster
08:27 jamese_ hi, got a 4 node gluster cluster (running 3.8) with 4 volumes (distributed-replicate 4x2) and am having issues with files not healing - anyone able to assist?
08:34 jri joined #gluster
08:38 BuBU29 left #gluster
08:40 fsimonce joined #gluster
08:41 susant1 left #gluster
08:44 BuBU29 joined #gluster
08:51 flying joined #gluster
08:52 Caveat4U joined #gluster
08:53 BlackoutWNCT1 joined #gluster
08:58 mbukatov joined #gluster
09:00 bbooth joined #gluster
09:05 musa22 joined #gluster
09:05 susant joined #gluster
09:06 Humble joined #gluster
09:06 gyadav__ joined #gluster
09:07 sona joined #gluster
09:10 musa22 joined #gluster
09:13 haomaiwang joined #gluster
09:14 k4n0 joined #gluster
09:16 pulli joined #gluster
09:16 alezzandro joined #gluster
09:18 aj__ joined #gluster
09:23 susant joined #gluster
09:23 musa22_ joined #gluster
09:23 gyadav_ joined #gluster
09:24 Debloper joined #gluster
09:25 DV__ joined #gluster
09:28 skumar__ joined #gluster
09:30 victori joined #gluster
09:32 Seth_Karlo joined #gluster
09:35 suliba joined #gluster
09:37 sbulage joined #gluster
09:37 rafi1 joined #gluster
09:38 DV__ joined #gluster
09:38 BitByteNybble110 joined #gluster
09:39 apandey joined #gluster
09:41 mb_ joined #gluster
09:42 Seth_Karlo joined #gluster
09:43 Humble joined #gluster
09:46 rastar joined #gluster
09:48 musa22 joined #gluster
09:52 Slashman joined #gluster
10:04 Seth_Karlo joined #gluster
10:06 skoduri joined #gluster
10:11 rastar joined #gluster
10:13 haomaiwang joined #gluster
10:14 mb_ joined #gluster
10:15 flying joined #gluster
10:16 ahino joined #gluster
10:16 Shu6h3ndu joined #gluster
10:24 gem joined #gluster
10:28 bbooth joined #gluster
10:31 TFJensen joined #gluster
10:32 DV__ joined #gluster
10:35 ashiq joined #gluster
10:44 rafi joined #gluster
10:50 bbooth joined #gluster
10:51 TFJensen Can anyone help me fix a broken brick on gluster setup.?
10:51 k4n0 joined #gluster
10:54 Caveat4U joined #gluster
10:56 Seth_Kar_ joined #gluster
11:01 victori joined #gluster
11:06 skoduri joined #gluster
11:10 ndevos RameshN: care to join #gluster-dev?
11:10 RameshN ndevos, hi
11:11 RameshN ndevos, done
11:11 suliba joined #gluster
11:11 puiterwijk joined #gluster
11:11 ndevos TFJensen: if you explain how you're using it, how it is supposed to work and how it got broken, maybe someone can help you out
11:20 atinm joined #gluster
11:25 ndarshan joined #gluster
11:26 TFJensen my data brick on host5 is not avalible
11:26 TFJensen under TCP there is no port for host5
11:29 TFJensen I did a "gluster volume start data force"
11:33 alezzandro joined #gluster
11:38 Wizek joined #gluster
11:38 TFJensen it is connected now, but I have a lot of unsync entries.
11:42 TFJensen Cant start the VMs on the data storage "VM has been paused due to a Storage I/O error"
11:56 foster joined #gluster
12:06 kdhananjay joined #gluster
12:07 cloph TFJensen: if you're out of quorum, the volume goes into read-only and VMs don't like that...
12:10 TFJensen I have all 3 nodes online , but still have 234 unsynced entries and cant start vms
12:11 ankit__ joined #gluster
12:14 DV__ joined #gluster
12:14 ashiq joined #gluster
12:22 Humble joined #gluster
12:31 Caveat4U joined #gluster
12:34 nishanth joined #gluster
12:37 kettlewell joined #gluster
12:38 rastar joined #gluster
12:44 TFJensen Nothing seens to syncronize at the moment. How do I fix that
12:50 haomaiwang joined #gluster
12:54 jiffin joined #gluster
12:57 skoduri joined #gluster
12:59 susant left #gluster
13:03 B21956 joined #gluster
13:08 mhulsman joined #gluster
13:10 Karan joined #gluster
13:12 ndevos TFJensen: you should check if there is a problem with self-heal, there is glustershd.log iirc, that might have some pointers
13:12 bbooth joined #gluster
13:13 rwheeler joined #gluster
13:13 haomaiwang joined #gluster
13:16 atinm joined #gluster
13:18 farhorizon joined #gluster
13:22 fulcrum joined #gluster
13:25 TFJensen here is the output from:
13:25 TFJensen "gluster volume heal data info
13:25 TFJensen Brick gluster03:/gluster/brick2/data
13:25 TFJensen <gfid:405da64c-748c-43fa-bbf5-2995d192b9d2>
13:25 TFJensen Status: Connected
13:25 TFJensen Number of entries: 1
13:25 TFJensen Brick gluster04:/gluster/brick2/data
13:25 TFJensen <gfid:405da64c-748c-43fa-bbf5-2995d192b9d2>
13:25 TFJensen Status: Connected
13:25 TFJensen Number of entries: 1
13:25 TFJensen Brick gluster05:/gluster/brick2/data
13:25 TFJensen <gfid:405da64c-748c-43fa-bbf5-2995d192b9d2>
13:25 TFJensen Status: Connected
13:25 TFJensen Number of entries: 1"
13:25 unclemarc joined #gluster
13:25 musa22 joined #gluster
13:36 bbooth joined #gluster
13:37 derjohn_mob joined #gluster
13:45 nh2_ joined #gluster
13:51 farhorizon joined #gluster
14:02 KlausBrbl left #gluster
14:03 TFJensen When I start a vm it goes paused "VM has been paused due to a storage error"
14:03 rwheeler joined #gluster
14:07 TFJensen after startup of a vm that went paused I get more entries in "gluster volume heal data info
14:07 TFJensen Brick gluster03:/gluster/brick2/data
14:07 TFJensen <gfid:405da64c-748c-43fa-bbf5-2995d192b9d2>
14:07 TFJensen Status: Connected
14:07 TFJensen Number of entries: 3
14:07 TFJensen Brick gluster04:/gluster/brick2/data
14:07 TFJensen Status: Connected
14:07 TFJensen Number of entries: 3
14:07 TFJensen Brick gluster05:/gluster/brick2/data
14:07 TFJensen <gfid:405da64c-748c-43fa-bbf5-2995d192b9d2>
14:07 TFJensen Status: Connected
14:07 TFJensen Number of entries: 3"
14:13 haomaiwang joined #gluster
14:14 shyam joined #gluster
14:18 ndevos TFJensen: how have you configured the VM to use the storage? You should have some details about the failing access in its log
14:19 ndevos TFJensen: if you use qemu/gfapi through libvirt, the log with the error is probably under /var/logs/libvirt... or similar, each VM has its own log there
14:19 ndevos TFJensen: in case you mount over FUSE, the log would be in /var/log/gluster/<path-to-mount-point>.log
14:19 susant joined #gluster
14:23 shyam joined #gluster
14:27 nbalacha joined #gluster
14:31 skylar joined #gluster
14:32 kpease_ joined #gluster
14:33 Caveat4U joined #gluster
14:34 TFJensen Each time I start a vm I get more unsynced files. I just looks like the data volume is not replicating
14:38 susant left #gluster
14:39 ira joined #gluster
14:39 james333 joined #gluster
14:42 TFJensen If i create a file from the host os it gets replicated to each brick, no additional unsynced files. But when starting a vm from ovirt i get the error "VM has been paused due to a storage error"
14:43 B21956 joined #gluster
14:45 squizzi joined #gluster
14:47 kpease_ joined #gluster
14:47 TFJensen joined #gluster
14:50 shyam joined #gluster
14:53 kpease joined #gluster
14:58 MidlandTroy joined #gluster
14:59 james333 Hi, question with ref to a dist-replicated cluster that isn't healing certain files.  If i step through and look at the attributes on a random file that isn't healing from gluster volume heal storage01 info) - I see one copy of the file has the trusted.afr.<client> attributes as expected, but the other one doesn't.  I can't see anything pointing towards a reason for non-healing, and neither does a heal
14:59 james333 / full heal / rebalance fix the issues.  Given the second copy of the file doesn't have the expected attributes i'm unable to follow the recover from split-brain document... any tips? :)
15:00 vbellur joined #gluster
15:01 ndevos TFJensen: you should be able to find the log for the VM or storage somewhere on the ovirt host, it will help to get the exact error from there
15:02 farhorizon joined #gluster
15:02 ndevos james333: if it is replicated, follow the split-brain instructions to remove the unsyn'd copy, and do a ,,(targeted selfheal) after that
15:02 glusterbot james333: I do not know about 'targeted selfheal', but I do know about these similar topics: 'targeted self heal'
15:03 ndevos ~targeted self heal | james333
15:03 glusterbot james333: https://web.archive.org/web/20130314122636/http://community.gluster.org/a/howto-targeted-self-heal-repairing-less-than-the-whole-volume/
15:04 misc mhhh, that's bad if we give doc to archive.org :/
15:09 ankit__ joined #gluster
15:11 james333 ndevos: Thank you.. having a read now
15:12 bbooth joined #gluster
15:13 ndevos misc: yes, but I dont know where the FAQ site went
15:13 haomaiwang joined #gluster
15:18 Shu6h3ndu joined #gluster
15:19 jiffin joined #gluster
15:20 Gambit15 joined #gluster
15:21 james333 Ok.  Have given the targetted self-heal a whizz, unfortunately it doesn't resolve the issue because from the mount point POV, we're getting a input/output error on the file access (and thus stat)
15:21 james333 Also see a LOOKUP() - Input/output error in the fuse logs for the local mount
15:23 james333 even tho, i can cat the file fine on the direct brick path... if that makes sense :)
15:25 jdossey joined #gluster
15:27 bbooth joined #gluster
15:28 ivan_rossi left #gluster
15:29 ahino joined #gluster
15:32 Slashman joined #gluster
15:33 shaunm joined #gluster
15:33 shyam joined #gluster
15:39 mb_ joined #gluster
15:42 alezzandro joined #gluster
15:43 farhoriz_ joined #gluster
15:45 icey joined #gluster
15:45 icey joined #gluster
15:47 [diablo] joined #gluster
15:49 skoduri joined #gluster
15:53 bowhunter joined #gluster
16:00 ankit__ joined #gluster
16:02 wushudoin joined #gluster
16:03 wushudoin joined #gluster
16:05 Caveat4U joined #gluster
16:13 haomaiwang joined #gluster
16:38 arpu joined #gluster
16:47 victori joined #gluster
16:47 bbooth joined #gluster
16:49 ksandha_ joined #gluster
16:52 jiffin joined #gluster
16:58 victori joined #gluster
16:58 Caveat4U joined #gluster
16:59 farhorizon joined #gluster
17:04 Caveat4U joined #gluster
17:05 ndarshan joined #gluster
17:12 victori joined #gluster
17:13 haomaiwang joined #gluster
17:18 jiffin joined #gluster
17:22 blue joined #gluster
17:24 riyas joined #gluster
17:25 blue I'm trying to re-add a failed node to a 3 node gluster setup but starting the heal just does nothing it seems. On version 3.8.4. How can I debug this best? I followed the guide here to add the failed server back: https://support.rackspace.com/how-to/recover-from-a-failed-server-in-a-glusterfs-array/#keep-the-ip-address
17:25 glusterbot Title: Recover from a failed server in a GlusterFS array (at support.rackspace.com)
17:43 jiffin joined #gluster
17:44 bbooth joined #gluster
17:48 ankit__ joined #gluster
17:55 DoubleJ joined #gluster
17:58 loadtheacc joined #gluster
18:00 atinm joined #gluster
18:02 james333 joined #gluster
18:13 haomaiwang joined #gluster
18:14 mhulsman joined #gluster
18:41 Seth_Karlo joined #gluster
18:42 Seth_Karlo joined #gluster
18:45 jri joined #gluster
18:52 jri joined #gluster
18:53 Wojtek944 joined #gluster
18:54 Wojtek944 In what instance would increasing the inode-lru-limit value be beneficial?
18:55 jri joined #gluster
18:58 farhorizon joined #gluster
19:06 arpu joined #gluster
19:08 jdossey joined #gluster
19:08 Vapez joined #gluster
19:09 Vapez I am doing something wrong or GlusterFS can't mount the same volume on 2 servers !?
19:09 Vapez_ joined #gluster
19:10 Vapez joined #gluster
19:11 side_control joined #gluster
19:11 mlhess joined #gluster
19:11 jbrooks joined #gluster
19:11 JoeJulian Vapez_: Yes it can (wouldn't be much use if it couldn't).
19:11 Vapez I am doing something wrong or GlusterFS can't mount the same volume on 2 servers !?
19:11 JoeJulian Vapez_: Yes it can (wouldn't be much use if it couldn't).
19:12 Vapez JoeJulian: 0-glusterfsd-mgmt: Exhausted all volfile servers
19:12 Vapez i have this error
19:13 haomaiwang joined #gluster
19:13 JoeJulian Sounds like that client cannot connect to the server listed on the mount command.
19:13 JoeJulian Check firewall(s).
19:14 JoeJulian Sorry I can't stick around and help more, but I've got to commute in to the office. Be around in ~1 hour.
19:15 jbrooks joined #gluster
19:17 social joined #gluster
19:29 kpease joined #gluster
19:30 kpease_ joined #gluster
19:45 derjohn_mob joined #gluster
19:56 timotheus1_ joined #gluster
20:02 jdossey joined #gluster
20:12 kpease joined #gluster
20:13 haomaiwang joined #gluster
20:13 valkyr3e joined #gluster
20:16 kpease joined #gluster
20:17 Vapez I can't start gluster anymore..
20:21 bbooth joined #gluster
20:22 Vapez http://termbin.com/ezwr
20:22 Vapez logs
20:25 Seth_Kar_ joined #gluster
20:27 kpease_ joined #gluster
20:29 Vapez JoeJulian: you get back?
20:32 JoeJulian Vapez: Looks like you have a name resolution problem: [2017-01-23 20:20:02.296497] E [MSGID: 106187] [glusterd-store.c:4405:glusterd_resolve_all_bricks] 0-glusterd: resolve brick failed in restore
20:32 Vapez Ok
20:33 Vapez How i fix it?
20:33 JoeJulian Make sure each of your hostnames used to create your volumes can be resolved.
20:35 JoeJulian Problems could be missing /etc/hosts entries, missing search parameter in resolv.conf or systemd-networkd configuration, systemd-resolved or /etc/resolv.conf issues...
20:37 Vapez Where i found the gluster volume configuration file for volume that i made ?
20:38 JoeJulian /var/lib/glusterd/vols/$volume_name/info
20:48 Vapez JoeJulian: thank you
20:48 Vapez i delete and maked a new one
20:48 Vapez but now it doesn't share the file in folders :|
20:50 Vapez I mean if I mount it in mount.glusterfs  gluster1:/main /home/test/public_html
20:50 Vapez user home partition
20:50 Vapez it doesn't get the files from brick
20:50 Vapez it need some extra permissions?
20:51 JoeJulian ~ pasteinfo | Vapez
20:51 glusterbot Vapez: Please paste the output of "gluster volume info" to http://fpaste.org or http://dpaste.org then paste the link that's generated here.
20:52 farhoriz_ joined #gluster
20:54 farhoriz_ joined #gluster
20:54 Vapez JoeJulian: https://paste.fedoraproject.org/535252/85204891/
20:54 glusterbot Title: #535252 • Fedora Project Pastebin (at paste.fedoraproject.org)
20:59 squizzi joined #gluster
20:59 jdossey joined #gluster
21:10 PatNarciso joined #gluster
21:10 PatNarciso Just curious - is Dan Mons (of Cutting Edge) in the room?
21:11 Vapez it's working now
21:12 Seth_Karlo joined #gluster
21:13 Seth_Karlo joined #gluster
21:13 haomaiwang joined #gluster
21:15 Seth_Kar_ joined #gluster
21:16 Seth_Karlo joined #gluster
21:17 Seth_Kar_ joined #gluster
21:25 ashiq joined #gluster
21:32 shyam joined #gluster
21:33 jdossey joined #gluster
21:45 johnthesecond joined #gluster
21:45 johnthesecond hello all
21:53 cholcombe what's this /etc/ssl/dhparam.pem file?  I don't see any info in the docs about it and my ssl setup fails to mount
21:56 cholcombe ah ok that's the diffie hellman file
21:57 bbooth joined #gluster
22:00 johnthesecond gluster 3.8.8 on centos7 - trying to mount gluster volume at boot, does not work (it gives invalid option in the logs) but after login I can do mount -a and all my volumes mount no problem - any ideas?
22:02 johnthesecond I think it has something to do with systemd, but I have no idea where to start looking
22:13 haomaiwang joined #gluster
22:32 bbooth joined #gluster
22:57 kettlewe_ joined #gluster
22:59 bbooth joined #gluster
23:00 Wojtek joined #gluster
23:10 jdossey joined #gluster
23:13 haomaiwang joined #gluster
23:20 bbooth joined #gluster
23:34 Peppard joined #gluster
23:44 bbooth joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary