Time |
Nick |
Message |
00:15 |
|
dlambrig joined #gluster |
01:28 |
|
plarsen joined #gluster |
01:28 |
|
nbalacha joined #gluster |
01:33 |
|
Lee1092 joined #gluster |
01:36 |
|
billputer joined #gluster |
01:39 |
|
lcurtis joined #gluster |
01:45 |
|
swebb joined #gluster |
01:54 |
|
dlambrig joined #gluster |
02:00 |
|
cyberbootje joined #gluster |
02:01 |
|
sage joined #gluster |
03:22 |
|
corretico joined #gluster |
03:33 |
|
haomaiwa_ joined #gluster |
03:38 |
|
stickyboy joined #gluster |
03:40 |
|
TheSeven joined #gluster |
03:48 |
|
nbalacha joined #gluster |
04:01 |
|
haomaiwa_ joined #gluster |
04:44 |
|
haomaiwa_ joined #gluster |
05:01 |
|
haomaiwa_ joined #gluster |
05:08 |
|
moogyver joined #gluster |
05:25 |
|
GB21 joined #gluster |
05:29 |
|
RedW joined #gluster |
05:29 |
|
Peppard joined #gluster |
06:01 |
|
haomaiwa_ joined #gluster |
06:02 |
|
necrogami joined #gluster |
06:02 |
|
sakshi joined #gluster |
06:05 |
|
nbalacha joined #gluster |
06:37 |
|
LebedevRI joined #gluster |
06:59 |
|
kovshenin joined #gluster |
07:01 |
|
haomaiwang joined #gluster |
07:02 |
|
haomaiwang joined #gluster |
07:42 |
|
muneerse joined #gluster |
07:56 |
|
jamesc joined #gluster |
08:01 |
|
haomaiwa_ joined #gluster |
08:51 |
|
DV joined #gluster |
09:01 |
|
haomaiwa_ joined #gluster |
09:12 |
|
rafi joined #gluster |
09:20 |
|
haomaiwang joined #gluster |
09:40 |
|
stickyboy joined #gluster |
10:01 |
|
haomaiwa_ joined #gluster |
10:37 |
|
haomaiwang joined #gluster |
11:01 |
|
haomaiwa_ joined #gluster |
11:13 |
|
mhulsman joined #gluster |
11:16 |
|
DV joined #gluster |
11:54 |
|
LebedevRI joined #gluster |
11:57 |
|
Pupeno joined #gluster |
12:07 |
|
bluenemo joined #gluster |
12:36 |
|
Mr_Psmith joined #gluster |
12:38 |
|
arcolife joined #gluster |
12:53 |
|
haomaiwang joined #gluster |
13:01 |
|
haomaiwang joined #gluster |
13:12 |
|
mufa joined #gluster |
13:18 |
|
DV joined #gluster |
13:23 |
|
mufa left #gluster |
13:23 |
|
mufa joined #gluster |
13:29 |
|
EinstCrazy joined #gluster |
13:35 |
|
mufa joined #gluster |
13:37 |
|
wnlx joined #gluster |
13:42 |
|
kovshenin joined #gluster |
14:01 |
|
haomaiwa_ joined #gluster |
14:02 |
|
arcolife joined #gluster |
14:05 |
|
livelace joined #gluster |
14:06 |
|
chirino_m joined #gluster |
14:07 |
livelace |
Hello. 3-way replicated volume. Enabled BitRot. lazy/normal/agressive methods was enabled, but, if we create simple file through FUSE client on server1, and modify the same file on server 3 through direct FS operation - BitRot doesn't find this changes on scrub. Why ? |
14:09 |
|
lcurtis joined #gluster |
14:32 |
|
plarsen joined #gluster |
14:36 |
ndevos |
livelace: I'm just guessing, but maybe bitrot triggers a heal of the file first? |
14:37 |
ndevos |
livelace: the bitrot develepers are not online now, they should be able to answer your question when you send it on the mailinglist |
14:40 |
|
harish_ joined #gluster |
14:52 |
|
shyam joined #gluster |
14:59 |
|
haomaiwa_ joined #gluster |
15:01 |
|
haomaiwa_ joined #gluster |
15:29 |
|
jbrooks joined #gluster |
15:33 |
|
chirino joined #gluster |
15:39 |
|
stickyboy joined #gluster |
15:56 |
hagarth |
livelace: are you looking at scrub logs on server 3 to check if the scrubber reports it? |
15:57 |
|
wushudoin joined #gluster |
15:57 |
hagarth |
ndevos: automatic healing is not yet available with bitrot. It is currently WIP. |
15:57 |
|
wushudoin joined #gluster |
16:01 |
|
haomaiwa_ joined #gluster |
16:05 |
ndevos |
hagarth: ah, thanks, good to know :) |
16:06 |
|
shaunm joined #gluster |
16:08 |
livelace |
hagarth, Of course, nothing suspicious |
16:09 |
livelace |
Start and rescheduling scrub |
16:10 |
livelace |
[root glusterfs3 ~]# gluster volume heal ovirt-data info |
16:10 |
livelace |
Brick glusterfs1.livelace.ru:/export/vdb1/ovirt-data/ |
16:10 |
livelace |
Number of entries: 0 |
16:10 |
livelace |
Brick glusterfs2.livelace.ru:/export/vdb1/ovirt-data/ |
16:10 |
livelace |
Number of entries: 0 |
16:10 |
livelace |
Brick glusterfs3.livelace.ru:/export/vdb1/ovirt-data/ |
16:10 |
livelace |
Number of entries: 0 |
16:12 |
hagarth |
livelace: bitrot detected files do not get listed in heal info |
16:12 |
livelace |
hagarth, http://pastebin.com/pBfeGpH3 |
16:12 |
glusterbot |
Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils. |
16:12 |
hagarth |
livelace: IIRC, scrubber also needs about 60-90 minutes to kickstart even in the agressive mode. |
16:13 |
hagarth |
looks like 60 minutes |
16:15 |
livelace |
hagarth, I test some things several hours (snapshots,clone etc), nothing was changed for this time |
16:16 |
livelace |
hagarth, What I should see in logs when files are was changed ? |
16:18 |
|
lcurtis joined #gluster |
16:18 |
livelace |
hagarth, Volume configuration http://fpaste.org/274624/75476144/ |
16:18 |
glusterbot |
Title: #274624 Fedora Project Pastebin (at fpaste.org) |
16:19 |
hagarth |
livelace: something along the lines of https://github.com/gluster/glusterfs/blob/master/xlators/features/bit-rot/src/bitd/bit-rot-scrub.c#L224 |
16:19 |
glusterbot |
Title: glusterfs/bit-rot-scrub.c at master · gluster/glusterfs · GitHub (at github.com) |
16:20 |
hagarth |
livelace: general tip - network.ping-timeout is too low. Recommend setting it to 10 at least. |
16:21 |
livelace |
hagarth, I known, this for testing |
16:22 |
livelace |
hagarth, Maybe, will be good thing if I send my question to mailing list ? Or you can help me now ? |
16:24 |
hagarth |
livelace: yes, would recommend posting it on the mailing list |
16:25 |
livelace |
hagarth, grep -i corr /var/log/gluster/*.log - gave nothing |
16:25 |
|
mhulsman joined #gluster |
16:26 |
hagarth |
livelace: check the value of trusted.bit-rot.signature in all 3 replicas |
16:26 |
hagarth |
livelace: while testing bit-rot make sure that the corruption is induced after this extended attribute is set for the file |
16:27 |
hagarth |
livelace: bitrot waits for 2 minutes of inactivity on a file before it attempts signing the file |
16:28 |
hagarth |
if corruption is induced before bit-rot has signed the file, then the signature itself would be incorrect and hence the scrubber might not be able to detect that |
16:31 |
livelace |
Uh |
16:33 |
livelace |
http://fpaste.org/274628/44397635/ |
16:33 |
glusterbot |
Title: #274628 Fedora Project Pastebin (at fpaste.org) |
16:34 |
|
Flo__ joined #gluster |
16:34 |
Flo__ |
hi |
16:34 |
glusterbot |
Flo__: Despite the fact that friendly greetings are nice, please ask your question. Carefully identify your problem in such a way that when a volunteer has a few minutes, they can offer you a potential solution. These are volunteers, so be patient. Answers may come in a few minutes, or may take hours. If you're still in the channel, someone will eventually offer an answer. |
16:35 |
livelace |
hagarth, signatures are different, so scrubber should detect this ? |
16:35 |
Flo__ |
I have a replication cluster of two bricks. http://pastebin.com/aeW6Ks5j. On 1 node, I've set some posix acl entrys. They are not synced to the other brick. |
16:35 |
glusterbot |
Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils. |
16:36 |
|
skoduri joined #gluster |
16:39 |
livelace |
hagarth, volume status http://fpaste.org/274629/ |
16:39 |
glusterbot |
Title: #274629 Fedora Project Pastebin (at fpaste.org) |
16:42 |
|
DV joined #gluster |
16:43 |
|
B21956 joined #gluster |
16:51 |
hagarth |
Flo__: did you set acl entries from a glusterfs mount? |
16:52 |
hagarth |
livelace: if signatures are different, then the scrubber cannot detect. a typical bit rot happens with signatures being the same and the underlying content different. |
17:21 |
livelace |
hagarth, Thanks, I will try again, after signature will be set in each replica |
17:27 |
CyrilPeponnet |
hey guys I have a weird issue. |
17:28 |
CyrilPeponnet |
I have a 3 node setup holding a volume containing some libs |
17:28 |
CyrilPeponnet |
previously it was replicate 2 |
17:28 |
CyrilPeponnet |
was working fine |
17:28 |
CyrilPeponnet |
but since I added a third brick |
17:28 |
CyrilPeponnet |
ldconfing -v core dump due to inode mismatch. |
17:28 |
CyrilPeponnet |
if I unmount the mount point (I'm using fuse gluster) then remount |
17:29 |
CyrilPeponnet |
it works for a time then fail again |
17:29 |
CyrilPeponnet |
using gluster server 3.6.5 and client 3.6.4 |
17:30 |
|
mufa joined #gluster |
17:48 |
|
chirino joined #gluster |
17:48 |
livelace |
hagarth, Thanks for your help, http://fpaste.org/274648/98091714/ |
17:48 |
glusterbot |
Title: #274648 Fedora Project Pastebin (at fpaste.org) |
17:53 |
|
kovshenin joined #gluster |
18:13 |
|
bluenemo joined #gluster |
18:16 |
|
bennyturns joined #gluster |
18:27 |
hagarth |
livelace: good to know! |
18:34 |
|
maveric_amitc_ joined #gluster |
18:42 |
|
LebedevRI joined #gluster |
18:45 |
|
dgbaley joined #gluster |
18:59 |
|
johndescs joined #gluster |
18:59 |
|
chirino joined #gluster |
19:21 |
|
CyrilP joined #gluster |
19:26 |
|
zerick_ joined #gluster |
19:27 |
|
m0zes_ joined #gluster |
19:28 |
|
patryck_ joined #gluster |
19:28 |
|
Dave____ joined #gluster |
19:28 |
|
msvbhat_ joined #gluster |
19:28 |
|
drue_ joined #gluster |
19:28 |
|
mjrosenb_ joined #gluster |
19:29 |
|
social__ joined #gluster |
19:30 |
|
p8952_ joined #gluster |
19:30 |
|
csaba1 joined #gluster |
19:30 |
|
foster_ joined #gluster |
19:31 |
|
atrius_ joined #gluster |
19:31 |
|
ashka joined #gluster |
19:32 |
|
LebedevRI_ joined #gluster |
19:32 |
|
Nebraskka joined #gluster |
19:33 |
|
dijuremo joined #gluster |
19:33 |
|
ndk joined #gluster |
19:34 |
|
campee joined #gluster |
19:45 |
|
jbrooks joined #gluster |
20:04 |
|
Pupeno joined #gluster |
20:09 |
|
cholcombe joined #gluster |
20:17 |
|
wushudoin joined #gluster |
20:17 |
|
wushudoin joined #gluster |
20:33 |
|
htrmeira joined #gluster |
20:53 |
|
livelace joined #gluster |
21:08 |
|
mufa joined #gluster |
21:13 |
|
F2Knight joined #gluster |
21:29 |
|
dlambrig joined #gluster |
21:39 |
|
stickyboy joined #gluster |
22:31 |
|
saltsa joined #gluster |
22:37 |
|
htrmeira joined #gluster |
22:58 |
|
shyam joined #gluster |