| Time |
Nick |
Message |
| 00:15 |
|
dlambrig joined #gluster |
| 01:28 |
|
plarsen joined #gluster |
| 01:28 |
|
nbalacha joined #gluster |
| 01:33 |
|
Lee1092 joined #gluster |
| 01:36 |
|
billputer joined #gluster |
| 01:39 |
|
lcurtis joined #gluster |
| 01:45 |
|
swebb joined #gluster |
| 01:54 |
|
dlambrig joined #gluster |
| 02:00 |
|
cyberbootje joined #gluster |
| 02:01 |
|
sage joined #gluster |
| 03:22 |
|
corretico joined #gluster |
| 03:33 |
|
haomaiwa_ joined #gluster |
| 03:38 |
|
stickyboy joined #gluster |
| 03:40 |
|
TheSeven joined #gluster |
| 03:48 |
|
nbalacha joined #gluster |
| 04:01 |
|
haomaiwa_ joined #gluster |
| 04:44 |
|
haomaiwa_ joined #gluster |
| 05:01 |
|
haomaiwa_ joined #gluster |
| 05:08 |
|
moogyver joined #gluster |
| 05:25 |
|
GB21 joined #gluster |
| 05:29 |
|
RedW joined #gluster |
| 05:29 |
|
Peppard joined #gluster |
| 06:01 |
|
haomaiwa_ joined #gluster |
| 06:02 |
|
necrogami joined #gluster |
| 06:02 |
|
sakshi joined #gluster |
| 06:05 |
|
nbalacha joined #gluster |
| 06:37 |
|
LebedevRI joined #gluster |
| 06:59 |
|
kovshenin joined #gluster |
| 07:01 |
|
haomaiwang joined #gluster |
| 07:02 |
|
haomaiwang joined #gluster |
| 07:42 |
|
muneerse joined #gluster |
| 07:56 |
|
jamesc joined #gluster |
| 08:01 |
|
haomaiwa_ joined #gluster |
| 08:51 |
|
DV joined #gluster |
| 09:01 |
|
haomaiwa_ joined #gluster |
| 09:12 |
|
rafi joined #gluster |
| 09:20 |
|
haomaiwang joined #gluster |
| 09:40 |
|
stickyboy joined #gluster |
| 10:01 |
|
haomaiwa_ joined #gluster |
| 10:37 |
|
haomaiwang joined #gluster |
| 11:01 |
|
haomaiwa_ joined #gluster |
| 11:13 |
|
mhulsman joined #gluster |
| 11:16 |
|
DV joined #gluster |
| 11:54 |
|
LebedevRI joined #gluster |
| 11:57 |
|
Pupeno joined #gluster |
| 12:07 |
|
bluenemo joined #gluster |
| 12:36 |
|
Mr_Psmith joined #gluster |
| 12:38 |
|
arcolife joined #gluster |
| 12:53 |
|
haomaiwang joined #gluster |
| 13:01 |
|
haomaiwang joined #gluster |
| 13:12 |
|
mufa joined #gluster |
| 13:18 |
|
DV joined #gluster |
| 13:23 |
|
mufa left #gluster |
| 13:23 |
|
mufa joined #gluster |
| 13:29 |
|
EinstCrazy joined #gluster |
| 13:35 |
|
mufa joined #gluster |
| 13:37 |
|
wnlx joined #gluster |
| 13:42 |
|
kovshenin joined #gluster |
| 14:01 |
|
haomaiwa_ joined #gluster |
| 14:02 |
|
arcolife joined #gluster |
| 14:05 |
|
livelace joined #gluster |
| 14:06 |
|
chirino_m joined #gluster |
| 14:07 |
livelace |
Hello. 3-way replicated volume. Enabled BitRot. lazy/normal/agressive methods was enabled, but, if we create simple file through FUSE client on server1, and modify the same file on server 3 through direct FS operation - BitRot doesn't find this changes on scrub. Why ? |
| 14:09 |
|
lcurtis joined #gluster |
| 14:32 |
|
plarsen joined #gluster |
| 14:36 |
ndevos |
livelace: I'm just guessing, but maybe bitrot triggers a heal of the file first? |
| 14:37 |
ndevos |
livelace: the bitrot develepers are not online now, they should be able to answer your question when you send it on the mailinglist |
| 14:40 |
|
harish_ joined #gluster |
| 14:52 |
|
shyam joined #gluster |
| 14:59 |
|
haomaiwa_ joined #gluster |
| 15:01 |
|
haomaiwa_ joined #gluster |
| 15:29 |
|
jbrooks joined #gluster |
| 15:33 |
|
chirino joined #gluster |
| 15:39 |
|
stickyboy joined #gluster |
| 15:56 |
hagarth |
livelace: are you looking at scrub logs on server 3 to check if the scrubber reports it? |
| 15:57 |
|
wushudoin joined #gluster |
| 15:57 |
hagarth |
ndevos: automatic healing is not yet available with bitrot. It is currently WIP. |
| 15:57 |
|
wushudoin joined #gluster |
| 16:01 |
|
haomaiwa_ joined #gluster |
| 16:05 |
ndevos |
hagarth: ah, thanks, good to know :) |
| 16:06 |
|
shaunm joined #gluster |
| 16:08 |
livelace |
hagarth, Of course, nothing suspicious |
| 16:09 |
livelace |
Start and rescheduling scrub |
| 16:10 |
livelace |
[root glusterfs3 ~]# gluster volume heal ovirt-data info |
| 16:10 |
livelace |
Brick glusterfs1.livelace.ru:/export/vdb1/ovirt-data/ |
| 16:10 |
livelace |
Number of entries: 0 |
| 16:10 |
livelace |
Brick glusterfs2.livelace.ru:/export/vdb1/ovirt-data/ |
| 16:10 |
livelace |
Number of entries: 0 |
| 16:10 |
livelace |
Brick glusterfs3.livelace.ru:/export/vdb1/ovirt-data/ |
| 16:10 |
livelace |
Number of entries: 0 |
| 16:12 |
hagarth |
livelace: bitrot detected files do not get listed in heal info |
| 16:12 |
livelace |
hagarth, http://pastebin.com/pBfeGpH3 |
| 16:12 |
glusterbot |
Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils. |
| 16:12 |
hagarth |
livelace: IIRC, scrubber also needs about 60-90 minutes to kickstart even in the agressive mode. |
| 16:13 |
hagarth |
looks like 60 minutes |
| 16:15 |
livelace |
hagarth, I test some things several hours (snapshots,clone etc), nothing was changed for this time |
| 16:16 |
livelace |
hagarth, What I should see in logs when files are was changed ? |
| 16:18 |
|
lcurtis joined #gluster |
| 16:18 |
livelace |
hagarth, Volume configuration http://fpaste.org/274624/75476144/ |
| 16:18 |
glusterbot |
Title: #274624 Fedora Project Pastebin (at fpaste.org) |
| 16:19 |
hagarth |
livelace: something along the lines of https://github.com/gluster/glusterfs/blob/master/xlators/features/bit-rot/src/bitd/bit-rot-scrub.c#L224 |
| 16:19 |
glusterbot |
Title: glusterfs/bit-rot-scrub.c at master · gluster/glusterfs · GitHub (at github.com) |
| 16:20 |
hagarth |
livelace: general tip - network.ping-timeout is too low. Recommend setting it to 10 at least. |
| 16:21 |
livelace |
hagarth, I known, this for testing |
| 16:22 |
livelace |
hagarth, Maybe, will be good thing if I send my question to mailing list ? Or you can help me now ? |
| 16:24 |
hagarth |
livelace: yes, would recommend posting it on the mailing list |
| 16:25 |
livelace |
hagarth, grep -i corr /var/log/gluster/*.log - gave nothing |
| 16:25 |
|
mhulsman joined #gluster |
| 16:26 |
hagarth |
livelace: check the value of trusted.bit-rot.signature in all 3 replicas |
| 16:26 |
hagarth |
livelace: while testing bit-rot make sure that the corruption is induced after this extended attribute is set for the file |
| 16:27 |
hagarth |
livelace: bitrot waits for 2 minutes of inactivity on a file before it attempts signing the file |
| 16:28 |
hagarth |
if corruption is induced before bit-rot has signed the file, then the signature itself would be incorrect and hence the scrubber might not be able to detect that |
| 16:31 |
livelace |
Uh |
| 16:33 |
livelace |
http://fpaste.org/274628/44397635/ |
| 16:33 |
glusterbot |
Title: #274628 Fedora Project Pastebin (at fpaste.org) |
| 16:34 |
|
Flo__ joined #gluster |
| 16:34 |
Flo__ |
hi |
| 16:34 |
glusterbot |
Flo__: Despite the fact that friendly greetings are nice, please ask your question. Carefully identify your problem in such a way that when a volunteer has a few minutes, they can offer you a potential solution. These are volunteers, so be patient. Answers may come in a few minutes, or may take hours. If you're still in the channel, someone will eventually offer an answer. |
| 16:35 |
livelace |
hagarth, signatures are different, so scrubber should detect this ? |
| 16:35 |
Flo__ |
I have a replication cluster of two bricks. http://pastebin.com/aeW6Ks5j. On 1 node, I've set some posix acl entrys. They are not synced to the other brick. |
| 16:35 |
glusterbot |
Please use http://fpaste.org or http://paste.ubuntu.com/ . pb has too many ads. Say @paste in channel for info about paste utils. |
| 16:36 |
|
skoduri joined #gluster |
| 16:39 |
livelace |
hagarth, volume status http://fpaste.org/274629/ |
| 16:39 |
glusterbot |
Title: #274629 Fedora Project Pastebin (at fpaste.org) |
| 16:42 |
|
DV joined #gluster |
| 16:43 |
|
B21956 joined #gluster |
| 16:51 |
hagarth |
Flo__: did you set acl entries from a glusterfs mount? |
| 16:52 |
hagarth |
livelace: if signatures are different, then the scrubber cannot detect. a typical bit rot happens with signatures being the same and the underlying content different. |
| 17:21 |
livelace |
hagarth, Thanks, I will try again, after signature will be set in each replica |
| 17:27 |
CyrilPeponnet |
hey guys I have a weird issue. |
| 17:28 |
CyrilPeponnet |
I have a 3 node setup holding a volume containing some libs |
| 17:28 |
CyrilPeponnet |
previously it was replicate 2 |
| 17:28 |
CyrilPeponnet |
was working fine |
| 17:28 |
CyrilPeponnet |
but since I added a third brick |
| 17:28 |
CyrilPeponnet |
ldconfing -v core dump due to inode mismatch. |
| 17:28 |
CyrilPeponnet |
if I unmount the mount point (I'm using fuse gluster) then remount |
| 17:29 |
CyrilPeponnet |
it works for a time then fail again |
| 17:29 |
CyrilPeponnet |
using gluster server 3.6.5 and client 3.6.4 |
| 17:30 |
|
mufa joined #gluster |
| 17:48 |
|
chirino joined #gluster |
| 17:48 |
livelace |
hagarth, Thanks for your help, http://fpaste.org/274648/98091714/ |
| 17:48 |
glusterbot |
Title: #274648 Fedora Project Pastebin (at fpaste.org) |
| 17:53 |
|
kovshenin joined #gluster |
| 18:13 |
|
bluenemo joined #gluster |
| 18:16 |
|
bennyturns joined #gluster |
| 18:27 |
hagarth |
livelace: good to know! |
| 18:34 |
|
maveric_amitc_ joined #gluster |
| 18:42 |
|
LebedevRI joined #gluster |
| 18:45 |
|
dgbaley joined #gluster |
| 18:59 |
|
johndescs joined #gluster |
| 18:59 |
|
chirino joined #gluster |
| 19:21 |
|
CyrilP joined #gluster |
| 19:26 |
|
zerick_ joined #gluster |
| 19:27 |
|
m0zes_ joined #gluster |
| 19:28 |
|
patryck_ joined #gluster |
| 19:28 |
|
Dave____ joined #gluster |
| 19:28 |
|
msvbhat_ joined #gluster |
| 19:28 |
|
drue_ joined #gluster |
| 19:28 |
|
mjrosenb_ joined #gluster |
| 19:29 |
|
social__ joined #gluster |
| 19:30 |
|
p8952_ joined #gluster |
| 19:30 |
|
csaba1 joined #gluster |
| 19:30 |
|
foster_ joined #gluster |
| 19:31 |
|
atrius_ joined #gluster |
| 19:31 |
|
ashka joined #gluster |
| 19:32 |
|
LebedevRI_ joined #gluster |
| 19:32 |
|
Nebraskka joined #gluster |
| 19:33 |
|
dijuremo joined #gluster |
| 19:33 |
|
ndk joined #gluster |
| 19:34 |
|
campee joined #gluster |
| 19:45 |
|
jbrooks joined #gluster |
| 20:04 |
|
Pupeno joined #gluster |
| 20:09 |
|
cholcombe joined #gluster |
| 20:17 |
|
wushudoin joined #gluster |
| 20:17 |
|
wushudoin joined #gluster |
| 20:33 |
|
htrmeira joined #gluster |
| 20:53 |
|
livelace joined #gluster |
| 21:08 |
|
mufa joined #gluster |
| 21:13 |
|
F2Knight joined #gluster |
| 21:29 |
|
dlambrig joined #gluster |
| 21:39 |
|
stickyboy joined #gluster |
| 22:31 |
|
saltsa joined #gluster |
| 22:37 |
|
htrmeira joined #gluster |
| 22:58 |
|
shyam joined #gluster |
