| Time |
Nick |
Message |
| 00:02 |
|
owlbot joined #gluster |
| 00:03 |
|
Wizek__ joined #gluster |
| 00:06 |
|
owlbot joined #gluster |
| 00:08 |
|
Wizek_ joined #gluster |
| 00:10 |
|
owlbot joined #gluster |
| 00:14 |
|
owlbot joined #gluster |
| 00:18 |
|
owlbot joined #gluster |
| 00:22 |
|
owlbot joined #gluster |
| 00:26 |
|
owlbot joined #gluster |
| 00:30 |
|
owlbot joined #gluster |
| 00:34 |
|
owlbot joined #gluster |
| 00:38 |
|
owlbot joined #gluster |
| 00:42 |
|
owlbot joined #gluster |
| 00:46 |
|
owlbot joined #gluster |
| 00:50 |
|
owlbot joined #gluster |
| 00:54 |
|
owlbot joined #gluster |
| 00:58 |
|
owlbot joined #gluster |
| 01:02 |
|
owlbot joined #gluster |
| 01:06 |
|
owlbot joined #gluster |
| 01:10 |
|
owlbot joined #gluster |
| 01:14 |
|
caitnop joined #gluster |
| 01:14 |
|
owlbot joined #gluster |
| 01:18 |
|
owlbot joined #gluster |
| 01:22 |
|
owlbot joined #gluster |
| 01:26 |
|
owlbot joined #gluster |
| 01:29 |
|
EinstCrazy joined #gluster |
| 01:30 |
|
owlbot joined #gluster |
| 01:34 |
|
owlbot joined #gluster |
| 01:38 |
|
owlbot joined #gluster |
| 01:41 |
|
B21956 joined #gluster |
| 01:42 |
|
owlbot joined #gluster |
| 01:43 |
|
B21956 joined #gluster |
| 01:46 |
|
owlbot joined #gluster |
| 01:50 |
|
owlbot joined #gluster |
| 01:54 |
|
owlbot joined #gluster |
| 01:59 |
|
owlbot joined #gluster |
| 02:03 |
|
owlbot joined #gluster |
| 02:03 |
|
theron joined #gluster |
| 02:07 |
|
owlbot joined #gluster |
| 02:11 |
|
owlbot joined #gluster |
| 02:15 |
|
owlbot joined #gluster |
| 02:16 |
|
nangthang joined #gluster |
| 02:19 |
|
nangthang joined #gluster |
| 02:19 |
|
owlbot joined #gluster |
| 02:19 |
|
ahino joined #gluster |
| 02:23 |
|
owlbot joined #gluster |
| 02:27 |
|
owlbot joined #gluster |
| 02:31 |
|
owlbot joined #gluster |
| 02:35 |
|
coredump|br joined #gluster |
| 02:35 |
|
owlbot joined #gluster |
| 02:35 |
|
farhoriz_ joined #gluster |
| 02:39 |
|
owlbot joined #gluster |
| 02:46 |
|
owlbot joined #gluster |
| 02:46 |
|
Dave joined #gluster |
| 02:48 |
|
ilbot3 joined #gluster |
| 02:48 |
|
Topic for #gluster is now Gluster Community - http://gluster.org | Patches - http://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/ |
| 02:51 |
|
owlbot joined #gluster |
| 02:52 |
JoeJulian |
cpetersen: Sorry, wasn't around today. Couldn't sit at my desk since I just had knee surgery yesterday and had to keep it elevated all day today. Working from a tiny laptop screen just isn't efficient for me. |
| 02:53 |
JoeJulian |
cpetersen: I need you to figure this out since I'll be doing it after you. ;) |
| 02:55 |
|
owlbot joined #gluster |
| 02:59 |
|
owlbot joined #gluster |
| 03:01 |
virusuy |
JoeJulian: how was your surgery ? |
| 03:03 |
|
owlbot joined #gluster |
| 03:03 |
JoeJulian |
Good. Uneventful. |
| 03:07 |
|
owlbot joined #gluster |
| 03:11 |
|
owlbot joined #gluster |
| 03:15 |
|
owlbot joined #gluster |
| 03:19 |
|
owlbot joined #gluster |
| 03:21 |
|
skoduri joined #gluster |
| 03:23 |
|
owlbot joined #gluster |
| 03:26 |
|
B21956 joined #gluster |
| 03:27 |
|
owlbot joined #gluster |
| 03:31 |
|
owlbot joined #gluster |
| 03:35 |
|
owlbot joined #gluster |
| 03:39 |
|
owlbot joined #gluster |
| 03:43 |
|
owlbot joined #gluster |
| 03:45 |
|
sakshi joined #gluster |
| 03:47 |
|
owlbot joined #gluster |
| 03:47 |
JoeJulian |
Uneventful is how I like surgery, airplane rides, and server upgrades. |
| 03:50 |
JoeJulian |
@later tell hagarth with regard to my red/black container update question, yes. The bricks are bind mounts. |
| 03:50 |
glusterbot |
JoeJulian: The operation succeeded. |
| 03:51 |
|
owlbot joined #gluster |
| 03:51 |
|
nishanth joined #gluster |
| 03:55 |
|
owlbot joined #gluster |
| 03:59 |
|
owlbot joined #gluster |
| 04:03 |
|
owlbot joined #gluster |
| 04:07 |
|
owlbot joined #gluster |
| 04:11 |
|
owlbot joined #gluster |
| 04:15 |
|
owlbot joined #gluster |
| 04:19 |
|
owlbot joined #gluster |
| 04:23 |
|
owlbot joined #gluster |
| 04:27 |
|
owlbot joined #gluster |
| 04:31 |
|
owlbot joined #gluster |
| 04:35 |
|
owlbot joined #gluster |
| 04:39 |
|
owlbot joined #gluster |
| 04:43 |
|
owlbot joined #gluster |
| 04:47 |
|
kovshenin joined #gluster |
| 04:47 |
|
owlbot joined #gluster |
| 04:51 |
|
owlbot joined #gluster |
| 04:55 |
|
owlbot joined #gluster |
| 04:59 |
|
owlbot joined #gluster |
| 05:03 |
|
m0zes joined #gluster |
| 05:03 |
|
nangthang joined #gluster |
| 05:03 |
|
owlbot joined #gluster |
| 05:07 |
|
owlbot joined #gluster |
| 05:10 |
|
kovshenin joined #gluster |
| 05:11 |
|
owlbot joined #gluster |
| 05:13 |
|
atinm joined #gluster |
| 05:15 |
|
theron joined #gluster |
| 05:15 |
|
owlbot joined #gluster |
| 05:19 |
|
owlbot joined #gluster |
| 05:23 |
|
owlbot joined #gluster |
| 05:27 |
|
owlbot joined #gluster |
| 05:30 |
|
kanagaraj joined #gluster |
| 05:31 |
|
owlbot joined #gluster |
| 05:35 |
|
owlbot joined #gluster |
| 05:38 |
|
kanagaraj_ joined #gluster |
| 05:39 |
|
haomaiwa_ joined #gluster |
| 05:40 |
|
owlbot joined #gluster |
| 05:44 |
|
owlbot joined #gluster |
| 05:48 |
|
owlbot joined #gluster |
| 05:49 |
|
nehar joined #gluster |
| 05:52 |
|
owlbot joined #gluster |
| 05:56 |
|
owlbot joined #gluster |
| 05:59 |
|
owlbot joined #gluster |
| 06:01 |
|
haomaiwa_ joined #gluster |
| 06:04 |
|
owlbot joined #gluster |
| 06:08 |
|
owlbot joined #gluster |
| 06:12 |
|
owlbot joined #gluster |
| 06:14 |
|
ashiq joined #gluster |
| 06:16 |
|
owlbot joined #gluster |
| 06:16 |
|
kanagaraj joined #gluster |
| 06:20 |
|
owlbot joined #gluster |
| 06:24 |
|
owlbot joined #gluster |
| 06:25 |
|
Intensity joined #gluster |
| 06:28 |
|
owlbot joined #gluster |
| 06:32 |
|
owlbot joined #gluster |
| 06:35 |
|
kanagaraj_ joined #gluster |
| 06:36 |
|
owlbot joined #gluster |
| 06:40 |
|
owlbot joined #gluster |
| 06:42 |
|
armyriad joined #gluster |
| 06:43 |
|
nishanth joined #gluster |
| 06:44 |
|
owlbot joined #gluster |
| 06:44 |
|
Wizek joined #gluster |
| 06:48 |
|
owlbot joined #gluster |
| 06:52 |
|
owlbot joined #gluster |
| 06:56 |
|
owlbot joined #gluster |
| 07:00 |
|
owlbot joined #gluster |
| 07:01 |
|
haomaiwa_ joined #gluster |
| 07:04 |
|
owlbot joined #gluster |
| 07:08 |
|
owlbot joined #gluster |
| 07:12 |
|
owlbot joined #gluster |
| 07:16 |
|
owlbot joined #gluster |
| 07:18 |
|
kanagaraj joined #gluster |
| 07:20 |
|
owlbot joined #gluster |
| 07:24 |
|
owlbot joined #gluster |
| 07:24 |
|
ashiq joined #gluster |
| 07:28 |
|
owlbot joined #gluster |
| 07:28 |
|
Manikandan joined #gluster |
| 07:32 |
|
owlbot joined #gluster |
| 07:36 |
|
owlbot joined #gluster |
| 07:40 |
|
owlbot joined #gluster |
| 07:44 |
|
owlbot joined #gluster |
| 07:45 |
|
Wizek joined #gluster |
| 07:48 |
|
owlbot joined #gluster |
| 07:52 |
|
owlbot joined #gluster |
| 07:56 |
|
owlbot joined #gluster |
| 08:00 |
|
owlbot joined #gluster |
| 08:01 |
|
haomaiwang joined #gluster |
| 08:04 |
|
owlbot joined #gluster |
| 08:08 |
|
owlbot joined #gluster |
| 08:12 |
|
owlbot joined #gluster |
| 08:16 |
|
owlbot joined #gluster |
| 08:18 |
|
haomaiwa_ joined #gluster |
| 08:20 |
|
owlbot joined #gluster |
| 08:24 |
|
owlbot joined #gluster |
| 08:28 |
|
owlbot joined #gluster |
| 08:32 |
|
R0ok_ joined #gluster |
| 08:32 |
|
owlbot joined #gluster |
| 08:36 |
|
owlbot joined #gluster |
| 08:40 |
|
owlbot joined #gluster |
| 08:44 |
|
owlbot joined #gluster |
| 08:48 |
|
owlbot joined #gluster |
| 08:50 |
|
haomaiwa_ joined #gluster |
| 08:52 |
|
owlbot joined #gluster |
| 08:56 |
|
owlbot joined #gluster |
| 08:57 |
|
mobaer joined #gluster |
| 09:00 |
|
owlbot joined #gluster |
| 09:04 |
|
owlbot joined #gluster |
| 09:08 |
|
owlbot joined #gluster |
| 09:12 |
|
owlbot joined #gluster |
| 09:16 |
|
owlbot joined #gluster |
| 09:19 |
|
wowas joined #gluster |
| 09:19 |
wowas |
Hello |
| 09:19 |
glusterbot |
wowas: Despite the fact that friendly greetings are nice, please ask your question. Carefully identify your problem in such a way that when a volunteer has a few minutes, they can offer you a potential solution. These are volunteers, so be patient. Answers may come in a few minutes, or may take hours. If you're still in the channel, someone will eventually offer an answer. |
| 09:20 |
|
owlbot joined #gluster |
| 09:21 |
|
merp_ joined #gluster |
| 09:24 |
|
owlbot joined #gluster |
| 09:28 |
|
owlbot joined #gluster |
| 09:32 |
|
owlbot joined #gluster |
| 09:33 |
wowas |
could someone please have a look at this? http://fpaste.org/326450/96078514/ |
| 09:33 |
glusterbot |
Title: #326450 Fedora Project Pastebin (at fpaste.org) |
| 09:33 |
wowas |
i have a 3 Node replica setup and one node does not see the other nodes for some reason. But i can ping every node |
| 09:34 |
|
haomaiwa_ joined #gluster |
| 09:36 |
|
owlbot joined #gluster |
| 09:40 |
|
owlbot joined #gluster |
| 09:44 |
|
owlbot joined #gluster |
| 09:48 |
|
owlbot joined #gluster |
| 09:50 |
|
haomaiwang joined #gluster |
| 09:52 |
|
owlbot joined #gluster |
| 09:56 |
|
owlbot joined #gluster |
| 09:57 |
wowas |
actually, i might have a network problem ^^ |
| 10:00 |
|
owlbot joined #gluster |
| 10:01 |
|
haomaiwa_ joined #gluster |
| 10:01 |
|
petan joined #gluster |
| 10:03 |
|
DV joined #gluster |
| 10:04 |
|
owlbot joined #gluster |
| 10:09 |
|
owlbot joined #gluster |
| 10:13 |
|
owlbot joined #gluster |
| 10:13 |
|
skoduri joined #gluster |
| 10:16 |
|
owlbot joined #gluster |
| 10:21 |
|
owlbot joined #gluster |
| 10:25 |
|
owlbot joined #gluster |
| 10:29 |
|
owlbot joined #gluster |
| 10:33 |
|
owlbot joined #gluster |
| 10:37 |
|
owlbot joined #gluster |
| 10:38 |
|
mhulsman joined #gluster |
| 10:41 |
|
owlbot joined #gluster |
| 10:45 |
|
owlbot joined #gluster |
| 10:45 |
|
haomaiwang joined #gluster |
| 10:49 |
|
owlbot joined #gluster |
| 10:53 |
|
owlbot joined #gluster |
| 10:57 |
|
owlbot joined #gluster |
| 11:01 |
|
owlbot joined #gluster |
| 11:05 |
|
owlbot joined #gluster |
| 11:09 |
|
owlbot joined #gluster |
| 11:13 |
|
owlbot joined #gluster |
| 11:17 |
|
owlbot joined #gluster |
| 11:18 |
|
DV joined #gluster |
| 11:21 |
|
owlbot joined #gluster |
| 11:25 |
|
owlbot joined #gluster |
| 11:25 |
|
DV joined #gluster |
| 11:25 |
|
mobaer joined #gluster |
| 11:26 |
|
Wizek joined #gluster |
| 11:27 |
|
DV__ joined #gluster |
| 11:29 |
|
owlbot joined #gluster |
| 11:33 |
|
owlbot joined #gluster |
| 11:37 |
|
owlbot joined #gluster |
| 11:41 |
|
owlbot joined #gluster |
| 11:45 |
|
owlbot joined #gluster |
| 11:48 |
|
kenhui joined #gluster |
| 11:49 |
|
owlbot joined #gluster |
| 11:53 |
|
owlbot joined #gluster |
| 11:57 |
|
owlbot joined #gluster |
| 12:00 |
|
robb_nl joined #gluster |
| 12:01 |
|
owlbot joined #gluster |
| 12:05 |
|
owlbot joined #gluster |
| 12:06 |
|
kenhui joined #gluster |
| 12:09 |
|
owlbot joined #gluster |
| 12:13 |
|
Wizek joined #gluster |
| 12:13 |
|
owlbot joined #gluster |
| 12:17 |
|
owlbot joined #gluster |
| 12:21 |
|
owlbot joined #gluster |
| 12:23 |
|
R0ok_ joined #gluster |
| 12:25 |
|
owlbot joined #gluster |
| 12:29 |
|
voobscout joined #gluster |
| 12:29 |
|
owlbot joined #gluster |
| 12:33 |
|
mhulsman joined #gluster |
| 12:33 |
|
owlbot joined #gluster |
| 12:37 |
|
owlbot joined #gluster |
| 12:41 |
|
owlbot joined #gluster |
| 12:45 |
|
owlbot joined #gluster |
| 12:49 |
|
owlbot joined #gluster |
| 12:50 |
|
kenhui joined #gluster |
| 12:53 |
|
owlbot joined #gluster |
| 12:57 |
|
owlbot joined #gluster |
| 12:58 |
|
voobscout joined #gluster |
| 13:01 |
|
owlbot joined #gluster |
| 13:05 |
|
owlbot joined #gluster |
| 13:09 |
|
haomaiwang joined #gluster |
| 13:09 |
|
owlbot joined #gluster |
| 13:13 |
|
owlbot joined #gluster |
| 13:17 |
|
owlbot joined #gluster |
| 13:21 |
|
owlbot joined #gluster |
| 13:25 |
|
owlbot joined #gluster |
| 13:29 |
|
owlbot joined #gluster |
| 13:32 |
post-factum |
wowas: check your firewall |
| 13:33 |
|
Ulrar joined #gluster |
| 13:33 |
wowas |
post-factum, yeah, i was a weird bonding problem i had to fix. But now i get this: http://www.gluster.org/pipermail/gluster-users/2016-February/025455.html |
| 13:33 |
glusterbot |
Title: [Gluster-users] Error between v3.7.8 and v3.7.0 (at www.gluster.org) |
| 13:33 |
|
owlbot joined #gluster |
| 13:34 |
wowas |
E [socket.c:2965:socket_connect] |
| 13:34 |
wowas |
0-management: Failed to set keep-alive: Invalid argument |
| 13:37 |
|
owlbot joined #gluster |
| 13:38 |
post-factum |
you have to update all cluster to same version |
| 13:38 |
post-factum |
*whole cluster |
| 13:41 |
wowas |
okay, thanks |
| 13:41 |
|
owlbot joined #gluster |
| 13:45 |
|
owlbot joined #gluster |
| 13:49 |
|
owlbot joined #gluster |
| 13:53 |
JoeJulian |
wowas: That's also not the client log, that's the management daemon. The client log would be /var/log/glusterfs/mnt.log |
| 13:53 |
|
owlbot joined #gluster |
| 13:54 |
wowas |
JoeJulian, yeah, but the problem of the source are the diffrent versions, right? |
| 13:55 |
JoeJulian |
Not necessarily, though you _should_ upgrade servers before upgrading clients. |
| 13:55 |
wowas |
JoeJulian, i was not paying attention on this at that time :-( |
| 13:56 |
JoeJulian |
Post the client log. Let's see if we can work around this. |
| 13:56 |
wowas |
okay :) |
| 13:57 |
wowas |
http://fpaste.org/326547/55976648/ |
| 13:57 |
glusterbot |
Title: #326547 Fedora Project Pastebin (at fpaste.org) |
| 13:57 |
wowas |
i did " mount -t glusterfs 10.10.3.7:/RaidVolC /mnt/ " |
| 13:57 |
|
owlbot joined #gluster |
| 13:59 |
post-factum |
i had the similar issue in the middle of cluster upgrade with mixed 3.7.0 and 3.7.3 nodes |
| 14:01 |
|
haomaiwa_ joined #gluster |
| 14:01 |
|
owlbot joined #gluster |
| 14:05 |
MACscr |
does gluster upgrade pretty well? Will my client go offline? The client and the server are the same. Im using it as an iscsi target |
| 14:05 |
|
owlbot joined #gluster |
| 14:10 |
|
owlbot joined #gluster |
| 14:11 |
|
voobscout joined #gluster |
| 14:12 |
wowas |
post-factum, i downgraded the rpm package, it seems to work now |
| 14:14 |
|
owlbot joined #gluster |
| 14:17 |
|
owlbot joined #gluster |
| 14:18 |
|
baojg joined #gluster |
| 14:22 |
|
owlbot joined #gluster |
| 14:22 |
|
Wizek joined #gluster |
| 14:26 |
|
owlbot joined #gluster |
| 14:29 |
|
vmallika joined #gluster |
| 14:30 |
|
owlbot joined #gluster |
| 14:30 |
|
Manikandan joined #gluster |
| 14:32 |
JoeJulian |
cpetersen: Did you already show me the xattrs on one of the split-brains? |
| 14:32 |
|
jiffin joined #gluster |
| 14:34 |
|
owlbot joined #gluster |
| 14:38 |
|
owlbot joined #gluster |
| 14:38 |
|
robb_nl joined #gluster |
| 14:42 |
|
owlbot joined #gluster |
| 14:46 |
|
owlbot joined #gluster |
| 14:47 |
|
DV joined #gluster |
| 14:50 |
|
owlbot joined #gluster |
| 14:54 |
|
owlbot joined #gluster |
| 14:58 |
|
owlbot joined #gluster |
| 15:01 |
|
haomaiwa_ joined #gluster |
| 15:02 |
|
owlbot joined #gluster |
| 15:06 |
|
owlbot joined #gluster |
| 15:08 |
|
robb_nl joined #gluster |
| 15:10 |
|
owlbot joined #gluster |
| 15:13 |
|
amye joined #gluster |
| 15:14 |
|
owlbot joined #gluster |
| 15:18 |
|
owlbot joined #gluster |
| 15:21 |
|
kovshenin joined #gluster |
| 15:22 |
|
owlbot joined #gluster |
| 15:26 |
|
owlbot joined #gluster |
| 15:27 |
|
vmallika joined #gluster |
| 15:30 |
|
owlbot joined #gluster |
| 15:34 |
|
owlbot joined #gluster |
| 15:38 |
|
owlbot joined #gluster |
| 15:41 |
|
kovshenin joined #gluster |
| 15:42 |
|
owlbot joined #gluster |
| 15:46 |
|
owlbot joined #gluster |
| 15:49 |
cpetersen |
JoeJulian: No I didn't. When the split-brain happens, I think quorum straightens it out. |
| 15:50 |
cpetersen |
It happens over the course of a minute or two |
| 15:50 |
|
owlbot joined #gluster |
| 15:52 |
JoeJulian |
So it's a false report maybe? |
| 15:52 |
cpetersen |
What happened was, I cut power to brick 1. The ganesha VIP floated to brick 3 and the share basically stayed up. When the VM booted up on the other host, it was black. |
| 15:52 |
cpetersen |
I see the VMware POST, but no boot of VM. |
| 15:52 |
cpetersen |
That usually means corruption on either the disk or on the RAM. |
| 15:53 |
cpetersen |
...file. |
| 15:53 |
cpetersen |
The weird part is that there still may be hope. I booted the original host back up and moved the VM back. Low and behold, it booted fine. |
| 15:53 |
cpetersen |
I'm completely baffled... |
| 15:53 |
JoeJulian |
The gluster servers are also the clients? |
| 15:53 |
cpetersen |
No, ESXi. =) |
| 15:54 |
JoeJulian |
I thought I'd read somewhere back they were doing double duty. |
| 15:54 |
|
owlbot joined #gluster |
| 15:54 |
JoeJulian |
So why does the vm boot up on "the other host"? |
| 15:54 |
JoeJulian |
Shouldn't it just stay up? |
| 15:54 |
cpetersen |
Well, I guess they are the clients if you consider that Ganesha basically consumes the bricks via GlusterFS and shares them via NFS 3. |
| 15:55 |
cpetersen |
No because I cut power to the host consuming the share as well as the storage node. |
| 15:55 |
cpetersen |
It's complicated... =] |
| 15:56 |
cpetersen |
I only have 3 servers and each has a large block of storage, so I have a VM on each re-introducing the storage to the host. All of the servers are part of the replicated storage and also run the critical VMs that need to be HA. |
| 15:57 |
cpetersen |
So yeah, complicated. |
| 15:57 |
cpetersen |
Hyper-converged and bla bla bla |
| 15:58 |
|
owlbot joined #gluster |
| 15:59 |
cpetersen |
The main weird part is that each host is consuming the same VIP for the NFS3 share. Why would it even go in to split-brain in the first place? There is no multi-path IO going on here. |
| 15:59 |
JoeJulian |
right |
| 16:01 |
JoeJulian |
So, the gluster server is a vmware vm that's sharing out the local storage (I assume that vm boots from local storage) to be the nfs share for the rest of the vms. |
| 16:01 |
|
haomaiwa_ joined #gluster |
| 16:01 |
cpetersen |
I was hypothesizing that the bricks don't write simultaneously, that the main node that's mounted distributes to the others and so when I simulate a failure, the two haven't caught up. |
| 16:02 |
cpetersen |
Correct. |
| 16:02 |
JoeJulian |
Shouldn't make the splitbrain. |
| 16:02 |
|
owlbot joined #gluster |
| 16:03 |
cpetersen |
We bought VMware HA licensing with replication. The problem is that VMware replication doesn't do replicated volumes, it's for DR only. So we realized we needed VSAN. VSAN is expensive as hell. So, I needed to come up with another solution. =) |
| 16:03 |
cpetersen |
So now I'm boldly going in this direction. |
| 16:04 |
cpetersen |
In theory it works, in practice it's a bit sketchy |
| 16:04 |
JoeJulian |
That's no problem. My plan is to do something similar, though I planned on running gluster on the bare metal. |
| 16:05 |
cpetersen |
Hmmm, didn't know gluster had a virtual appliance for VMware. |
| 16:05 |
cpetersen |
I was googling GlusterFS direct mount on ESXi. |
| 16:06 |
|
owlbot joined #gluster |
| 16:07 |
|
m0zes joined #gluster |
| 16:07 |
JoeJulian |
Well, iirc esxi is basically ubuntu with the vmware hypervisor process running on it. |
| 16:08 |
JoeJulian |
What I intend to try is to take the vmware bits and see if I can run them on Arch Linux. If I can, then I run gluster in a systemd-nspawn container on the same hardware I run the hypervisor. |
| 16:08 |
cpetersen |
Basically, except all of the applications are proprietary for some reason. |
| 16:09 |
|
mobaer joined #gluster |
| 16:09 |
cpetersen |
Sounds just like what Pivot3 did with their CloudBank iteration. |
| 16:09 |
cpetersen |
Linux with hypervisor and storage controller installed on bare metal. |
| 16:09 |
cpetersen |
They do RAID6X, which means that you can lost an appliance and two drives but still survice. |
| 16:10 |
cpetersen |
survive. |
| 16:10 |
|
owlbot joined #gluster |
| 16:10 |
JoeJulian |
Meh |
| 16:10 |
cpetersen |
I don't know what kind of back end they use for storage computation, but their shit always fails. |
| 16:10 |
JoeJulian |
Heh |
| 16:11 |
cpetersen |
They used Citrix Xen back then. They use VMware now. |
| 16:11 |
JoeJulian |
<boggle> |
| 16:11 |
cpetersen |
I think your idea is awesome. Obviously using KVM, not ESXi, correct? |
| 16:12 |
JoeJulian |
Hey, we're using this software that locks us in to doing things in a specific way that's kind of broken, can we switch to some other software that locks us in even harder? |
| 16:12 |
JoeJulian |
We already do that with openstack+kvm. I'm talking about doing that with ESXi as well. |
| 16:13 |
cpetersen |
OIC. |
| 16:14 |
cpetersen |
So, a bit of news about Ganesha. |
| 16:14 |
|
owlbot joined #gluster |
| 16:14 |
cpetersen |
I took a tcpdump from when my NFS4.1 share wasn't coming back online after a failure in ESXi. |
| 16:15 |
cpetersen |
Malahal pointed out that the ESXi client was using BIND_CONN_TO_SESSION which is not yet implemented in Ganesha. |
| 16:15 |
cpetersen |
It's a change that could be coming soon as per mattbenjamin1. |
| 16:16 |
cpetersen |
I'm curious if, because NFS4.1 is more stateful, that it could solve my problem of the brief split-brain. |
| 16:16 |
cpetersen |
But I won't know until that is implemented. |
| 16:18 |
|
owlbot joined #gluster |
| 16:19 |
cpetersen |
I still don't think NFS3 would cause the split-brain. |
| 16:21 |
cpetersen |
I think it's how vCenter manages the HA. It touches each file, even the VM files that aren't affected by the HA failover. |
| 16:21 |
JoeJulian |
The whole thing about a split-brain being "brief" makes me think it's a false positive. |
| 16:21 |
cpetersen |
But it doesn't split-brain until that VIP failover. |
| 16:21 |
JoeJulian |
split-brains either are are aren't. |
| 16:21 |
JoeJulian |
are *or* aren't. |
| 16:22 |
|
owlbot joined #gluster |
| 16:22 |
cpetersen |
Yeah, I kinda thought that too. It scares me half to death when it happens. Basically it lists all of the VM files including the vmdk-flat and nvram files. |
| 16:22 |
cpetersen |
And being a creature of habit, I always think, shit there is a problem - when split-brain happens. |
| 16:25 |
cpetersen |
Interesting, this article suggests to mount each ESXi host to a different brick in the replicated cluster. |
| 16:25 |
cpetersen |
http://www.rehmert.com/2015/03/software-defined-storage-for-vmware-vsphere-on-glusterfs-nfs/ |
| 16:25 |
cpetersen |
His setup is similar, just not with Ganesha. Rather than using a float IP, he just mounts each brick independently. |
| 16:26 |
cpetersen |
But that would create multi-path issues with HA, I'm sure... |
| 16:26 |
|
owlbot joined #gluster |
| 16:27 |
JoeJulian |
Make a split and get the ,,(extended attributes) from one or more reported file on the two remaining servers. |
| 16:27 |
glusterbot |
(#1) To read the extended attributes on the server: getfattr -m . -d -e hex {filename}, or (#2) For more information on how GlusterFS uses extended attributes, see this article: http://pl.atyp.us/hekafs.org/index.php/2011/04/glusterfs-extended-attributes/ |
| 16:28 |
|
nishanth joined #gluster |
| 16:28 |
cpetersen |
Question, what is the difference between replicated and distributed-replicated? |
| 16:29 |
cpetersen |
Is that the same thing? |
| 16:29 |
JoeJulian |
distributed-replicated happens when you have a multiple of your replica count in bricks. |
| 16:30 |
cpetersen |
OIC. So 3 nodes, 2 replica bricks on each and all nodes replicate. |
| 16:30 |
JoeJulian |
so, replica 3 with 6 bricks is going to distribute roughly half of your files to one set of three replica, and the other half to the other set of three. |
| 16:30 |
cpetersen |
Ohhh, IC. |
| 16:30 |
|
owlbot joined #gluster |
| 16:32 |
cpetersen |
Have you ever heard of mounting GlusterFS natively within the ESXi console? |
| 16:32 |
cpetersen |
Rather than using iSCSI or NFS? |
| 16:32 |
JoeJulian |
No |
| 16:33 |
cpetersen |
Ok :) |
| 16:34 |
|
owlbot joined #gluster |
| 16:38 |
|
owlbot joined #gluster |
| 16:42 |
|
owlbot joined #gluster |
| 16:46 |
|
owlbot joined #gluster |
| 16:49 |
|
chromatin joined #gluster |
| 16:50 |
|
ovaistariq joined #gluster |
| 16:50 |
|
owlbot joined #gluster |
| 16:54 |
|
owlbot joined #gluster |
| 16:57 |
|
Wizek joined #gluster |
| 16:58 |
|
owlbot joined #gluster |
| 17:01 |
|
haomaiwang joined #gluster |
| 17:02 |
|
owlbot joined #gluster |
| 17:03 |
|
DV joined #gluster |
| 17:06 |
|
owlbot joined #gluster |
| 17:10 |
|
owlbot joined #gluster |
| 17:14 |
|
owlbot joined #gluster |
| 17:18 |
|
owlbot joined #gluster |
| 17:22 |
|
owlbot joined #gluster |
| 17:23 |
|
jri joined #gluster |
| 17:26 |
|
owlbot joined #gluster |
| 17:27 |
|
mowntan joined #gluster |
| 17:27 |
|
kenhui joined #gluster |
| 17:30 |
|
owlbot joined #gluster |
| 17:34 |
|
owlbot joined #gluster |
| 17:38 |
|
owlbot joined #gluster |
| 17:42 |
|
owlbot joined #gluster |
| 17:46 |
|
DV joined #gluster |
| 17:46 |
|
owlbot joined #gluster |
| 17:49 |
|
mobaer joined #gluster |
| 17:50 |
|
owlbot joined #gluster |
| 17:53 |
|
mhulsman joined #gluster |
| 17:54 |
|
owlbot joined #gluster |
| 17:58 |
|
owlbot joined #gluster |
| 18:00 |
|
Wizek joined #gluster |
| 18:01 |
|
haomaiwa_ joined #gluster |
| 18:02 |
|
owlbot joined #gluster |
| 18:03 |
|
mobaer1 joined #gluster |
| 18:04 |
|
robb_nl joined #gluster |
| 18:06 |
|
owlbot joined #gluster |
| 18:10 |
|
owlbot joined #gluster |
| 18:11 |
|
theron joined #gluster |
| 18:14 |
|
Telsin joined #gluster |
| 18:14 |
|
owlbot joined #gluster |
| 18:19 |
|
owlbot joined #gluster |
| 18:23 |
|
owlbot joined #gluster |
| 18:27 |
|
owlbot joined #gluster |
| 18:31 |
|
owlbot joined #gluster |
| 18:35 |
|
owlbot joined #gluster |
| 18:39 |
|
owlbot joined #gluster |
| 18:43 |
|
owlbot joined #gluster |
| 18:46 |
|
voobscout joined #gluster |
| 18:47 |
|
owlbot joined #gluster |
| 18:51 |
|
owlbot joined #gluster |
| 18:55 |
|
owlbot joined #gluster |
| 18:59 |
|
owlbot joined #gluster |
| 19:01 |
|
haomaiwang joined #gluster |
| 19:03 |
|
owlbot joined #gluster |
| 19:07 |
|
owlbot joined #gluster |
| 19:11 |
|
owlbot joined #gluster |
| 19:12 |
|
calavera joined #gluster |
| 19:15 |
|
owlbot joined #gluster |
| 19:19 |
|
owlbot joined #gluster |
| 19:23 |
|
owlbot joined #gluster |
| 19:27 |
|
owlbot joined #gluster |
| 19:31 |
|
owlbot joined #gluster |
| 19:32 |
|
theron joined #gluster |
| 19:35 |
|
owlbot joined #gluster |
| 19:38 |
|
kovshenin joined #gluster |
| 19:38 |
|
arcolife joined #gluster |
| 19:39 |
|
merp_ joined #gluster |
| 19:39 |
|
owlbot joined #gluster |
| 19:43 |
|
owlbot joined #gluster |
| 19:47 |
|
owlbot joined #gluster |
| 19:48 |
telmich |
hello |
| 19:48 |
glusterbot |
telmich: Despite the fact that friendly greetings are nice, please ask your question. Carefully identify your problem in such a way that when a volunteer has a few minutes, they can offer you a potential solution. These are volunteers, so be patient. Answers may come in a few minutes, or may take hours. If you're still in the channel, someone will eventually offer an answer. |
| 19:48 |
telmich |
what can be the problem if I get the following error from qemu: |
| 19:48 |
telmich |
Transport endpoint is not connected |
| 19:50 |
JoeJulian |
telmich: That's a network error. |
| 19:51 |
|
owlbot joined #gluster |
| 19:55 |
|
owlbot joined #gluster |
| 19:56 |
|
Wizek joined #gluster |
| 19:58 |
|
Wizek joined #gluster |
| 19:59 |
|
owlbot joined #gluster |
| 20:01 |
|
haomaiwang joined #gluster |
| 20:03 |
|
owlbot joined #gluster |
| 20:04 |
|
chromatin joined #gluster |
| 20:07 |
|
owlbot joined #gluster |
| 20:10 |
post-factum |
telmich: or server is down, you know |
| 20:11 |
|
owlbot joined #gluster |
| 20:11 |
|
DV joined #gluster |
| 20:15 |
|
owlbot joined #gluster |
| 20:18 |
|
voobscout joined #gluster |
| 20:19 |
|
owlbot joined #gluster |
| 20:20 |
|
amye joined #gluster |
| 20:23 |
|
owlbot joined #gluster |
| 20:27 |
|
owlbot joined #gluster |
| 20:30 |
|
Wizek joined #gluster |
| 20:31 |
|
owlbot joined #gluster |
| 20:35 |
|
owlbot joined #gluster |
| 20:36 |
|
XpineX joined #gluster |
| 20:38 |
|
theron joined #gluster |
| 20:39 |
|
owlbot joined #gluster |
| 20:41 |
|
kovshenin joined #gluster |
| 20:42 |
|
Wizek_ joined #gluster |
| 20:43 |
|
owlbot joined #gluster |
| 20:47 |
|
owlbot joined #gluster |
| 20:51 |
|
Wizek__ joined #gluster |
| 20:51 |
|
owlbot joined #gluster |
| 20:55 |
|
owlbot joined #gluster |
| 20:58 |
|
theron joined #gluster |
| 20:59 |
|
owlbot joined #gluster |
| 21:00 |
|
kovshenin joined #gluster |
| 21:01 |
|
haomaiwa_ joined #gluster |
| 21:03 |
|
owlbot joined #gluster |
| 21:07 |
|
owlbot joined #gluster |
| 21:08 |
|
voobscout joined #gluster |
| 21:11 |
|
owlbot joined #gluster |
| 21:13 |
|
DV joined #gluster |
| 21:15 |
|
owlbot joined #gluster |
| 21:19 |
|
owlbot joined #gluster |
| 21:22 |
|
kenhui joined #gluster |
| 21:22 |
|
kenhui joined #gluster |
| 21:23 |
|
owlbot joined #gluster |
| 21:27 |
|
owlbot joined #gluster |
| 21:33 |
|
owlbot joined #gluster |
| 21:35 |
|
owlbot joined #gluster |
| 21:39 |
|
owlbot joined #gluster |
| 21:43 |
|
owlbot joined #gluster |
| 21:47 |
|
owlbot joined #gluster |
| 21:51 |
|
owlbot joined #gluster |
| 21:56 |
|
owlbot joined #gluster |
| 21:58 |
|
fcami joined #gluster |
| 22:00 |
|
owlbot joined #gluster |
| 22:01 |
|
haomaiwa_ joined #gluster |
| 22:04 |
|
owlbot joined #gluster |
| 22:07 |
|
DV_ joined #gluster |
| 22:08 |
|
owlbot joined #gluster |
| 22:12 |
|
owlbot joined #gluster |
| 22:13 |
|
voobscout joined #gluster |
| 22:16 |
|
owlbot joined #gluster |
| 22:20 |
|
owlbot joined #gluster |
| 22:24 |
|
owlbot joined #gluster |
| 22:28 |
|
owlbot joined #gluster |
| 22:32 |
|
owlbot joined #gluster |
| 22:32 |
|
ahino joined #gluster |
| 22:33 |
|
kovshenin joined #gluster |
| 22:36 |
|
owlbot joined #gluster |
| 22:40 |
|
owlbot joined #gluster |
| 22:42 |
|
Wizek joined #gluster |
| 22:44 |
|
owlbot joined #gluster |
| 22:48 |
|
owlbot joined #gluster |
| 22:52 |
|
owlbot joined #gluster |
| 22:56 |
|
owlbot joined #gluster |
| 23:00 |
|
owlbot joined #gluster |
| 23:01 |
|
haomaiwa_ joined #gluster |
| 23:04 |
|
owlbot joined #gluster |
| 23:08 |
|
owlbot joined #gluster |
| 23:12 |
|
owlbot joined #gluster |
| 23:16 |
|
owlbot joined #gluster |
| 23:20 |
|
owlbot joined #gluster |
| 23:24 |
|
owlbot joined #gluster |
| 23:28 |
|
owlbot joined #gluster |
| 23:32 |
|
owlbot joined #gluster |
| 23:36 |
|
owlbot joined #gluster |
| 23:40 |
|
owlbot joined #gluster |
| 23:44 |
|
owlbot joined #gluster |
| 23:44 |
|
merp_ joined #gluster |
| 23:48 |
|
owlbot joined #gluster |
| 23:52 |
|
owlbot joined #gluster |
| 23:56 |
|
owlbot joined #gluster |
