Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster, 2017-06-21

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:14 Seth_Karlo joined #gluster
00:29 Alghost joined #gluster
00:33 Alghost_ joined #gluster
00:59 fcoelho joined #gluster
01:09 shdeng joined #gluster
01:27 tannerb3 alright, I've got geo-replication sort of running, but now I have one entry in the geo-rep status view showing a node is Faulty
01:27 tannerb3 logs don't show much
01:32 edong23 joined #gluster
01:37 prasanth joined #gluster
01:48 ilbot3 joined #gluster
01:48 Topic for #gluster is now Gluster Community - https://www.gluster.org | Documentation - https://gluster.readthedocs.io/en/latest/ | Patches - https://review.gluster.org/ | Developers go to #gluster-dev | Channel Logs - https://botbot.me/freenode/gluster/ & http://irclog.perlgeek.de/gluster/
02:04 prasanth joined #gluster
02:45 vbellur joined #gluster
02:55 BitByteNybble110 joined #gluster
02:57 vbellur joined #gluster
02:59 nishanth joined #gluster
03:00 vbellur1 joined #gluster
03:01 vbellur2 joined #gluster
03:01 vbellur1 joined #gluster
03:02 vbellur joined #gluster
03:03 vbellur joined #gluster
03:04 vbellur joined #gluster
03:05 vbellur1 joined #gluster
03:05 vbellur joined #gluster
03:06 vbellur joined #gluster
03:07 vbellur1 joined #gluster
03:07 vbellur joined #gluster
03:08 Gambit15 joined #gluster
03:08 Gambit15_ joined #gluster
03:17 ppai joined #gluster
03:35 susant joined #gluster
03:46 ashiq joined #gluster
03:46 riyas joined #gluster
03:51 buvanesh_kumar joined #gluster
03:53 susant joined #gluster
03:58 nbalacha joined #gluster
04:00 Karan joined #gluster
04:01 itisravi joined #gluster
04:11 ndarshan joined #gluster
04:12 msvbhat joined #gluster
04:20 Shu6h3ndu joined #gluster
04:27 jiffin joined #gluster
04:28 gyadav joined #gluster
04:30 atinm joined #gluster
04:37 sahina joined #gluster
04:41 kotreshhr joined #gluster
04:45 msvbhat joined #gluster
04:47 buvanesh_kumar joined #gluster
04:54 prasanth joined #gluster
05:10 amarts joined #gluster
05:18 armyriad joined #gluster
05:27 Prasad joined #gluster
05:28 karthik_us joined #gluster
05:29 skumar joined #gluster
05:32 poornima joined #gluster
05:36 ashiq joined #gluster
05:42 hgowtham joined #gluster
05:45 Karan joined #gluster
05:52 mbukatov joined #gluster
05:55 Saravanakmr joined #gluster
05:55 itisravi joined #gluster
06:01 apandey joined #gluster
06:02 apandey_ joined #gluster
06:05 kdhananjay joined #gluster
06:08 PatNarciso joined #gluster
06:12 fiyawerx joined #gluster
06:13 apandey__ joined #gluster
06:15 ankitr joined #gluster
06:28 rastar joined #gluster
06:29 msvbhat joined #gluster
06:32 jtux joined #gluster
06:34 rafi1 joined #gluster
06:37 nishanth joined #gluster
06:39 sona joined #gluster
07:06 jkroon joined #gluster
07:07 itisravi_ joined #gluster
07:08 ankitr joined #gluster
07:08 ij__ joined #gluster
07:08 ij__ Hi!
07:08 glusterbot ij__: Despite the fact that friendly greetings are nice, please ask your question. Carefully identify your problem in such a way that when a volunteer has a few minutes, they can offer you a potential solution. These are volunteers, so be patient. Answers may come in a few minutes, or may take hours. If you're still in the channel, someone will eventually offer an answ
07:08 ij__ Funny bot... ;)
07:10 ij__ Anyway, after upgrading from Debian Jessie to Stretch, the clients on stretch cannot connect to the servers on Jessie anymore... I've already tried to configure for unsecure connection, but without success. Still no connection possible.
07:11 ij__ Any tips for this? (will copy log to paste.debian.net)
07:12 aravindavk joined #gluster
07:13 ij__ http://paste.debian.net/972518/
07:13 glusterbot Title: debian Pastezone (at paste.debian.net)
07:27 nbalacha joined #gluster
07:28 amarts joined #gluster
07:29 [diablo] joined #gluster
07:30 susant joined #gluster
07:34 fsimonce joined #gluster
07:46 msvbhat joined #gluster
08:14 major joined #gluster
08:16 kshlm joined #gluster
08:17 Seth_Karlo joined #gluster
08:19 nbalacha joined #gluster
08:22 caitlinb joined #gluster
08:23 MateuszM joined #gluster
08:25 Wizek_ joined #gluster
08:29 apandey_ joined #gluster
08:33 MrAbaddon joined #gluster
08:39 buvanesh_kumar joined #gluster
08:40 guest joined #gluster
08:41 MateuszM Hello,
08:42 MateuszM I'm using a 3 node replicate cluster and wondering if anyone has any VM going crazy when you take one of the gluster nodes down
08:43 MateuszM I'm using the FUSE native client to connect to the cluster - my virtual machines are being run by KVM on a separate physical server
08:43 ankitr joined #gluster
08:50 atinm joined #gluster
08:54 ankitr joined #gluster
08:54 amarts joined #gluster
08:58 rafi joined #gluster
08:59 apandey__ joined #gluster
09:02 skumar_ joined #gluster
09:04 jiffin1 joined #gluster
09:07 hybrid512 joined #gluster
09:08 Seth_Karlo joined #gluster
09:11 Seth_Kar_ joined #gluster
09:15 amarts joined #gluster
09:17 jiffin1 joined #gluster
09:18 atinm joined #gluster
09:18 Seth_Karlo joined #gluster
09:34 _nixpanic joined #gluster
09:34 _nixpanic joined #gluster
09:34 ankitr joined #gluster
09:45 skumar__ joined #gluster
09:49 prasanth joined #gluster
09:51 susant left #gluster
09:52 atinm joined #gluster
09:58 rafi1 joined #gluster
09:58 msvbhat joined #gluster
10:00 guest joined #gluster
10:01 amarts joined #gluster
10:03 rafi joined #gluster
10:15 Alghost joined #gluster
10:16 atinm joined #gluster
10:17 legreffier joined #gluster
10:23 msvbhat joined #gluster
10:29 buvanesh_kumar joined #gluster
10:48 Seth_Karlo joined #gluster
10:57 mahdi_adnan joined #gluster
10:58 mahdi_adnan Hi, where does Gluster store Profiling info ? and whats going to happen if i keep Profiling started all the time ?
11:00 kdhananjay mahdi_adnan: you need to execute 'gluster volume profile <VOL> info' and optionally redirect the output to a file to see the numbers
11:00 kdhananjay mahdi_adnan: until then it will be recorded in-memory
11:01 kdhananjay mahdi_adnan: and did you mean start profile and never stop it?
11:01 mahdi_adnan Yes
11:01 mahdi_adnan jsut start it
11:01 kdhananjay mahdi_adnan: hmm why would you want to do that? :)
11:01 mahdi_adnan I need to monitor Gluster with Prometheus
11:02 mahdi_adnan and graph and stats with Grafana
11:03 mahdi_adnan so if i started the Profiling without redirecting it's output it will be in - memory
11:03 mahdi_adnan how much will it consume ?
11:05 rafi2 joined #gluster
11:06 kdhananjay mahdi_adnan: not much. it just updates its numbers. doesn't add any new information over time
11:07 susant joined #gluster
11:08 kdhananjay joined #gluster
11:10 mahdi_adnan Many thanks mate
11:10 rafi1 joined #gluster
11:14 mahdi_adnan left #gluster
11:15 hgowtham joined #gluster
11:15 Seth_Karlo joined #gluster
11:17 DV__ joined #gluster
11:17 Seth_Karlo joined #gluster
11:29 [o__o] joined #gluster
11:31 WebertRLZ joined #gluster
11:32 Saravanakmr joined #gluster
11:58 sona joined #gluster
11:59 apandey joined #gluster
12:02 jbrooks joined #gluster
12:07 kdhananjay joined #gluster
12:24 baber joined #gluster
12:26 apandey joined #gluster
12:30 jiffin1 joined #gluster
12:37 jiffin1 joined #gluster
12:39 caitlinb joined #gluster
13:18 skylar joined #gluster
13:21 Seth_Karlo joined #gluster
13:23 Seth_Kar_ joined #gluster
13:34 kotreshhr joined #gluster
13:51 amarts joined #gluster
13:53 bowhunter joined #gluster
13:58 jstrunk joined #gluster
14:04 rafi joined #gluster
14:12 tannerb3 joined #gluster
14:13 baber joined #gluster
14:15 buvanesh_kumar joined #gluster
14:18 Saravanakmr joined #gluster
14:19 bowhunter joined #gluster
14:20 hgowtham joined #gluster
14:20 gyadav joined #gluster
14:24 itisravi joined #gluster
14:25 mbukatov joined #gluster
14:34 Seth_Karlo joined #gluster
14:35 ankitr joined #gluster
14:41 Seth_Kar_ joined #gluster
14:45 kpease joined #gluster
14:49 farhorizon joined #gluster
14:56 baber joined #gluster
15:02 tannerb3 so I managed to get geo-rep working yesterday. Apparently running gluster in repl mode with sudo makes it not use what's in /root/.ssh/. However, when I start the geo-replication, it's showing one brick has a Faulty status
15:04 wushudoin joined #gluster
15:06 msvbhat joined #gluster
15:19 shyam joined #gluster
15:26 kotreshhr1 joined #gluster
15:31 rafi1 joined #gluster
15:32 ankitr joined #gluster
15:32 bowhunter joined #gluster
15:42 baber joined #gluster
15:50 susant left #gluster
15:53 nashgul joined #gluster
15:54 debian1 joined #gluster
15:54 nashgul joined #gluster
15:57 nashgul joined #gluster
16:06 JoeJulian ij__: debian breaks apart ipv4 and ipv6. You'll need to remove the ipv6 ::1 address from localhost in /etc/hosts or recombine your ip stack (it's a sysctl thing)
16:09 ij__ JoeJulian: well, IPv6 is broken on my host anyway and frequently crashes dom0 completely when activated... will give it a try... would it work when all clients and servers are on same version (stretch)?
16:10 ij__ JoeJulian: speaking of: ::1 on server side I assume?
16:10 JoeJulian It has to do with the decisions made by the debian distro designers. All debian versions should have that problem. (yes, server side).
16:10 JoeJulian s/problem/feature/
16:10 glusterbot What JoeJulian meant to say was: It has to do with the decisions made by the debian distro designers. All debian versions should have that feature. (yes, server side).
16:11 armyriad joined #gluster
16:13 Gambit15 joined #gluster
16:16 ij__ JoeJulian: removing ::1 from hosts doesn't seem to work, when doing ip -6 a d ::1 dev lo it works and no ::1 anymore, but then glusterd doesn't start anymore :)
16:17 * JoeJulian raises an eyebrow
16:18 ij__ ok, glusterd processes still running
16:19 ij__ now it's running but still not working as in: client cannot mount
16:19 JoeJulian ,,(paste) the client log
16:19 glusterbot For a simple way to paste output, install netcat (if it's not already) and pipe your output like: | nc termbin.com 9999
16:20 JoeJulian fyi, my debian suggestion came from a success here: https://botbot.me/freenode/gluster/2017-06-12/?msg=87150039&amp;page=4
16:20 ij__ https://paste.debian.net/972607/
16:20 glusterbot Title: debian Pastezone (at paste.debian.net)
16:20 ij__ ok, that was the server log
16:21 JoeJulian What gluster versions are you mixing?
16:22 ij__ JoeJulian: https://paste.debian.net/972609/ - client log
16:22 glusterbot Title: debian Pastezone (at paste.debian.net)
16:22 ij__ ii  glusterfs-client                                                3.8.8-1
16:23 ij__ ii  glusterfs-server                                                3.5.2-2+deb8u3
16:23 ij__ I would be fine if I'm sure that those problems will vanish when all server/clients are on the same version
16:24 JoeJulian Yeah. I don't even think both servers are the same version. Maybe just upgrade the servers too? download.gluster.org
16:28 Gambit15 joined #gluster
16:28 ij__ JoeJulian: you're correct... I upgraded one server to 3.8.8 from backports... after downgrading again to jessie version, mount from client is working again now
16:29 tannerb3 JoeJulian, do you have any idea what would cause gluster to say one node/brick in geo-replication is faulty?
16:29 msvbhat joined #gluster
16:29 ij__ JoeJulian: thanks for your help! :)
16:29 JoeJulian tannerb3: Can the client reach it? Firewall, routing, ???
16:30 JoeJulian ij__: You're welcomee.
16:30 JoeJulian Damned keyboard keeps doing that. Grrr.
16:30 tannerb3 https://paste.debian.net/972610/
16:30 glusterbot Title: debian Pastezone (at paste.debian.net)
16:31 JoeJulian As a complete asside, "farmcommand" sounds like a way more fun game to play than "farmville" was.
16:32 tannerb3 :D I agree. Since I have replication setup via replica-0, I'm assuming it's connecting ok?
16:32 tannerb3 I could see traffic coming in via bmon on it
16:34 JoeJulian Unless gluster-replica-0.grandukevpc can't connect to gluster-replica-4 (I'm assuming 4) for some reason.
16:34 JoeJulian Oh 0
16:34 JoeJulian meh
16:34 tannerb3 Yeah, it's 0 to 0 having trouble
16:35 JoeJulian There should be a log for that client on one of those two machines.
16:36 msvbhat joined #gluster
16:37 kotreshhr joined #gluster
16:38 amarts joined #gluster
16:38 susant joined #gluster
16:41 kotreshhr left #gluster
16:46 tannerb3 JoeJulian, just found this in /var/log/glusterfs/geo-replication/farmcommand https://paste.debian.net/972612/
16:46 glusterbot Title: debian Pastezone (at paste.debian.net)
16:47 tannerb3 when I setup the keys for the 4 replicas I wrote a small script that did them all at once, so they are all the same
16:48 baber joined #gluster
16:48 JoeJulian "bash: /nonexistent/gsyncd" pretty sure that should say something other than "nonexistent". Maybe compare against a working log?
16:50 JoeJulian This is all debian? gluster servers are all running the same version? Same gluster subpackages (if your distro does it that way) are on each?
16:51 tannerb3 It doesn't look like there are any logs for the other nodes, it appears the only logs you get are specifically about the slave you specify
16:52 tannerb3 I can see logs from previous gluster-replica-0's that I've tried. It's all ubuntu, all running 3.10.3
16:53 amarts joined #gluster
16:53 jiffin joined #gluster
16:53 JoeJulian hmm
16:54 tannerb3 it was 3.10.1 on prod, and 3.10.3 on the new replicas, but I upgraded prod to 3.10.3 last night
16:55 tannerb3 gluster volume geo-replication <MASTERVOL> [<SLAVEUSER>@]<SLAVEHOST>::<SLAVEVOL> config remote-gsyncd <GSYNCD_PATH>
16:55 tannerb3 maybe I need that
17:09 JoeJulian seems likely
17:10 tannerb3 I tried, now all 4 are faulty :)
17:11 JoeJulian <sigh>
17:12 tannerb3 oh, it was my fault
17:12 tannerb3 I think it's working!
17:13 tannerb3 In my "I'll try anything" mode I enabled use-meta-volume, so replication was failing because it wasn't mounted
17:17 tannerb3 yup, it's working. Thanks for being my rubber duck, JoeJulian. Also, thanks in general for being such a huge help in this chat, your help is invaluable
17:21 bowhunter joined #gluster
17:24 JoeJulian Excellent. Glad you got it figured out.
17:24 JoeJulian And thank you for the complement.
17:25 skoduri_ joined #gluster
17:28 plarsen joined #gluster
17:33 subscope joined #gluster
17:46 Karan joined #gluster
17:51 skylar joined #gluster
17:55 apandey joined #gluster
18:08 msvbhat joined #gluster
18:21 primehaxor joined #gluster
18:31 baber joined #gluster
18:32 tannerb3 when running `gluster geo-replication ... status detail`, what do the ENTRY and DATA columns represent?
18:52 guhcampos joined #gluster
18:57 JoeJulian I believe entry is number of files and data is number of bytes.
19:03 tannerb3 e.g the brick that first worked this morning is at 548863 under ENTRY, 8072 DATA. Another has similar numbers, then the other 2 have low numbers under ENTRY, both ~500, and 0 under DATA
19:04 jiffin joined #gluster
19:18 rastar joined #gluster
19:19 Seth_Karlo joined #gluster
19:22 WebertRLZ joined #gluster
19:27 fiyawerx_ joined #gluster
19:29 primehaxor joined #gluster
19:34 bowhunter joined #gluster
19:34 Bardack joined #gluster
20:23 plarsen joined #gluster
20:40 plarsen joined #gluster
20:46 bowhunter joined #gluster
20:56 armyriad joined #gluster
20:59 Wizek_ joined #gluster
21:01 farhorizon joined #gluster
21:33 hvisage joined #gluster
21:39 jkroon joined #gluster
22:33 bowhunter joined #gluster
23:09 Alghost joined #gluster
23:10 Alghost_ joined #gluster
23:11 bowhunter joined #gluster
23:34 plarsen joined #gluster
23:56 Alghost joined #gluster

| Channels | #gluster index | Today | | Search | Google Search | Plain-Text | summary