Perl 6 - the future is here, just unevenly distributed

IRC log for #gluster-dev, 2016-07-05

| Channels | #gluster-dev index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 rafi joined #gluster-dev
00:01 rafi joined #gluster-dev
00:12 samikshan joined #gluster-dev
02:17 poornimag joined #gluster-dev
03:30 magrawal joined #gluster-dev
03:32 sanoj joined #gluster-dev
03:42 sakshi joined #gluster-dev
03:50 hgowtham joined #gluster-dev
03:50 sanoj joined #gluster-dev
03:50 Manikandan joined #gluster-dev
03:51 atinm joined #gluster-dev
04:03 itisravi joined #gluster-dev
04:04 itisravi_ joined #gluster-dev
04:22 shubhendu joined #gluster-dev
04:27 Muthu_ joined #gluster-dev
04:27 suliba joined #gluster-dev
04:35 rraja joined #gluster-dev
04:40 ndarshan joined #gluster-dev
04:41 shubhendu joined #gluster-dev
04:55 shubhendu joined #gluster-dev
05:04 poornimag joined #gluster-dev
05:06 spalai joined #gluster-dev
05:14 ppai joined #gluster-dev
05:15 itisravi_ joined #gluster-dev
05:18 prasanth_ joined #gluster-dev
05:21 aspandey joined #gluster-dev
05:25 Bhaskarakiran joined #gluster-dev
05:30 msvbhat joined #gluster-dev
05:38 devyani7_ joined #gluster-dev
05:39 Apeksha joined #gluster-dev
05:40 nishanth joined #gluster-dev
05:44 karthik___ joined #gluster-dev
05:45 mchangir joined #gluster-dev
05:47 Muthu__ joined #gluster-dev
05:49 atalur joined #gluster-dev
05:55 pur joined #gluster-dev
06:02 asengupt joined #gluster-dev
06:03 skoduri joined #gluster-dev
06:12 kshlm joined #gluster-dev
06:15 kdhananjay joined #gluster-dev
06:16 itisravi joined #gluster-dev
06:22 hchiramm joined #gluster-dev
06:24 ppai joined #gluster-dev
06:26 atinm kshlm, I just too the example config file you had in your PR and try to bring up glusterd2 instance and saw that parsing failed error
06:26 atinm kshlm, not sure whether I am missing anything here
06:26 kshlm atinm, I've replied in the PR.
06:26 hgowtham joined #gluster-dev
06:27 kshlm Short answer, you've copied the toml example and given it a yaml extension.
06:27 atinm kshlm, the example file needs a change in that case :)
06:27 atinm kshlm, ahh!! I was not aware that toml and yaml have different semantics
06:27 atinm kshlm, will try that out
06:45 aspandey joined #gluster-dev
06:46 s-kania joined #gluster-dev
06:51 sakshi joined #gluster-dev
07:14 pg joined #gluster-dev
07:23 rastar joined #gluster-dev
07:23 rafi joined #gluster-dev
07:46 rafi joined #gluster-dev
07:51 karthik___ joined #gluster-dev
07:52 ppai joined #gluster-dev
07:59 rafi joined #gluster-dev
08:01 misc nigelb: so, documentation on planet would go on tools, or procedures ?
08:01 misc (cause neither seems to fit)
08:03 nigelb misc: Tools fits slightly better. But if you want to name "Tools" to make it fit differently, go ahead.
08:04 misc nigelb: well, yeah, tools sound the place, but planet is not really a tool :/
08:04 misc sound like
08:04 nigelb I know.
08:05 misc I guess we can change later once we have a better idea
08:07 sanoj joined #gluster-dev
08:09 rafi joined #gluster-dev
08:12 msvbhat joined #gluster-dev
08:20 Saravanakmr joined #gluster-dev
08:22 ppai joined #gluster-dev
08:25 ashiq joined #gluster-dev
08:41 Muthu_ joined #gluster-dev
08:41 Muthu__ joined #gluster-dev
08:42 ppai joined #gluster-dev
08:48 ramky joined #gluster-dev
08:49 post-factum hmm we get periodic spontaneous bricks crash with the following stacktrace http://termbin.com/x0gv
08:49 post-factum each time stacktrace is almost the same pointing to inode.c:336
08:50 post-factum i guess some NULL dereferencing happens there
08:50 post-factum any ideas?
08:51 post-factum it is 3.7.12 with those patches: http://termbin.com/kwha
08:52 post-factum ndevos: anoopcs: skoduri: ^^
08:56 post-factum here is another stacktrace: http://termbin.com/66ry
08:57 skoduri post-factum, yes..looks like invalid memory reference..any steps to reproduce?
08:58 post-factum skoduri: in fact, no. just start volume, and let the workload do the job in several hours
08:58 post-factum skoduri: that volume holds our websites, for example. mostly reading happens
09:00 skoduri post-factum, oh okay
09:02 post-factum skoduri: the only suspicious things in logs are warnings described in https://bugzilla.redhat.com/show_bug.cgi?id=1336630
09:02 glusterbot Bug 1336630: low, low, ---, pkarampu, MODIFIED , ERROR and Warning message on writing a file from mount point "null gfid for path (null)" repeated 3 times between"
09:02 post-factum skoduri: i'd like to cherry-pick that changeset, but could that be the case?
09:03 kdhananjay joined #gluster-dev
09:04 skoduri post-factum, if I match the 3.7 sources with line number, it crashed at 'if (xl->cbks->forget) ' ...do you have core generated?
09:04 post-factum skoduri: yes, sure. that is how i got stacktraces :)
09:05 post-factum skoduri: and yes, you are pointing to the line i've found as well
09:05 skoduri post-factum, okay :) .. could you print *xl in frame 5
09:05 post-factum skoduri: any help with gdb please?
09:06 skoduri post-factum, after you open the core via gdb, run 'f 5'
09:06 post-factum done
09:07 skoduri now  run these commands --> 'p xl', ' p *xl' and paste in termbin
09:07 post-factum skoduri: http://termbin.com/6jj1
09:08 post-factum skoduri: also, i guess, you'd want this: http://termbin.com/ehxf
09:11 atinm kshlm, I need your opinion on http://review.gluster.org/#/c/14758
09:13 post-factum skoduri: also, repeated the same with second stacktrace: http://termbin.com/2deq almost the same
09:14 skoduri post-factum, whole xl object looks invalid ... xl->name seems to contain some garbage value
09:14 skoduri post-factum, run this ' p index'
09:14 post-factum skoduri: $1 = 5
09:15 post-factum skoduri: on both stacktraces
09:15 skoduri okay
09:16 ppai joined #gluster-dev
09:19 post-factum skoduri: meanwhile inode->table->xl->graph->xl_count is 17
09:20 skoduri post-factum, right..some xlator may have reset/freed inode_ctx but hasn't set xl_key back to NULL..
09:22 post-factum skoduri: how one would find the guilty one?
09:23 skoduri looking for clues in the code
09:24 skoduri left #gluster-dev
09:24 skoduri joined #gluster-dev
09:29 skoduri post-factum, can you please run the command 'thread apply all bt' and verify if there are any other threads operating on the same inode entry "inode=0x7fc0756b89f8"
09:29 post-factum skoduri: is that first stacktrace?
09:30 skoduri post-factum, right...this one - http://termbin.com/x0gv
09:30 post-factum skoduri: ok give me a moment
09:32 post-factum skoduri: https://gist.github.com/b2c7228b77259cee6af329ad96d4dfa5
09:32 post-factum skoduri: ctrl+f gave me zero result, see it in stacktrace only
09:33 skoduri okay
09:38 rastar joined #gluster-dev
09:38 rafi joined #gluster-dev
09:42 post-factum skoduri: checked second stacktrace with the same result
09:44 msvbhat joined #gluster-dev
09:46 anoopcs post-factum, Just confirming: You were seeing this with 3.7.11 too, right?
09:46 post-factum anoopcs: correct. decided to upgrade this night to see if it is fixed
09:47 anoopcs post-factum, Ok.
09:52 post-factum skoduri: anoopcs: volume info just in case http://termbin.com/vvf1
09:53 post-factum skoduri: anoopcs: probably, upcall-related? i see it in stacktrace
10:01 skoduri post-factum, since it is right below io-threads xlator, it happened to be first one in the stack trace...
10:02 skoduri post-factum, I think inode_ctx is being freed twice ..not sure how though
10:02 skoduri left #gluster-dev
10:02 skoduri joined #gluster-dev
10:04 post-factum skoduri: could http://review.gluster.org/#/c/14739/1 be the case?
10:05 post-factum skoduri: i happily merged it into our 3.7 build
10:06 skoduri post-factum, I suspected the same as it is addressing inode leaks but I do not see any other relation... could you try re-test excluding patch if possible?
10:06 post-factum skoduri: yep, I could revert that patch now and re-deploy
10:07 skoduri okay
10:10 ppai joined #gluster-dev
10:16 anoopcs skoduri, post-factum: I do see a relation in the above mentioned patch w.r.t this crash.
10:16 itisravi joined #gluster-dev
10:16 skoduri anoopcs, readdir code path?
10:16 post-factum anoopcs: would you please explain
10:16 anoopcs skoduri, Yes.
10:16 anoopcs See here: http://review.gluster.org/#/c/14739/1/xlators/storage/posix/src/posix.c
10:16 anoopcs post-factum, ^^
10:17 anoopcs Just before calling gf_dirent_free() from posix_rdo_readdir() we call posix_readdirp_fill()
10:18 skoduri anoopcs, yes..I checked those code changes..
10:18 skoduri its rightly doing unref in case of error cases..
10:18 skoduri on top the crash happened for some other inode
10:18 skoduri as part of inode_table_prune but not the one being unref'ed
10:19 skoduri but anyways..I could be missing something..
10:19 anoopcs Ok. Let me check once more
10:23 foster joined #gluster-dev
10:35 surabhi joined #gluster-dev
10:36 post-factum anoopcs: skoduri: anyway, i must say, we didn't have that patch for 3.7.11
10:36 surabhi joined #gluster-dev
10:37 anoopcs That's correct.
10:44 sanoj joined #gluster-dev
11:03 atinm kshlm, do you want to merge http://review.gluster.org/#/c/14857/ ?
11:07 skoduri post-factum, in case f you still hit that crash post reverting that patch, could you please file a bug and attach the core.
11:14 post-factum skoduri: sure
11:14 post-factum skoduri: first, i just want to wait for another crash before reverting just to make sure i get the same stacktrace
11:15 skoduri okay
11:15 post-factum skoduri: but i've already prepared packages
11:26 sunnikri joined #gluster-dev
11:36 ppai joined #gluster-dev
11:37 shubhendu joined #gluster-dev
11:43 sanoj joined #gluster-dev
11:45 ira joined #gluster-dev
11:55 Saravanakmr #REMINDER: Gluster Community Bug Triage meeting at 12:00 UTC #gluster-meeting
11:59 Muthu__ joined #gluster-dev
11:59 Muthu_ joined #gluster-dev
12:05 kkeithley skoduri++
12:05 glusterbot kkeithley: skoduri's karma is now 26
12:11 ashiq joined #gluster-dev
12:13 msvbhat joined #gluster-dev
12:19 poornimag joined #gluster-dev
12:19 pg joined #gluster-dev
12:25 skoduri Saravanakmr++
12:25 glusterbot skoduri: Saravanakmr's karma is now 13
12:26 kkeithley Saravanakmr++
12:26 glusterbot kkeithley: Saravanakmr's karma is now 14
12:26 Saravanakmr skoduri++ ndevos++ kkeithley++
12:26 glusterbot Saravanakmr: skoduri's karma is now 27
12:26 glusterbot Saravanakmr: ndevos's karma is now 282
12:26 glusterbot Saravanakmr: kkeithley's karma is now 130
12:26 ndevos Saravanakmr++
12:26 glusterbot ndevos: Saravanakmr's karma is now 15
12:46 mchangir joined #gluster-dev
12:55 atinm joined #gluster-dev
12:55 hchiramm joined #gluster-dev
13:15 spalai left #gluster-dev
13:17 hchiramm_ joined #gluster-dev
13:29 Muthu_ joined #gluster-dev
13:30 Muthu__ joined #gluster-dev
13:40 skoduri joined #gluster-dev
13:42 ndevos kshlm: if there is a holiday tomorrow, will you still be hosting the community meeting?
13:43 kshlm ndevos, I will be hosting
13:43 ndevos ok, great :)
13:44 kkeithley I thought I signed up to chair the call tomorrow? But if you really want to do it that's fine with me
13:44 kkeithley (It's in the minutes even.)
13:45 kshlm kkeithley, I forgot!
13:45 atinm joined #gluster-dev
13:45 kshlm You're still the host. I'll be attending the meeting.
13:46 kkeithley s/call/meeting/
13:46 * kkeithley wonders where glusterbot is
13:46 post-factum glusterbot: ping
13:46 glusterbot pong
13:46 post-factum here :)
13:47 kkeithley s/call/meeting/g
13:47 kkeithley here, but not making corrections
13:47 post-factum glusterbot: help
13:47 glusterbot post-factum: (help [<plugin>] [<command>]) -- This command gives a useful description of what <command> does. <plugin> is only necessary if the command is in more than one plugin. You may also want to use the 'list' command to list all available plugins and commands.
13:48 post-factum glusterbot: list
13:48 glusterbot post-factum: Admin, Alias, Anonymous, Bugzilla, Channel, ChannelStats, Conditional, Config, Dict, Factoids, Google, Herald, Karma, Later, MessageParser, Misc, Network, NickCapture, Note, Owner, Plugin, PluginDownloader, Reply, Seen, Services, String, Topic, Trigger, URL, User, Utilities, and Web
13:59 shyam joined #gluster-dev
14:10 jiffin joined #gluster-dev
14:11 rafi joined #gluster-dev
14:11 jiffin1 joined #gluster-dev
14:12 ndevos kkeithley: I've completely reviewed http://review.gluster.org/14085 now, and could not find anything else to complain about ;-)
14:13 ndevos glusterbot: help Bugzilla
14:13 glusterbot ndevos: Error: There is no command "bugzilla". However, "Bugzilla" is the name of a loaded plugin, and you may be able to find its provided commands using 'list Bugzilla'.
14:13 ndevos glusterbot: list Bugzilla
14:13 glusterbot ndevos: add, attachment, bug, and query
14:14 ndevos glusterbot: query glusterfs-3.8.1
14:14 glusterbot ndevos: No results for "glusterfs-3.8.1."
14:14 post-factum glusterbot: query glusterfs-3.7.11
14:14 glusterbot post-factum: Bug https://bugzilla.redhat.com:443/show_bug.cgi?id=1324405 unspecified, unspecified, ---, kaushal, CLOSED CURRENTRELEASE, GlusterFS-3.7.11 tracker
14:14 post-factum ha
14:14 ndevos glusterbot: query 1345943
14:14 glusterbot ndevos: No results for "1345943."
14:14 rafi joined #gluster-dev
14:15 post-factum glusterbot: bug 1345943
14:15 glusterbot post-factum: Bug https://bugzilla.redhat.com:443/show_bug.cgi?id=1345943 unspecified, unspecified, ---, bugs, NEW , GlusterFS 3.8.1 tracker
14:15 ndevos glusterbot: query bug glusterfs-3.8.1
14:15 glusterbot ndevos: No results for "bug glusterfs-3.8.1."
14:16 ndevos well, I guess its just broken?
14:17 penguinRaider joined #gluster-dev
14:23 jiffin1 joined #gluster-dev
14:26 rafi joined #gluster-dev
14:42 Bhaskarakiran joined #gluster-dev
14:47 jiffin1 joined #gluster-dev
14:50 jiffin joined #gluster-dev
15:01 msvbhat joined #gluster-dev
15:05 mchangir joined #gluster-dev
15:05 wushudoin| joined #gluster-dev
15:09 lpabon joined #gluster-dev
15:13 cholcombe joined #gluster-dev
15:14 misc yeah, the firewall of RHIT block ntp, so the 2 new servers can't be synced, so they can't connect to freeipa/kerberos
15:23 shubhendu joined #gluster-dev
15:36 dlambrig left #gluster-dev
15:45 kshlm joined #gluster-dev
15:49 Apeksha joined #gluster-dev
16:00 jiffin1 joined #gluster-dev
16:05 jiffin joined #gluster-dev
16:17 baojg joined #gluster-dev
16:18 pkalever joined #gluster-dev
16:18 dlambrig_ joined #gluster-dev
16:31 jiffin1 joined #gluster-dev
17:16 penguinRaider joined #gluster-dev
17:47 baojg joined #gluster-dev
18:11 shubhendu joined #gluster-dev
18:15 pkalever left #gluster-dev
18:22 jiffin joined #gluster-dev
18:26 ashiq joined #gluster-dev
18:27 jiffin joined #gluster-dev
18:28 jiffin1 joined #gluster-dev
18:33 jiffin1 joined #gluster-dev
18:41 jiffin1 joined #gluster-dev
18:46 jiffin joined #gluster-dev
18:48 jiffin1 joined #gluster-dev
18:49 baojg joined #gluster-dev
18:52 penguinRaider joined #gluster-dev
18:56 jiffin joined #gluster-dev
18:58 jiffin1 joined #gluster-dev
19:06 jiffin1 joined #gluster-dev
19:12 jiffin joined #gluster-dev
19:16 jiffin1 joined #gluster-dev
19:21 jiffin joined #gluster-dev
19:23 jiffin1 joined #gluster-dev
19:28 jiffin1 joined #gluster-dev
19:34 jiffin joined #gluster-dev
19:50 baojg joined #gluster-dev
20:51 baojg joined #gluster-dev
21:52 baojg joined #gluster-dev
22:52 baojg joined #gluster-dev
23:53 baojg joined #gluster-dev

| Channels | #gluster-dev index | Today | | Search | Google Search | Plain-Text | summary