Perl 6 - the future is here, just unevenly distributed

IRC log for #salt, 2017-06-25

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:20 flowstategames joined #salt
00:25 drewbert joined #salt
00:26 drewbert I'm seeing "Error loading grains, unexpected linux_gpu_data output, check that you have a valid shell configured and permissions to run lspci command" Please advise?
00:26 dxiri joined #salt
00:30 flowstategames joined #salt
00:41 flowstategames joined #salt
00:42 darix joined #salt
00:46 Nexus_x1 joined #salt
00:56 disdain joined #salt
01:15 vegasq joined #salt
01:22 vegasq joined #salt
01:24 onlyanegg joined #salt
01:48 ilbot3 joined #salt
01:48 Topic for #salt is now Welcome to #salt! <+> Latest Versions: 2016.3.6, 2016.11.5 <+> Support: https://www.saltstack.com/support/ <+> Logs: http://irclog.perlgeek.de/salt/ <+> Paste: https://gist.github.com/ <+> See also: #salt-devel, #salt-offtopic <+> We are volunteers and may not have immediate answers <+> The call for speakers for SaltConf17 is now open: http://tinyurl.com/SaltConf17
02:09 flowstategames joined #salt
02:30 MTecknology drewbeer_: can you run the lspci command?
02:30 MTecknology drewbeer_: err.. nevermind, they left. tab complete fail
02:36 dxiri joined #salt
02:47 flowstategames joined #salt
02:47 dxiri joined #salt
02:49 drewbert_ joined #salt
02:54 onlyanegg joined #salt
02:55 icebal joined #salt
03:00 flowstat_ joined #salt
03:01 dxiri joined #salt
03:13 asyncsec joined #salt
03:23 donmichelangelo joined #salt
03:23 dxiri joined #salt
03:32 flowstategames joined #salt
03:40 dxiri joined #salt
03:55 onlyanegg joined #salt
04:01 drewbert joined #salt
04:01 drewbert Man, the saltpad deployment documentation is not good.
04:06 iggy is that still even actively maintained?
04:13 drewbert Hrmm, no development on it for a year.
04:16 drewbert Anyway. I'm still struggling with minions not responding to commands.  I can verify that the minion is running on the device (in debug mode, in fact).  salt-call on the minion works.  It 'looks like the minion is not even receiving the command.
04:19 iggy not even test.ping works?
04:23 dhoutz joined #salt
04:24 drewbert That is correct. I'm seeing "Minion did not return. [No response]"  My salt-master is on an AWS server.  AWS likes to terminate idle connections. Reading through the github issues, it seems a number of people have had trouble with this. I'm surprised salt/zeromq aren't more aggressive with their keepalives.
04:25 MTecknology run both daemons in debug
04:26 MTecknology in the foreground
04:29 drewbert running the minion in debug in the foreground already =) It's not getting the message at all.
04:37 drewbert I'm gonna try halving the TCP keepalive first message interval and setting the other settings explicity.
05:01 xet7 joined #salt
05:07 flowstategames joined #salt
05:26 vegasq joined #salt
05:28 coredumb drewbert: try tcp transport if you can
05:29 drewbert coredumb: Where can I find documentation of the tcp transport dependencies?
05:30 onlyanegg joined #salt
05:30 coredumb deps is tornado so it's already in
05:31 coredumb you can just enable it
05:31 drewbert Nice nice. And libsodium too, right?
05:31 coredumb mmmh not sure
05:32 drewbert Reading the code now, doesn't look like it.
05:32 flowstat_ joined #salt
05:32 drewbert This is actually potentially a much better solution if it will work. The documentation warns that its experimental though.
05:32 drewbert I need something production capable.
05:33 coredumb yeah that's what they say
05:33 drewbert I wonder what the rough bits are.
05:33 coredumb but apparently they want it to be the default in the near future
05:34 coredumb from what I've tried it's perfectly fine though
05:34 mavhq joined #salt
05:46 evle1 joined #salt
05:51 xet7 joined #salt
06:08 fritz09 joined #salt
06:16 flowstategames joined #salt
06:26 major joined #salt
06:31 onlyanegg joined #salt
07:15 jeddi joined #salt
07:32 onlyanegg joined #salt
07:34 zerocool_ joined #salt
07:36 CEH joined #salt
07:51 xet7 joined #salt
07:55 zerocoolback joined #salt
08:06 buu joined #salt
08:07 buu Ok guys
08:07 buu Why doesn't my ubuntu salt minion 2016.11.5 talk to my debian salt master 2016.11.5
08:08 viq buu: tcpdump showing packets arriving? key accepted?
08:08 buu Key claims to be accepted
08:08 buu ping between them works (same lan)
08:09 viq How about telnet to 4505 and 4506?
08:09 iggy can you connect from the minion to the master on port 4505/4506?
08:09 buu iggy: http://paste.debian.net/plain/973176
08:10 buu nc -v 192.168.1.14 4506
08:10 buu Connection to 192.168.1.14 4506 port [tcp/*] succeeded!
08:10 buu same for 4505
08:11 iggy does it take a while to timeout?
08:11 iggy do you have any minions that work?
08:11 buu Yes, I have at least 3 other debian ones that work, same lan
08:12 buu And yes, I just get 3 timeouts over 2-3 minutes
08:12 buu [DEBUG   ] SaltReqTimeoutError, retrying. (3/3)
08:12 viq buu: any firewall on the ubuntu one?
08:12 iggy sounds like a good reason not to use Ubuntu
08:12 * iggy not helpful
08:13 viq :D
08:13 viq "ancient african word for 'I don't know how to configure debian'" ? ;P
08:13 iggy honestly, the only time I've ever seen that was bad network and bad ext_pillar (the ext_pillar hung the master so it would timeout)
08:19 viq joined #salt
08:26 justanotheruser joined #salt
08:28 buu joined #salt
08:30 buu So anyways
08:30 buu Power outage defeated
08:31 buu Somewhat ironically the machine stayed up but its switch went down
08:32 buu iggy: http://paste.debian.net/plain/973179
08:32 buu This is what my salt-call on the minion eventually outputs
08:34 absolutejam Anyone know the best way to distribute python modules with salt modules?
08:35 absolutejam Going to try just dropping in _utils later and see how that works
08:35 buu Ok so.. I just did an apt-get remove --purge, rm -r /etc/salt
08:35 buu reinstalled
08:35 buu [CRITICAL] The Salt Master has rejected this minion's public key!
08:35 buu Ok sure, delete it from master, re-run salt-key -A, see a new key, accept it, re-run salt-call test.ing
08:36 buu Now it hangs again
09:33 onlyanegg joined #salt
09:46 CEH joined #salt
09:50 mt5225 joined #salt
09:56 CEH joined #salt
09:57 Praematura joined #salt
10:30 Trauma joined #salt
10:33 Trauma joined #salt
10:38 ronnix joined #salt
10:45 xet7 joined #salt
10:50 ronnix joined #salt
10:55 Trauma joined #salt
11:03 pbandark joined #salt
11:04 Trauma joined #salt
11:09 kiorky joined #salt
11:20 asyncsec joined #salt
11:21 cb joined #salt
11:33 onlyanegg joined #salt
11:41 hoonetorg joined #salt
12:05 CEH joined #salt
12:05 evle joined #salt
12:15 Inveracity joined #salt
12:18 cyborg-one joined #salt
12:32 pbandark joined #salt
12:33 mikecmpbll joined #salt
12:46 Inveracity joined #salt
12:47 cyborg-one joined #salt
12:52 hexa- joined #salt
12:53 guerby joined #salt
12:57 jerrcs joined #salt
13:34 onlyanegg joined #salt
13:37 johnkeates joined #salt
13:39 johnkeates postgres_database.present always fails here with a python exception and CommandExecutionError
13:48 saltnoob joined #salt
13:50 MTecknology that probably means it didn't work
13:51 guerby joined #salt
13:51 guerby joined #salt
13:52 nethershaw joined #salt
13:56 guerby joined #salt
13:56 johnkeates indeed
14:01 Trauma joined #salt
14:02 saltnoob joined #salt
14:02 saltnoob hi
14:04 zerocoolback joined #salt
14:05 saltnoob if im pulling from the salt mine for network interfaces whats the easiest way to print all the IPaddresses seperated by a ,
14:06 LostSoul joined #salt
14:07 another-idiot joined #salt
14:07 saltnoob :D
14:12 zerocoolback joined #salt
14:19 inetpro joined #salt
14:24 asyncsec joined #salt
14:30 Shirkdog joined #salt
14:35 onlyanegg joined #salt
14:39 johnkeates hire someone in india to do it, cheaper and faster :p
14:44 MTecknology saltnoob: You can use mine.get to see what the data structure looks like and I'm sure the join filter would be helpful
14:46 XenophonF absolutejam: use a pkg.installed or pip.installed state - that automatically triggers a minion reload
14:46 nicksloan joined #salt
14:48 XenophonF you can do those in the same SLS file as the states that require the extra Python modules, as long as you don't require them at render time
14:51 inetpro joined #salt
14:56 johnkeates joined #salt
14:56 johnkeates i'm sad because of https://github.com/saltstack/salt/issues/41931
15:02 zerocoolback joined #salt
15:09 Praematura joined #salt
15:15 saltnoob is there any documentation on the join filter ?
15:16 saltnoob wait found it :FD
15:17 xet7 joined #salt
15:31 ronnix joined #salt
15:51 onlyanegg joined #salt
15:52 saltnoob another silly question when using the replace filter how do you specify new line break ? is it with  | ?
15:56 saltnoob actually looks liek some examples I had are weird and its actually \n which makes sence lol :D
16:24 jhujhiti joined #salt
16:24 Praematura joined #salt
16:37 onlyanegg joined #salt
16:39 heyimawesome joined #salt
16:48 dxiri joined #salt
16:48 dxiri joined #salt
16:54 CEH joined #salt
17:00 nicksloan joined #salt
17:11 vegasq joined #salt
17:23 tobstone joined #salt
17:29 sjorge joined #salt
17:40 justanotheruser joined #salt
17:49 nicksloan joined #salt
17:50 Trauma joined #salt
17:51 Praematura joined #salt
17:52 inetpro joined #salt
17:57 Trauma joined #salt
18:02 nicksloan joined #salt
18:10 alvinstarr joined #salt
18:24 cyborg-one joined #salt
18:30 onlyanegg joined #salt
18:35 Trauma joined #salt
18:52 ronnix joined #salt
18:53 nicksloan joined #salt
18:56 onlyanegg joined #salt
19:12 drewbert joined #salt
19:12 drewbert I verified that even with explicit TCP keepalive settings, the zeromq transport will not survive AWS's firewall.
19:13 drewbert I'm going to try the TCP transport. Hopefully it will demonstrate better keepalive behaviour.  It wouldn't be so bad if the minion automatically reconnected, but it just idles there in a disconnected state.
19:14 iggy at job-- we had similar issues with GCE's firewall
19:14 iggy we ended up going with multiple masters
19:16 systeem joined #salt
19:25 absolutejam XenophonF: this is for custom Salt modules though
19:25 absolutejam Such as returners or engines
19:26 absolutejam I mean, I could create a state for it no problem, but that means i need to do a state.apply as well as a saltutil.sync to ensure it's all synced
19:35 fracklen joined #salt
19:46 iggy absolutejam: https://docs.saltstack.com/en/latest/ref/file_server/dynamic-modules.html
19:46 iggy that's all the supported _foo dirs
19:47 iggy if you need something other than what's there, yeah, you're going to have to lay it down some other way
19:48 iggy the notable exceptions are master only things (runners, ext_pillar, etc)
19:48 CEH joined #salt
19:52 fracklen joined #salt
19:52 drewbert iggy: multiple masters solved your connection keepalive issues?
19:54 absolutejam There's no reason I can't put dependent modules in there though?
19:54 absolutejam iggy:
19:55 absolutejam I assumed it would work because I thought it just synced entire folders
19:56 iggy drewbert: in a way... we were connecting all of our minions back to 1 master in a different project... after we went with multiple masters (1 per project), we stopped doing that
19:56 iggy absolutejam: define dependent modules...
20:01 drewbert iggy: interesting
20:03 absolutejam basically something pulled from pypi iggy
20:04 absolutejam Eg. if I have a returner that uses a module that I install via. pip
20:04 Praematura joined #salt
20:06 fracklen joined #salt
20:06 cgiroua joined #salt
20:20 iggy oh...
20:21 iggy you can't put regular python modules (i.e. from pip) in _dirs
20:21 iggy that's not in the python path so it won't be found
20:33 CEH joined #salt
20:55 onlyanegg joined #salt
21:08 andi- joined #salt
21:25 patrek joined #salt
21:30 Guest34108 joined #salt
21:30 Guest34108 left #salt
21:30 drewbert joined #salt
21:36 snc joined #salt
21:38 ronnix joined #salt
22:04 drewbert How can I tell salt to use aes instead of clear?
22:10 XenophonF joined #salt
22:13 iggy you should be more specific... salt has a lot of moving parts
22:18 buu I'm back part 85
22:18 buu ubuntu still won't talk to master
22:19 edrocks joined #salt
22:19 buu http://paste.debian.net/plain/973283
22:19 drewbert Eh, turns out that wasn't the problem anyway.  I have a minion that's connecting the the master without issue and another that won't connect.   Here are there versions: https://gist.github.com/anonymous/e12bc66500d0d8451a890861247565ef
22:23 buu I've verified ping works, I can connect to 4505/6 with netcat
22:23 buu The master can both see and accept new keys from the minion
22:23 drewbert buu: yeah, same for me
22:24 drewbert I should also note that zeromq "works" for me
22:24 drewbert but the tcp transport does not
22:28 buu drewbert: how did you test that?
22:28 buu The output is basically identical on another machine that works, same lan
22:29 buu even same aes value
22:30 drewbert Yeah, I've got two minion machines at my desk, and a master at aws.  I set them all to zeromq, turned them all on in the foreground with -l debug.  Watched them all for.  Set them all to use the TCP transport. Turned them all on in the foreground with -l debug.  Only one of the machines reponded to a test.ping.
22:30 buu nice
22:30 buu =[
22:30 buu What transport options are there?
22:31 drewbert zeromq, tcp, and raet
22:31 drewbert I run into timeout issues with zeromq.  Amazon doesn't respect tcp keepalives.
22:31 drewbert I can't get the TCP transport to work on the my target device.
22:32 drewbert I hear bad things about raet.
22:32 drewbert Salt is pretty fantastic at masterless configuration management, but I've got to admit, its transport layers are pretty embarrassing.
22:34 drewbert Here's my failing gist: https://gist.github.com/anonymous/95e7a933a23a7d0a4d09152f7798cd82
22:35 drewbert I modified minion.py to log.exception the underlying exception (my only change)
22:35 buu drewbert: have you tried turning on zeromq logging?
22:35 buu I just learned that this existed
22:35 drewbert buu: That failure is for the tcp transport.  The zeromq transport annoyed me because there was no builtin keepalive mechanism that worked for aws.
22:37 drewbert Basically what this guy is saying: https://github.com/saltstack/salt/issues/12540
22:38 buu Oh, I thought it always used zeromq at some level
22:47 drewbert Le sigh
22:48 nona joined #salt
22:52 onlyanegg joined #salt
22:59 jmiven joined #salt
23:16 drewbert Why does salt try to send commands to minions that have never connected? Seems it could just say "minion7: not connected" instead of "[no response]"

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary