Perl 6 - the future is here, just unevenly distributed

IRC log for #salt, 2016-02-16

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 malfaitc joined #salt
00:04 bet0x joined #salt
00:06 malfaitc so it looks like salt can easily plug into any authentication system.  i was curious if most handle authorization via acl?  https://docs.saltstack.com/en/latest/topics/eauth/access_control.html
00:07 malfaitc or is there a better way?
00:13 keimlink joined #salt
00:23 tweakism I am seeking thoughts & feedback on https://github.com/saltstack/salt/issues/30274#issuecomment-184272251
00:23 saltstackbot [#30274]title: Hide binary contents in pillar.{get,item,items} by default | Given https://github.com/saltstack/salt/pull/30268, more people are likely to start using the file_tree external pillar to store binary data....
00:27 aagbds joined #salt
00:29 jfelchner joined #salt
00:30 jfelchner tweakism just wanted to come back in and say the node groups worked amazingly. Thanks again. :) You ever get started with your Python thing?
00:34 tweakism yeah
00:34 tweakism jfelchner: I wanted to ask you, what version of file_tree are you using?
00:34 jfelchner Ummm.... I'm on the very latest salt version that bootstrap installs.
00:34 tweakism 'cause as far as I can tell 2015.8.{4,5} file_tree.py has a nasty bug in it
00:35 tweakism jfelchner: do you any of your files in your file tree end with \n?  (this would be the default for unix text files)
00:35 bearonis left #salt
00:35 jfelchner Yes. Absolutely.
00:35 tweakism and it works?
00:35 jfelchner They're both SSH keys.
00:36 bearonis joined #salt
00:36 jfelchner Yessir
00:36 nyx_ joined #salt
00:36 jfelchner I mean they show up when I do `pillar.get` from the CLI
00:36 tweakism ah, another question: do you have any files at the level of root_dir/nodegroups/all/file.txt  or are they all deeper than that?
00:36 jfelchner They're all deeper than that.
00:36 tweakism AHA
00:37 jfelchner ;)
00:37 tweakism jfelchner: could you be kind enough to do me a favor, and try a file at that level, that ends with a \n ?
00:37 jfelchner np
00:37 tweakism you can create one with vim, or do in shell:   printf 'Test\n' > root_dir/nodegroups/all/file.txt
00:37 tweakism some editors don't do end-of-file \n correctly, so be careful.
00:37 tweakism oh, or I guess you could just add several blank lines at the end, too; whichever
00:38 jfelchner tweakism what am I looking for?
00:38 tweakism jfelchner: the data shouldnt end up in pillar (can use pillar.items to see) and you should get an exception in the log
00:38 Muchoz joined #salt
00:39 aagbds joined #salt
00:40 tzero joined #salt
00:40 jfelchner Not sure about the log, but I can confirm that adding a file with `blah\n\n` to the root of the `pillar_ext` root causes all of the other files to be skipped.
00:41 jfelchner Removing that file and refreshing pillar makes everything work again
00:41 iceyao joined #salt
00:41 jfelchner Really glad I didn't have any on the root or I would have gone crazy trying to figure out what I was doing wrong hahahaha
00:43 antpa joined #salt
00:44 tweakism that's exactly what I've been doing for the last 2 days
00:45 tweakism 'cause I was sure that if it was so broke it doesn't work at all, it couldn't have been missed by everyone else
00:45 tweakism so I've been skeptical that I actually found a bug
00:45 tweakism and thinking I was doing it wrong
00:45 tweakism :)
00:46 dyasny joined #salt
00:49 tweakism omg thank you so much jfelchner, that has been bugging me silly;  mine is working w/ the un-fixed file_tree.py now :)
01:00 iceyao joined #salt
01:04 tweakism whytewolf: also, that works, for the directories.
01:05 whytewolf tweakism: nice
01:05 tweakism perfectly, even.
01:08 jfelchner tweakism :)) np
01:08 whytewolf perfectly is even better
01:09 dlam joined #salt
01:09 tweakism whytewolf: this is what works:  http://paste.debian.net/390197/
01:09 tweakism now, to see if I can do the same thing, except w/ lines in file, instead of files in a directory :)
01:09 whytewolf humm. that I am not sure of. file.line can be tricky
01:10 tweakism well, actually; any such fail I might need to make can be done exactly this way, with a file.d/ directory
01:10 iceyao_ joined #salt
01:11 traph joined #salt
01:12 tweakism *any such file
01:18 xstra joined #salt
01:19 rotbeard joined #salt
01:21 joe_n joined #salt
01:26 nyx_ joined #salt
01:27 Tyrm joined #salt
01:29 kevinquinnyo joined #salt
01:30 kevinquinnyo joined #salt
01:30 kevinquinnyo joined #salt
01:31 kevinquinnyo joined #salt
01:34 Shirkdog joined #salt
01:36 sk_0 joined #salt
01:36 brianfeister joined #salt
01:50 malinoff joined #salt
01:57 brianfeister joined #salt
01:59 rotbeard joined #salt
02:05 jaybocc2 joined #salt
02:06 malfaitc joined #salt
02:13 xstra joined #salt
02:14 onlyanegg joined #salt
02:15 iceyao joined #salt
02:15 catpigger joined #salt
02:17 antpa joined #salt
02:24 yjmbo joined #salt
02:26 donmichelangelo joined #salt
02:28 antpa joined #salt
02:30 betatron joined #salt
02:32 yjmbo I'm confused with my reactor setup - I'm trying to run a task when a new minion has its key accepted (manually). The reactor fires on 'salt/key', and I can see the sls file being rendered (running salt-master -l debug at the moment). I can see command being published ("[DEBUG   ] Published command details {'tgt_type': 'glob', 'jid': '20160216151952039873', 'tgt': 'jim-t1.example.com', 'ret': '', 'user': 'saltmaster', 'arg': ['new_ssh_host_keys'], 'fun':
02:33 sauvin joined #salt
02:33 betatron what dependencies must be installed to get ec2 driver dependencies working in centos 7?
02:33 betatron docs are quiet on that front
02:36 tweakism betatron: for the apt packages, they have depends/recommends/suggests metadata.
02:37 tweakism I can't remember if rpm/yum has the same.
02:37 tweakism betatron: you could also look at the files in the requirements/ directory of the source tree.
02:37 tweakism betatron: those are various dependencies, as pipy package names.
02:38 rideh joined #salt
02:38 rideh joined #salt
02:40 brianfeister joined #salt
02:41 betatron tweakism: thanks, was hoping for a shorter fishing trip since centos 7 and all. also, while apt packages have metadata not sure which level (recommends, suggest) is required for ec2 driver
02:42 tweakism depends is stuff you need, recommends is stuff you usually also need, suggests is stuff you may also want.
02:46 tweakism by default, recommends will be auto-installed and suggests won't.
02:46 tweakism I turn off both and manually look through package's recommends and suggests
02:46 tweakism you can usually tell what's relevant to you and what isn't.
02:46 evle joined #salt
02:46 tweakism betatron: if I had to guess, I'd guess python-botocore and python-libcloud (debian names)
02:48 ilbot3 joined #salt
02:48 Topic for #salt is now Welcome to #salt! | Latest Version: 2015.8.5 | Register for SaltConf16: http://saltconf.com/register/ | Paid support available for open source Salt! https://www.saltstack.com/support/ | Logs: http://irclog.perlgeek.de/salt/ | Paste: https://gist.github.com/ (please don't multiline paste into channel) | Ask with patience as we are volunteers and may not have immediate answers
02:48 betatron yep, libcloud is installed and so is python-boto. however, python2-boto3 is dependent on python-botocore.
02:51 malinoff joined #salt
02:52 pdayton joined #salt
02:54 pdayton joined #salt
02:57 beardedeagle joined #salt
02:58 rideh joined #salt
03:05 beardedeagle joined #salt
03:07 rideh joined #salt
03:08 pdayton joined #salt
03:09 favadi joined #salt
03:16 neilf__ joined #salt
03:19 scarcry joined #salt
03:21 malinoff joined #salt
03:24 yjmbo left #salt
03:27 llua joined #salt
03:29 Tyrm joined #salt
03:32 aqua^c_ joined #salt
03:37 racooper joined #salt
03:38 karlthane joined #salt
03:43 jaybocc2 joined #salt
03:51 anmol joined #salt
04:03 treaki joined #salt
04:05 malinoff joined #salt
04:11 catpigger joined #salt
04:18 srinivas joined #salt
04:20 joe_n joined #salt
04:23 ramteid joined #salt
04:32 brianfeister joined #salt
04:44 iceyao joined #salt
04:47 pppingme joined #salt
04:50 Vishvendra joined #salt
04:54 joe_n joined #salt
04:59 viq joined #salt
04:59 voidspacexyz joined #salt
05:00 catpigger joined #salt
05:06 voidspacexyz1 joined #salt
05:10 voidspacexyz1 joined #salt
05:12 iceyao_ joined #salt
05:18 iceyao joined #salt
05:27 anmol joined #salt
05:32 Tyrm joined #salt
05:36 favadi joined #salt
05:37 rdas joined #salt
05:41 fracklen joined #salt
05:42 pdayton joined #salt
05:44 joe_n joined #salt
05:45 jaybocc2 joined #salt
05:56 iceyao joined #salt
05:57 iceyao_ joined #salt
05:57 hasues joined #salt
05:57 hasues left #salt
05:59 iceyao__ joined #salt
06:02 iceyao joined #salt
06:09 jhauser joined #salt
06:13 voidspacexyz1 joined #salt
06:17 voidspacexyz1 joined #salt
06:21 brianfeister joined #salt
06:23 voidspacexyz1 joined #salt
06:28 brianfeister joined #salt
06:35 rogst joined #salt
06:48 felskrone joined #salt
06:52 voidspacexyz1 joined #salt
07:00 kevinquinnyo joined #salt
07:01 notreallyhere joined #salt
07:03 kevinquinnyo joined #salt
07:13 stqism left #salt
07:20 iceyao joined #salt
07:24 slav0nic joined #salt
07:29 linjan joined #salt
07:30 colegatron joined #salt
07:32 opdude joined #salt
07:34 Tyrm joined #salt
07:42 is_null joined #salt
07:42 sjorge joined #salt
07:42 sjorge joined #salt
07:43 Pluggi joined #salt
07:44 jeffspeff joined #salt
07:45 jaybocc2 joined #salt
07:46 jcastle joined #salt
07:46 rnts joined #salt
07:46 jeblair joined #salt
07:47 jgelens joined #salt
07:47 aRkadeFR joined #salt
07:49 ffredrikk joined #salt
07:49 Gabemo joined #salt
07:51 traph joined #salt
08:00 fxhp joined #salt
08:05 josuebrunel joined #salt
08:06 rubendv joined #salt
08:06 rubendv joined #salt
08:11 dariusjs joined #salt
08:12 voidspacexyz1 joined #salt
08:13 kevinquinnyo joined #salt
08:14 atmosx joined #salt
08:23 fracklen joined #salt
08:30 kawa2014 joined #salt
08:31 fredvd joined #salt
08:35 impi joined #salt
08:38 CrummyGummy joined #salt
08:39 brianfeister joined #salt
08:43 garphy joined #salt
08:46 patchedmonkey joined #salt
08:46 jaybocc2 joined #salt
08:51 iceyao_ joined #salt
08:59 kevinquinnyo joined #salt
09:00 Tyrm joined #salt
09:02 Rumbles joined #salt
09:09 voidspacexyz1 joined #salt
09:13 s_kunk joined #salt
09:14 Xevian joined #salt
09:14 rmnuvg joined #salt
09:16 rubendv joined #salt
09:16 rubendv joined #salt
09:20 ronnix joined #salt
09:25 KermitTheFragger joined #salt
09:25 pcdummy joined #salt
09:25 pcdummy joined #salt
09:27 MadHatter42 joined #salt
09:27 wwwbukolaycom joined #salt
09:28 Glasswlkr joined #salt
09:38 chiui joined #salt
09:44 treaki joined #salt
09:50 MadHatter42 joined #salt
09:50 Vishvendra1 joined #salt
09:56 antpa joined #salt
09:58 hlub joined #salt
09:59 Erik-p joined #salt
09:59 Erik-p hi all anyone can help with boto?
10:00 Erik-p 'boto_elb' __virtual__ returned False
10:00 jhauser joined #salt
10:03 hlub Erik-p: do you have the required version of boto installed?
10:04 Erik-p no i am new to this do i need to install boto with pip on the vm?
10:04 hlub it seems to require version 2.33.0
10:05 Erik-p so i need to install pip on all my servers, pip state for boto?
10:05 MadHatter42 joined #salt
10:06 hlub isn't it included in any package repository of your system?
10:07 hlub I know nothing about boto.
10:08 test joined #salt
10:09 Guest18023 left #salt
10:09 babilen Erik-p: Which distribution are you deploying on?
10:11 Erik-p for now windows but i like it to work on all. what i want to do is to use salt orch to upgrade my frontend, build an orch to use boto to remove vm from elb, upgrade and add it back to elb
10:12 babilen No idea about system packages for Windows. Guess that it still doesn't have proper repositories, so pip is probably the way to go
10:13 amcorreia joined #salt
10:17 Vishvendra1 joined #salt
10:18 cyborg-one joined #salt
10:26 jhauser joined #salt
10:28 brianfeister joined #salt
10:30 favadi joined #salt
10:32 rubendv joined #salt
10:32 rubendv joined #salt
10:34 antpa joined #salt
10:38 giantlock joined #salt
10:42 rotbeard joined #salt
10:42 MadHatter42 joined #salt
10:43 pcdummy joined #salt
10:43 pcdummy joined #salt
10:47 jaybocc2 joined #salt
10:47 pjammer joined #salt
10:48 antpa joined #salt
10:51 brianfeister joined #salt
10:54 totzky joined #salt
11:02 Tyrm joined #salt
11:12 elsmo joined #salt
11:14 ronnix joined #salt
11:21 a7p left #salt
11:27 Erik-p after install boto with pip when i run boto module i get NameError: global name '__salt__' is not defined
11:30 hlub what do you mean by running the module?
11:30 Erik-p salt myhost boto_elb.get_instance_health elbxxxx
11:39 zz_Cidan joined #salt
11:39 Cidan joined #salt
11:44 opdude @Erik-p that sounds like a bug in the module
11:47 elsmo Hi all. I have a little helper sls file that maps various jinja variables to grains depending on pillar data (ie I can use {{ minion_public_ip }} which might be eth0 or eth1 depending on the provider, and that is handled in the helper sls. This works well for state, but I want to use this file in pillar as well. Can I import sls files from the state root into pillar?
11:48 elsmo or maybe, this information should really be stored in the pilar to start with anyway, and then just "got" from there.
11:53 MadHatter42 joined #salt
11:53 MadHatter41 joined #salt
12:01 babilen elsmo: fwiw, I'd recommend to use network.ip_addrs with a suitable cidr mask for that. Bonus points for using the mine if you require information about other minions.
12:01 babilen elsmo: See https://docs.saltstack.com/en/latest/topics/mine/#mine-functions-aliases for information on the latter
12:03 elsmo babilen: This is less how to do it, and more where these helpers should live.
12:04 elsmo http://pastebin.com/Zfz23EWc  is an example of an sls file I include with seom state. It abstracts away the networking, so someone else can say hey, I want this state to have this file looking like this, and it should have the boxes public IP in it, instead of them having to know which interface on the box is the public one
12:05 babilen pastebin.com is horrible, please use one of http://refheap.com, http://paste.debian.net, https://gist.github.com, http://sprunge.us, …
12:05 babilen Sounds as if you want to make that "utils" and have them live in _utils
12:06 elsmo babilen: well thats what I have at the moment, I was wondering if i can then import utils into pillar as well as state files?
12:06 babilen elsmo: Yes, and I am saying that using grains to get IP addresses is horrible, as that requires knowledge about interfaces that simply doesn't matter. Just use network.ip_addrs with suitable cidr masks for that purpose.
12:07 babilen If you make it mine functions you can use a runner to get that information in pillars: https://docs.saltstack.com/en/develop/ref/modules/all/salt.modules.mine.html#salt.modules.mine.get
12:07 babilen But you can also use utils in pillars
12:13 JPT joined #salt
12:14 elsmo Hmm. And your dislike of using the grains like that is because if you use a cidr mask, it is targeting the network, not which interface happens to be plugged into the network?
12:16 rm_jorge joined #salt
12:19 antpa joined #salt
12:21 babilen elsmo: indeed
12:22 babilen elsmo: I typically include a mine function alias for each private ip4 cidr range + all subsets therefore for semantic networks (/24 /23 ..)
12:23 quasiben joined #salt
12:23 lionel joined #salt
12:24 elsmo babilen: I see your point, though a counterpoint could be that in cloud infrastructure, IPs vary more than which interface is which.. on a VM move for example. so if you get a new IP range you need to update those cidr masks right?
12:24 elsmo I guess which interface is which could also change, though I have not seen that happen as of yet..
12:25 babilen elsmo: In that case you might want to write a custom grain or external pillar that queries your cloud providers API akin to https://github.com/saltstack/salt-contrib/blob/master/grains/ec2_info.py
12:25 elsmo babilen: ahh, nice.
12:26 babilen I'm not saying that it is the solution to everything, but so far I am very happy with my choice to base logic such as this on CIDR and provide those CIDR masks in a "net" pillar. That way I have to change it at one place if it changes.
12:27 elsmo babilen: yeah, fair enough.
12:27 elsmo babilen: thanks :)
12:28 babilen having said all that: Look into utils for your "utilities"
12:28 LondonAppDev joined #salt
12:36 felskrone joined #salt
12:40 ingslovak joined #salt
12:40 Erik-p cant make boto work on linux and windows need some help
12:41 Erik-p install boto 2.38.0 and IAM role to the vm
12:41 Erik-p salt xxxx boto_elb.get_instance_health xxxxx
12:41 Erik-p 'boto_elb' __virtual__ returned False
12:44 evle joined #salt
12:48 jaybocc2 joined #salt
12:54 rubendv joined #salt
12:56 babilen Erik-p: You might have forgotten to install the necessary modules: See https://github.com/saltstack/salt/blob/develop/salt/modules/boto_elb.py#L76
12:58 pdayton joined #salt
12:59 Erik-p ok i will check it thanks on windows i fixed it by downloading the modules.boto_elb from dev
13:00 rem5 joined #salt
13:02 ronnix joined #salt
13:04 Tyrm joined #salt
13:05 Erik-p i need a direction if i like to make an orch to highstate all my servers with grain.item X 1 by 1 (not using salt -b). like jinja loop to bring all servers with grain.item X
13:05 srinivas joined #salt
13:09 nethershaw joined #salt
13:10 JDiPierro joined #salt
13:11 rdas joined #salt
13:13 JDiPierro joined #salt
13:13 MadHatter42 joined #salt
13:14 giantlock joined #salt
13:14 nyx_ joined #salt
13:28 akhter joined #salt
13:28 akhter joined #salt
13:29 Erik-p can i run orchestration with - tgt: '*' but it will run 1 by 1?
13:30 XenophonF hey does anyone here use salt-formula for configuring salt formulas on their master?
13:31 XenophonF i'm getting a weird error in the formula after updating my fork :-/
13:32 XenophonF would it be too much to ask for the renderer to emit line numbers at which errors occur?
13:35 XenophonF god dammit the structure of the salt_formulas:list dict changed in a backwards-incompatible way
13:36 XenophonF who's bright idea was that?
13:40 babilen XenophonF: Let's find out!
13:40 XenophonF i found it
13:41 XenophonF i'm going to patch thomaslarsen's changes such that they check whether salt_formulas:list:ENVIRONMENT_NAME is a dict or a list
13:41 XenophonF if it's a dict, new behavior
13:41 XenophonF if it's a list, old behavior
13:44 jhauser joined #salt
13:50 dyasny joined #salt
13:52 ronnix joined #salt
13:55 fredvd joined #salt
13:58 bhosmer joined #salt
13:58 DammitJim joined #salt
14:00 rem5 joined #salt
14:02 JDiPierro joined #salt
14:02 subsignal joined #salt
14:02 XenophonF what really grinds my gears is the handwavey "oh this breaks people's existing configs but whatever" in the pull request
14:04 JDiPierro joined #salt
14:08 pdayton joined #salt
14:09 cpowell joined #salt
14:12 numkem joined #salt
14:15 toastedpenguin joined #salt
14:16 rem5 joined #salt
14:18 numkem_ joined #salt
14:20 krymzon joined #salt
14:21 antpa joined #salt
14:21 numkem_ joined #salt
14:21 mpanetta joined #salt
14:24 bhosmer joined #salt
14:25 numkem_ joined #salt
14:31 zsoftich4 joined #salt
14:31 jcristau joined #salt
14:33 numkem joined #salt
14:34 ffredrikk Trying to get reactor to work, and initiate highstate when any minion starts up. I've been following the docs. Nothing happens. What am I missing? The minion is Windows based. I see nothing happening when viewing the events.
14:39 winsalt joined #salt
14:45 Tyrm joined #salt
14:48 jaybocc2 joined #salt
14:50 zmalone joined #salt
14:54 andrew_v joined #salt
14:54 lompik joined #salt
14:58 M-MadsRC joined #salt
15:00 MadHatter42 joined #salt
15:00 XenophonF https://github.com/saltstack-formulas/salt-formula/issues/201
15:00 saltstackbot [#201]title: Existing salt.formulas configurations broken by recent pull request | Pull request #200 changed how this formula manage formulas on Salt masters in a backwards-incompatible way.  This causes the `salt.formulas` SLS to fail on masters that use the old-style format of the `salt_formulas:list` Pillar key, which mapped environments to lists of formulas to be cloned, with errors similar to the following:...
15:02 XenophonF I guess for now, I'm going to locally back out that pull request.
15:02 _JZ_ joined #salt
15:02 hasues joined #salt
15:02 hasues left #salt
15:04 jespada joined #salt
15:05 hlub Which one is more preferred way to go when implementing module functions: 1) return True/False status and log errors/info for simple actions or 2) raise an exception on error?
15:07 XenophonF hlub: #1 i think
15:07 XenophonF exceptions can break things for other states/modules in ways that can be surprising
15:12 racooper joined #salt
15:14 amcorreia joined #salt
15:15 M-liberdiko joined #salt
15:17 giantlock joined #salt
15:17 beardedeagle joined #salt
15:17 Hetman joined #salt
15:18 Hetman Hello, can anyone advise what I'm missing here: http://pastebin.com/63nk4aYt
15:21 dunz0r Hetman: Shouldn't it be set os_map = [ ?
15:23 Hetman dunz0r: ok its [] not an list an I need a dict ? key: value ?
15:24 XenophonF https://github.com/saltstack-formulas/salt-formula/pull/202
15:24 saltstackbot [#202]title: Revert PR #200 | This restores the original structure/behavior of the `salt_formulas` Pillar key.  Please refer to discussion in issue #201.
15:24 antpa joined #salt
15:24 XenophonF OK back to real work now
15:25 srinivas joined #salt
15:25 dunz0r Hetman: Hmm, didn't see that. Never mind then
15:29 elsmo babilen: Don't suppose you could point be in the direction of any _utils docs? I can't find much info, slightly unclear if this is a dir I should create, where it should reside etc..
15:30 babilen elsmo: No idea .. it is one of those many _$FOO directories like _modules, _states, ... and so on
15:30 babilen You might want to take a look at https://github.com/saltstack/salt/tree/develop/salt/utils for inspiration
15:32 mapu joined #salt
15:33 elsmo so these dirs would live inside the salt installation dir? IE, /usr/lib/python2.7/dist-packages/salt/_utils/ for example?
15:33 Brew joined #salt
15:33 elsmo babilen: apologies, but I can't find any dirs that start with an underscore..
15:34 babilen elsmo: no, no, noooo! They would live in file_roots (e.g. /srv/salt/_utils or your git repo if you use GitFS)
15:34 babilen These directories are used to provide your own state or module implementations (and will be synced with saltutil.sync_all or the respective specific functions)
15:35 bowhunter joined #salt
15:35 tpaul joined #salt
15:36 babilen https://docs.saltstack.com/en/latest/ref/modules/#modules-are-easy-to-write has some information for modules, but there's also _states, _utils and so on ...
15:36 babilen https://github.com/saltstack/salt/issues/31206 is a bug you might find interesting in that context
15:36 saltstackbot [#31206]title: Document all the custom module "_dirs" settings | (Hat-tip to Tom and Pedro.)...
15:37 elsmo babilen: ahhh, that makes more sense :)
15:39 RandyT Greetings, curious if anyone has thoughts about how to further debug this or are having similar issues. Note I am more focused on the update I just added to this issue. https://github.com/saltstack/salt/issues/28286
15:39 saltstackbot [#28286]title: hash formats required for s3 source conflict with error message and other uses of file hashes | When referencing an s3:// source for file hashes an error message will be emitted stating that the file format should be 'hashtype=hash', even when the file is provided in that format....
15:41 srinivas_ joined #salt
15:43 morissette joined #salt
15:43 fracklen joined #salt
15:43 subsignal joined #salt
15:44 mapu joined #salt
15:46 pagurus joined #salt
15:47 armguy What would be the best way to sort out why all the sudden I am seeing this error.. [ERROR   ] Template was specified incorrectly: False
15:47 pagurus left #salt
15:52 bonzibuddy joined #salt
15:59 numkem joined #salt
16:01 alinuxninja For those who post formulas out for public use, how do you normally specify documentation on what info is required in the pillars, and what it does/etc?
16:01 AndreasLutro pillar.example
16:02 alinuxninja so normally, there is no need to indicate what the options actually do?
16:02 Hetman is there is somewhere in documentation when I can get: failed: mapping values are not allowed here ?
16:02 AndreasLutro you can add yaml comments to the example
16:02 AndreasLutro Hetman: you've got invalid yaml
16:02 alinuxninja ah, I see.
16:02 alinuxninja thanks @AndreasLutro
16:03 jfindlay Ashald: your pull request seems fine to me
16:04 Hetman AndreasLutro: http://pastebin.com/6MxaRQQz sorry I'm lost , is there is any way to trace that back ?
16:04 nZac joined #salt
16:05 shaggy_surfer joined #salt
16:05 catpig joined #salt
16:06 mr_chris joined #salt
16:06 whytewolf hetman that should be service.running not service: running
16:06 MadHatter42 joined #salt
16:06 elsmo babilen: Sorry for all the silly questions, just finding this a little hard to understand. I run both the salt states and pillar using gitfs, and I have 'gitfs_root: salt' set in my master conf, and in there I have added the _utils dir, and placed in there 'helpers.sls' however the jinja import statement can't seem to see it when rendering the pillar. Does it have to be a python module? or I'm using the ext_pillar setting
16:06 elsmo pointing to a pillar sub dir, so maybe it can't find the _utils folder..
16:07 mr_chris In the past, Salt Cloud used to provision CentOS7 with the Salt Copr repo using copr-be.cloud.fedoraproject.org. Today, I provisioned a new machine and it's using repo.saltstack.com.
16:07 Hetman whytewolf: thanks
16:07 babilen elsmo: It would have to be a Python modules, yes
16:07 mr_chris Is the copr repo depricated now? I has an older version of than repo.saltstack.com.
16:07 mr_chris *deprecated
16:08 LondonAppDev joined #salt
16:09 M-MadsRC joined #salt
16:09 Ashald @jfindlay thanks! what do I need to do to have it merged? :)
16:10 babilen :)
16:11 babilen Ashald: Still nothing?
16:11 Ashald yeah :(
16:11 beardedeagle anyone already poc'd slatstack -> vault -> consul for secrets?
16:11 beardedeagle Working on it now, but would love to draw from any existing working implementation
16:11 Ashald that our plan...
16:11 Ashald for future
16:12 Ashald for now working on improving Consul Pillar for Salt Stack
16:12 spiette joined #salt
16:13 babilen beardedeagle: Sounds like something that is urgently needed
16:13 Ashald I'm planning to push PRs with multi-dc support based on pillarenv + customizable de-serializers for data from Consul KV
16:13 Ashald and then create a de-serializer that will lookup data from Vault
16:13 Ashald at least, that's how I imagine it
16:14 Ashald something like, if there is a value like vault://secrets/foo/bar that the actual value will be extracted from Vault
16:14 Ashald though maybe there are better ways to do that...
16:14 babilen +1
16:14 voidspacexyz joined #salt
16:14 Ashald also would be great to utilize Consul UI for putting data into Vault
16:14 beardedeagle @babilen: You still have a single secret local to the minion or application, but from there it is much better from a security standpoint then just pillars on the server/git, even if they are gpg encrypted
16:15 Ashald still have no idea how to do that but  something like: monitor some folder in Consul and once key is created there delete original value from Consul and replace with encrypted with Vault
16:16 Ashald but for all of that happen I first need to have https://github.com/saltstack/salt/pull/31187 merged :)
16:16 saltstackbot [#31187]title: Full control over client options in Consul pillar |
16:16 beardedeagle @Ashald: not sure if there are better ways yet. This is very early POC for me on the subject. We just need a better way to distribute secrets here.
16:16 Ashald yeah, the same goes for us
16:17 Ashald but rather than investing into some in-house solutions I'd rather give a try to Consul + Vault + Salt and contribute it to FOSS
16:17 Ashald at least, that's my plan :)
16:17 vpm joined #salt
16:18 babilen Ashald: I see that you've pinged the usual suspects already .. lets see what comes of that
16:18 Ashald :)
16:18 Ashald thanks ^^
16:18 Ashald for your support :)
16:19 ronnix joined #salt
16:20 adelcast left #salt
16:22 adelcast joined #salt
16:22 giantlock joined #salt
16:23 JDiPierro joined #salt
16:24 JDiPierr_ joined #salt
16:24 nyx_ joined #salt
16:25 antpa joined #salt
16:26 jimklo joined #salt
16:26 M-MadsRC joined #salt
16:26 debian112 left #salt
16:27 debian112 joined #salt
16:29 Brew joined #salt
16:30 mpanetta Is there anywhere I can find more documentation on the ssh_interface option for salt-cloud besides here: https://docs.saltstack.com/en/latest/topics/cloud/openstack.html
16:31 mpanetta Trying to get it to use the private IP on my VM but it is picking the wrong one.
16:40 impi joined #salt
16:40 fracklen joined #salt
16:43 M-liberdiko joined #salt
16:49 jaybocc2 joined #salt
16:51 malinoff joined #salt
16:51 johnkeates joined #salt
16:53 jfindlay Ashald: Mike has been doing pull requests lately
16:53 jfindlay it will probably get in sometime today
16:54 johnkeates left #salt
16:54 beardedeagle @Ashald: I see a few attempts around getting a Vault sdb
16:55 beardedeagle May pickup where those dropped
16:55 Hetman Is that correct syntax in my sls file {{ salt['pillar.get']('osmajorrelease') }}  trying to use this to generate file path and salt returning failed type: got bool expected str to unicode convert
16:55 ecrane joined #salt
16:55 writtenoff joined #salt
16:56 Hetman fixed its grains not pillar
16:57 atmosx joined #salt
16:59 onlyanegg joined #salt
16:59 denys joined #salt
17:06 tzero joined #salt
17:06 johnkeates joined #salt
17:08 [afk]evinquinnyo hm, i've never had this problem before but salt-master can not see one of my minions, as shown in salt-key -L
17:09 kevinquinnyo i've restarted the minion and even the master, anyone know why that might be?
17:09 johnkeates joined #salt
17:09 kevinquinnyo i did change the hostname and the minion_id, not sure if the key is in some state of rejection and its just not showing, but i dont even see anything in the logs on minion or master regarding it yet
17:10 kevinquinnyo hey nm, it showed up finally -- there must be a cache invalidation timeout for keys that expired
17:10 kevinquinnyo or something
17:11 invalidexception joined #salt
17:12 babilen Ashald: You may continue ;)
17:14 Ashald great, thanks guys!
17:14 babilen No, thank you!
17:14 Ashald > <beardedeagle>@Ashald: I see a few attempts around getting a Vault sdb -- btw, nice idea, I didn't think about that
17:15 Ashald will consider it as well when I will get to Vault integration
17:15 Ashald if there won't be anybody who will implement it first
17:17 UtahDave joined #salt
17:18 BlackBishop joined #salt
17:19 BlackBishop any easy way to list all the runners and modules installed ?
17:19 elsmo Is pillar data rendered on the salt master? It seems that maybe the minion is not reporting the interface names correctly- my minion has em0, em1, em2 but the Master has this error when it tried to render: Interface "em1" not in available interfaces: "lo", "eth2", "eth1", "eth0"
17:19 cornfeedhobo joined #salt
17:19 cornfeedhobo does anyone know how to override a pillar value in state?
17:20 jettero cornfeedhobo: just ... don't use it?
17:20 jettero what do you mean precisely?
17:21 scoates joined #salt
17:22 kevinquinnyo elsmo: do you mean grains?
17:22 cornfeedhobo jettero: lets say you have a file.managed state with jinja inside the file that you expect to be filled in with pillar, but in this one single use case, you would like to change the pillar value only for that state, so it changes what is inserted into the file
17:23 elsmo kevinquinnyo: I have "minion_public_ip: {{ salt.network.interface_ip('em1') }}" in my pillar file, and the master log complains em1 is not an interface name..
17:24 BlackBishop salt \* saltutil.sync_all doesn't show up anything
17:25 jhauser joined #salt
17:25 heaje joined #salt
17:28 kevinquinnyo elsmo: from the salt-master command line, do you get an ip back if you issue salt whatever-minion-id network.interface_ip em1
17:28 kevinquinnyo if you get an ip back, then you might need to sync your pillar data with salt whatever-minion-id saltutil.sync_all
17:29 jettero cornfeedhobo: Yeah, in the state, you just query some other pillar or use the value you want to sub. Sorta where you go {{ salt['pillar.get']('pillar-key') }} just put something else
17:29 UtahDave elsmo: Yes, pillar data is rendered on the master, by design
17:29 jettero maybe I'm missing it
17:30 gtmanfred BlackBishop: i don't believe i know of one that is built in, but you can use awk
17:30 gtmanfred salt-run -d | awk -F "[' .]+" '/^[^ ]/ && !x[$2]++ {print $2}'
17:30 gtmanfred salt-call sys.doc | awk -F '[ .]+' '/^    [^ ]/ && !x[$2]++ {print $2}'
17:30 babilen elsmo: On the master (otherwise the minion would need access to all the data!)
17:30 BlackBishop shiny
17:31 BlackBishop thanks
17:31 gtmanfred np
17:31 babilen elsmo: Mine + runner in pillar starting to look better? ;)
17:32 elsmo kevinquinnyo: I do get an ip back from the minion when querying it from the master, and syncing pillar data did not fix it-same issue
17:32 elsmo babilen: heh
17:32 ffredrikk joined #salt
17:33 elsmo babilen: found this https://lemarchand.io/saltstack-and-internal-network-interfaces/ which is similar, but uses the grains system..
17:34 BlackBishop gtmanfred: weird enough it shows one runner that I have but not another
17:34 gtmanfred that should show all the runners that would be printed out with doc strings
17:35 gtmanfred which should be all the runners
17:35 babilen elsmo: Sure, that works. Using the mine comes with the added bonus that once you have it in place that you can easily obtain this information about *other* minions also.
17:35 gtmanfred if it isn't listed, then it is either not loaded, or might not have a doc string? not sure how salt handles runners that don't have a doc string
17:35 antpa joined #salt
17:36 elsmo babilen: ahh, as you said before, i see..
17:36 babilen elsmo: I mean it really boils down to "Use network.ip_addrs" and the question "Where do I need this information?"
17:36 JDiPierro joined #salt
17:37 elsmo babilen: in that example, is the code then living in _grains or similar folder?
17:41 cornfeedhobo jettero: hmmm. okay. not quite what i was shooting for, but i'll work around
17:42 krymzon joined #salt
17:47 dlam joined #salt
17:48 mapu joined #salt
17:50 jaybocc2 joined #salt
17:52 ZiLi0n joined #salt
17:52 ifattah Can someone point me to where SaltLoggingClass can possibly be extended to accept a custom LogRecord class?
17:52 ZiLi0n Hello everyone, is there a way to pass parameters from CLI to a sls state?
17:52 ifattah AttributeError: 'SaltLoggingClass' object has no attribute 'setLogRecordFactory'
17:53 invalidexception joined #salt
17:55 tligda joined #salt
17:56 akhter joined #salt
18:06 knite joined #salt
18:07 knite I'm using pkg.installed with a source argument. it seems to ignore changes to the file? eg, sources: my_package: salt://wherever/pkg_1.0.0_amd64.deb' will install, but if I bump that to pkg_2.0.0, it's not upgraded?
18:07 ageorgop joined #salt
18:09 UtahDave ZiLi0n: You can pass in pillar data on the CLI, which will get passed into your state.    `salt <minion id> state.hightstate  pillar='{"my_pillar_key": "my+pillar+val"}'
18:10 UtahDave knite: try using pkg.latest if you want it to upgrade.
18:11 knite UtahDave: pkg.latest doesn't take a source arg
18:12 ZiLi0n thanks UtahDave, so the only way to pass parameters is using the pillar
18:12 ZiLi0n ?
18:12 bearonis I'm experiencing a salt-minion hanging when on "Initializing new AsyncZeroMQReqChannel" when connecting to a master. I'm able to ping the master and have network connectivity on the minion. Any thoughts about what could cause this?
18:12 UtahDave ZiLi0n: Yeah, otherwise you'd use your regular pillar facilities to determine which minions get which data
18:13 ZiLi0n I see, ok.
18:13 ZiLi0n what about to pass parameter from a states to another states?
18:14 UtahDave knite: have you tried adding  refresh: True    ?
18:14 nyx_ joined #salt
18:16 UtahDave ZiLi0n: Can you explain what you're trying to accomplish?
18:16 knite UtahDave: just tried it, no difference
18:16 knite Looks like a known issue: https://github.com/saltstack/salt/issues/15240
18:16 saltstackbot [#15240]title: No way to update a package installed via "sources" and salt:// url | I have some locally compiled RPMs that I dumped in directory inside my Salt state, and installed using pkg.installed with a "sources" that uses a salt:// url. This worked great. However, I figured out that one of the package was missing the mysql-devel package when it was compiled. So I install that, rebuild all the RPMs, and then... There doesn't seem to be a
18:18 fracklen joined #salt
18:20 Heartsbane UtahDave: lunch some time this week?
18:20 Heartsbane I have a "work from home" day I need to burn
18:20 UtahDave knite: OK, I spoke with the guy who has done most of that.  He added code for that to work with yum, but it still needs to be added for apt.  He's going to pick up that ticket.
18:21 knite UtahDave: ...seriously?! That's great, thanks for doing that!
18:22 UtahDave you're welcome!
18:22 UtahDave Heartsbane: tomorrow or thursday would work for me
18:23 Heartsbane Thurday works for me
18:24 knite I tried a trick recommended in a different issue, which is to include the package version in the sources arg: sources: my_pkg_1.0.0: salt://.../. this did something bizarre - the package correctly updated, but salt threw an error - The following packages failed to install/update: <pkg>
18:25 UtahDave knite: lovely
18:25 knite is there any way to ignore the error and treat that state as successful? might bite me in the butt later, but ah well.
18:26 jaybocc2 joined #salt
18:26 brianfeister joined #salt
18:28 whytewolf knite: i have seen that kind of thing before. typically if the version doens't match exactly what the package manager says is the version once the update is compleated. it will try updateing every run cause it thinks it has the wrong version
18:29 knite whytewolf: hm...but I'm installing with source, so there's no version arg. the name arg is (supposed to be) just a name, salt doesn't know how to pull version info out of it.
18:29 shaggy_surfer joined #salt
18:34 whytewolf knite: true :/ in this case it might be that the installed package doesn't match the name in the end. result would be the same. since the package manegment isn't able to line up the info with what you are saying it should be. it will try installing it everytime even though it exists
18:35 numkem joined #salt
18:35 * Heartsbane blames robawt.
18:37 jfindlay knite: may be related: https://github.com/saltstack/salt/issues/30792
18:37 saltstackbot [#30792]title: Specifying version in pkgs list returns failure even though it succeeds (on Ubuntu) | If I have a state like the following:...
18:38 hightekvagabond joined #salt
18:43 patchedmonkey joined #salt
18:44 * robawt should be blamed by Heartsbane
18:45 akhter joined #salt
18:50 kevinquinnyo so i have an event-driven dns system, where new A records are added for new minions, but my dns server is also managed by salt.  I have it creating a default zone file when it's first being built, but from then on, I don't want salt to modify that file
18:51 kevinquinnyo i'm actually not even sure how i should handle that
18:51 mohae joined #salt
18:53 ajw0100 joined #salt
18:53 kevinquinnyo hmm maybe the events (minion coming alive) should not directly call the dns module, but rather should append pillar data, and then the module always builds dns records from the pillar data
18:54 ALLmightySPIFF joined #salt
18:56 UtahDave kevinquinnyo: both approaches can work, but I generally like your second idea and have the dns module build it's config from the same list.
18:56 * robawt highfives UtahDave
18:57 * UtahDave highfives robawt!
18:57 kevinquinnyo UtahDave: yeah i think that way it remains idempotent and dependent on salt's pillar for it's source of truth
18:57 baweaver joined #salt
18:57 spuder joined #salt
18:57 kevinquinnyo now I'm wondering how to set pillar from within salt
18:58 * kevinquinnyo googles
18:58 kevinquinnyo i know you can set grains dynamically
18:58 hal58th_ joined #salt
18:59 UtahDave back in a bit
18:59 baweaver joined #salt
18:59 bet0x joined #salt
19:00 pppingme joined #salt
19:01 bhosmer joined #salt
19:02 skullone_ joined #salt
19:02 kevinquinnyo ahhh ok i got it.  I'll write an ext_pillar to use for this
19:02 skullone_ quick question, is salt-cloud userdata "jinja-able"
19:02 skullone_ ie, add an fqdn to userdata, based on the instance name?
19:06 spuder joined #salt
19:08 pcdummy joined #salt
19:08 pcdummy joined #salt
19:09 baweaver joined #salt
19:11 elektrix joined #salt
19:11 pcdummy joined #salt
19:11 pcdummy joined #salt
19:12 knite joined #salt
19:12 pdayton joined #salt
19:12 akhter joined #salt
19:12 beardedeagle you guys know that the newest bootstrap fails to copy over minion config options in salt-cloud configs right? about to put in a pr to clean up some expressions around this that were causing the issue.
19:15 hal58th_ if there is no ticket, then they are not away of it
19:16 adelcast left #salt
19:17 alainv joined #salt
19:17 west575 joined #salt
19:17 foundatron joined #salt
19:18 alainv Anyone used the x509 module/state successfully? It keeps throwing me KeyErrors on the ca_server argument for certificated_managed
19:18 adelcast joined #salt
19:21 MindDrive joined #salt
19:22 elsmo joined #salt
19:24 notnotpeter joined #salt
19:27 mapu joined #salt
19:27 dlam is there a way to check if a given state has been run?   (i wanna check "rabbitmq.config")
19:27 jfindlay beardedeagle: by newest, do you mean the develop version?
19:27 beardedeagle yes
19:27 beardedeagle putting in PR now
19:27 jfindlay thanks
19:28 beardedeagle do you guys/gals use shellchecker against it at all?
19:28 kevinquinnyo [CRITICAL] Specified ext_pillar interface test_ext_pillar is unavailable
19:29 kevinquinnyo where does salt want this to be by default?  I have it in the my [file_roots]/_modules/ which i thought was the default location
19:29 kevinquinnyo i have a __virtual__() function that returns the string that matches my /etc/salt/master conf file
19:29 kevinquinnyo for the pillar opts
19:29 kevinquinnyo ext_pillar opts rather
19:30 jfindlay beardedeagle: yes, s0undt3ch has generally done bootstrap releases recently.  There should be info on that in the README, although I've not done it before
19:31 a7p joined #salt
19:31 beardedeagle PR in: https://github.com/saltstack/salt-bootstrap/pull/760
19:31 saltstackbot [#760]title: fixing syntax errors | PR fixes the following:...
19:33 numkem joined #salt
19:34 q1x joined #salt
19:34 numkem joined #salt
19:35 hightekvagabond joined #salt
19:36 patchedmonkey joined #salt
19:37 jorrel joined #salt
19:40 jorr joined #salt
19:40 kevinquinnyo ok so there is a default <file_root>/_modules/ and <file_root>/_states/ but *not* anything like <file_root>/_pillar ?  That means if you want to create a custom ext_pillar you must stop using the underscore directories, and set a specific extension_modules in the salt master conf?
19:40 akhter joined #salt
19:40 kevinquinnyo or put your ext_pillar directly into the system path where salt code lives?
19:41 hightekvagabond joined #salt
19:42 jfindlay kevinquinnyo: yes, unfortunately, the master uses a different custom plugin config/format from minions
19:42 jfindlay although this was changed recently
19:42 beardedeagle Just released everything I contribute to or plan to in the immediate future are related to salt in some shape or form.
19:43 beardedeagle even my puppet stuff relates to salt lol
19:44 kevinquinnyo jfindlay: how recently?  Im running Beryllium
19:44 jfindlay kevinquinnyo: https://github.com/saltstack/salt/pull/30647
19:44 saltstackbot [#30647]title: Allow custom types to sync to the master | This adds a new runner module called ``saltutil`` which syncs custom types into...
19:44 kevinquinnyo so basically I should *never* put things in _modules/ or _state/ because then i'm locked into only creating custom modules and states, nothing else
19:45 jfindlay kevinquinnyo: I'm unsure what you're asking
19:46 MTecknology Do we have SSCA yet?
19:46 kevinquinnyo well my only choice is to modify the extension_modules to something of my choosing right?  that way i can extend additional components of salt besides just modules and state modules
19:47 tpaul Anyone know what "unable to cache" means when using the windows package manager in salt?
19:47 gtmanfred kevinquinnyo: extension_modules is for everything,including on the master
19:47 kevinquinnyo right
19:47 MTecknology tpaul: You'll usually find a more helpful error message that describes the issue above what you're looking at.
19:47 gtmanfred there is a patch in develop that allows for syncing of stuff like pillar and runners on the master
19:48 MTecknology Nope.. no SSCA yet. I'm excited for it.
19:48 tpaul MTecknology: Would they be on the minion? I have the master at trace and don't have much besides that
19:48 gtmanfred kevinquinnyo: https://github.com/saltstack/salt/pull/30647
19:48 saltstackbot [#30647]title: Allow custom types to sync to the master | This adds a new runner module called ``saltutil`` which syncs custom types into...
19:48 gtmanfred you need that patch
19:48 kevinquinnyo gtmanfred: yeah jfindlay mentioned that
19:49 gtmanfred until that, you just need to have the /srv/modules/pillars/<thing.py>
19:49 gtmanfred or /srv/module/runners/<thing.py>
19:49 kevinquinnyo well i guess that's the better way to do it though ^
19:49 gtmanfred you can set the extension_modules directory to something other than /srv/modules
19:49 MTecknology tpaul: Usually the minion can tell you, yes. You might be looking for something about salt not having permissions to write to a directory (the dir might not exist)
19:50 gtmanfred but until you have that patch, you can't have it in the different fileserver backends like you can _modules and _states
19:50 kevinquinnyo i thought using _modules/ and _states/ was a good practice / convention since it seemed common
19:50 q1x_ joined #salt
19:50 gtmanfred it is, but only for stuff that goes to the minion
19:50 gtmanfred _runners and _pillar do not, they stay on the master
19:50 tpaul MTecknology: the directories on the master exist and have been populated with the sls files from the github repo, I'll see what I can find on the minion
19:50 gtmanfred the change terminalmage made, will allow them to be synced to /var/cache/salt/master/extmods from the fileservers though
19:50 kevinquinnyo oh i see
19:51 tpaul oh geeze, I always forget Windows has no sane way to look at a text file without non-windows line endings...
19:52 west575 tpaul: wordpad
19:52 tpaul ws2k3_: (File is in use)
19:52 jettero I'm having a problem one one of my salt masters (500 hosts or so) where batches bigger than about 10 cause most of the queried minions to zombie-ify (down to manage.down, but technically running). They don't seem to produce any helpful errors, even in debug mode, but I may not know what to look for.
19:52 gtmanfred jettero: what are your workers set to?
19:53 tpaul west575: (file in use)
19:53 tpaul I had to stop salt...
19:53 gtmanfred how many worker threads do you have*
19:53 jettero I've tried various things. Doesn't seem to make any difference at all. I had it set to 50, tried 100, tried 200, tried 20, went back to 50.
19:53 hairytoez joined #salt
19:53 west575 tpaul: what file is in use?
19:53 tpaul The minion log file
19:56 jettero gtmanfred: how many worker threads should you have? I can't seem to find a ref on that. People say you should bump it up if you get the try increasing worker_threads error (kinda obvious) but I keep hoping for a formula or table... I suppose it depends on the network?
19:57 jettero Anyway, that doesn't seem to be a factor in this.
19:57 tpaul The minion just give me the same error "Unable to cache file" is there a particular path on the minion that needs to be configured?
19:58 gtmanfred jettero: the worker threads is the number of minions that you can pass data to or recieve data from at a given time iirc
19:58 UtahDave tpaul: It
19:58 gtmanfred but you should be fine since you are using the batch 10
19:59 UtahDave tpaul: it's saying it can't download that file for some reason.
19:59 sybix joined #salt
19:59 irctc781 joined #salt
19:59 gtmanfred jettero: i unfortunately do not have anything with 500 minions on it right now, but was about to test our env which has 200 minions, and we have our worker threads at 15
19:59 tpaul UtahDave: How does that work? Does it download it to the master, then copy it to the minion?
19:59 gtmanfred actually, looks like it is at 40 now :/
20:00 joejoba joined #salt
20:00 UtahDave tpaul: where do you have it configured to download from?  The minion will download it directly from wherever the package definition defines it.
20:01 jettero gtmanfred: yeah, 50 is obviously too many. I wondered if it was causing problems... but lowering it didn't help either
20:01 irctc781 HI all... I need some help to enable init.d services with a different priority. By default, the priority is 20, so it creates the right symlinks with S20 and K20, but I need to configure another service with priority 30. I couldn;t find where to put this 30.
20:02 jettero I think the problem is some kind of deadlock. A couple legs of the network are kinda slow (by modern standards) and I think zmq gets kinda jammed up in the minions, which seem to report no errors. The master only reports timeouts (even in debug mode)
20:02 gtmanfred that is possible
20:02 tpaul UtahDave: I'm trying to use jre8 from the github repo... oh wait I found my issue: "due to winrepo installer limitations you need to manually download the exe from..."
20:02 gtmanfred we have a couple that hte same thing happens to
20:02 gtmanfred jettero: you might up your timeout from 10?
20:02 tpaul UtahDave: I picked the worst package to use as a test haha
20:03 UtahDave :)  sorry about that.
20:04 jettero gtmanfred: interesting. Where does one set that? master? minion? both?
20:04 nidr0x joined #salt
20:04 jettero I've looked for such a setting, but didn't think I'd found one... is it obvious to find and I'm blind?
20:04 gtmanfred uhh
20:05 gtmanfred one second
20:05 tpaul UtahDave: notepadd++ worked OK, that was my issue, now I just need to read docs and find out how to add my own packages and I'll be golden, thanks!
20:05 UtahDave tpaul: cool!
20:06 gtmanfred jettero: it is timeout: in /etc/salt/master i think, which defaults to 5 seconds
20:06 gtmanfred i think you can set it on the minions too
20:06 gtmanfred nah, only on the master
20:06 gtmanfred jettero: you can also call salt -t 60 test.ping
20:06 gtmanfred and set it on each command
20:06 a7p left #salt
20:06 spuder joined #salt
20:07 gtmanfred jettero: but that changes the timeout for how long the minion has to respond for the job lookup when running a highstate
20:08 tpaul UtahDave: will be submitting some PRs to the git repo for a couple of open source packages as well
20:08 UtahDave tpaul: awesome!  appreciate it!
20:09 dlam joined #salt
20:09 jrgochan joined #salt
20:10 jrgochan Hey all. Just wondering what the purpose of salt.modules.mount.automaster and the /etc/auto_salt files are all about
20:12 gtmanfred jrgochan: it is a mac/darwin tool https://developer.apple.com/library/mac/documentation/Darwin/Reference/ManPages/man5/auto_master.5.html
20:13 jrgochan Ahhhh. Thanks! Much appreciated
20:13 gtmanfred jrgochan: https://github.com/saltstack/salt/blob/develop/salt/states/mount.py#L435-L441
20:13 gtmanfred used in the states for figuring out what is and isn't mounted and what should be mounted
20:14 jettero gtmanfred: does it differ much from the -t in salt -t ? I've used that without much success. Only -b 10 makes my salt go
20:14 gtmanfred https://github.com/saltstack/salt/blob/develop/salt/states/mount.py#L664-L666
20:14 gtmanfred jettero: they are the same thing
20:14 jettero (I've got a few other mastres, some big, and I've never seen this before).
20:14 jettero ok, then -t doesn't solve the problem either
20:14 gtmanfred -t just overrides timeout in /etc/salt/master
20:15 ajw0100 joined #salt
20:16 jettero I was thinking about trying this in aws (so it's not production and not the dev hosts in use by hundreds of people that freak if you break 'em); ... in aws, and use iptables or tc shaping to slow down zmq to a miserable state. See if I can reproduce it.
20:16 jettero Seems to me you've never heard of this before either
20:16 kevinquinnyo i guess i'm still confused on this.  I now have extension_modules: /srv/salt/modules/ in my /etc/salt/master conf and in my extension_modules dir I have /src/salt/modules/{modules,states,runners,pillar} dirs
20:17 kevinquinnyo do i still need that patch gtmanfred or should i be able to restart the salt master, and the files in those directories should be accessible / synced to the minion, a module or state module for example?
20:18 kevinquinnyo s/src/srv (typo)
20:19 gtmanfred only the modules and states will be synced to the minion
20:19 gtmanfred runners and pillar dirs are used by the master to render data, they will not sync to the minion
20:19 kevinquinnyo yep
20:19 kevinquinnyo ok so something is wrong then since my module is not available to the minions and not syncing
20:19 gtmanfred salt \* saltutil.sync_all
20:20 gtmanfred and check /var/cache/salt/minion/extmods/ on the minion
20:20 gtmanfred that is where the files should be
20:20 gtmanfred if they are not, try salt-call saltutil.sync_all on the minion, and see if errors appear
20:20 gtmanfred or, if the files are there, see if there is an error loading the module
20:21 kevinquinnyo no errors on that salt-call, and nothing synced
20:21 gtmanfred jettero: i have experienced it before, but only when our minions are all the way in hong kong.
20:21 kevinquinnyo it's weird
20:22 gtmanfred sounds like the salt master isn't finding them? i have my extension like this
20:22 gtmanfred [root@salt ~]# cat /etc/salt/master.d/pillars.conf
20:22 gtmanfred ext_pillar_first: True
20:22 gtmanfred extension_modules: /srv/salt/modules
20:22 gtmanfred ext_pillar:
20:22 gtmanfred - openstack_ips: []
20:22 gtmanfred and it works, for pillars and for my states and modules
20:22 kevinquinnyo do you have a directory like /srv/salt/modules/modules/
20:23 kevinquinnyo and /src/salt/modules/modules/openstack_ips.py or something?
20:23 kevinquinnyo dang.. srv not src i keep doing that
20:23 gtmanfred no, that is a pillar
20:23 al joined #salt
20:23 kevinquinnyo ah
20:24 kevinquinnyo /srv/salt/modules/pillar/openstack_ips.py
20:24 kevinquinnyo is that correct?
20:24 gtmanfred yeah
20:24 gtmanfred but again, those do not sync to the minion
20:24 kevinquinnyo that's fine
20:24 kevinquinnyo but the modules should
20:24 gtmanfred yeah
20:24 gtmanfred one second, lemme check something
20:24 kevinquinnyo so my structure is identical to yours, i bet i have a typo somewhere
20:24 brianfeister joined #salt
20:25 gtmanfred this https://docs.saltstack.com/en/latest/ref/modules/all/salt.modules.saltutil.html#salt.modules.saltutil.sync_modules specifically says
20:25 gtmanfred sync_modules only syncs from salt://_modules
20:25 gtmanfred and nothing about extension_modules
20:25 gtmanfred so it could be a mistake in documentation
20:26 zmalone joined #salt
20:26 al joined #salt
20:26 giantlock joined #salt
20:28 kevinquinnyo well i straced sync_modules and i see it accessing the directory /srv/salt/modules/modules
20:29 kevinquinnyo so i know it's thinking about it..
20:29 gtmanfred source = salt.utils.url.create('_' + form)
20:29 gtmanfred mod_dir = os.path.join(__opts__['extension_modules'], '{0}'.format(form))
20:29 gtmanfred yeah, definitely looking at it
20:30 kevinquinnyo ok welp
20:30 kevinquinnyo i'm gonna reboot everything and cry
20:30 kevinquinnyo i mean continue troubleshooting
20:32 beardedeagle rofl
20:33 bet0x There is any plugin for salt to automate porn download based on tags wich i like?
20:36 beardedeagle and @jfindlay, I see what you are talking about in tests. Uses checkbashisms, which is alright.
20:36 gtmanfred kevinquinnyo: https://github.com/saltstack/salt/issues/20865#issuecomment-78200943
20:36 saltstackbot [#20865]title: extension_modules config works different on master and slave | Or i could be wrong, but this is current issue i am having. ...
20:36 gtmanfred kevinquinnyo: the stuff in the extension_modules directory is not synced to the minion
20:36 gtmanfred it is just a place to put files on the minion to load from
20:36 gtmanfred kevinquinnyo: only stuff in salt://_modules is synced to the minion
20:37 gtmanfred kevinquinnyo: by default, extension_modules is just a directory that extends /var/cache/salt/minion/extmods
20:38 gtmanfred kevinquinnyo: starting with the change here, https://github.com/saltstack/salt/pull/30647 extension_modules will also be synced to the minion
20:38 saltstackbot [#30647]title: Allow custom types to sync to the master | This adds a new runner module called ``saltutil`` which syncs custom types into...
20:38 gtmanfred kevinquinnyo: but until then, if you want saltutil.sync_all to sync stuff to the minion, use /srv/salt/{_states,_modules}
20:40 garphy joined #salt
20:44 foundatron Hi, does anyone know if it's possible to make gitfs only update manually?
20:44 baweaver joined #salt
20:44 foundatron I see this section which explains how to make gitfs update on push https://docs.saltstack.com/en/latest/topics/tutorials/gitfs.html#refreshing-gitfs-upon-push
20:45 foundatron Buth otherwise the default is to try to update every 60 seconds
20:46 foundatron I want it to update only when I manually run gitfs/update
20:46 foundatron So I guess my question is, can I change the default behavior of gitfs to not auto poll?
20:48 lorengordon joined #salt
20:52 fredvd joined #salt
20:53 kevinquinnyo gtmanfred: reviewing, thanks, i was afk for a bit
20:53 gtmanfred no worries
20:54 baweaver joined #salt
20:55 jaybocc2 joined #salt
20:56 kevinquinnyo gtmanfred: ok so using 'extension_modules' option in the salt master config does not exclude the additional usage of _modules/ and _states/ ?
20:56 gtmanfred correct
20:56 gtmanfred they are different
20:57 gtmanfred _modules and _states get synced to /var/cache/salt/extmod
20:57 gtmanfred uhh /var/cache/salt/minion/extmod
20:57 kevinquinnyo that way i could still currently (without that patch) use extension_modules directory just for things that stay on master, like pillar, runner, etc
20:57 gtmanfred which is treated as a default extention_modules directory
20:57 gtmanfred yes
20:57 gtmanfred you can use both
20:57 kevinquinnyo ok whew
20:57 kevinquinnyo thanks so much
20:58 gtmanfred the stuff in the extension_modules directory is seperate (and in 2016.3, will sync things to the minion or master, except pillars cause that got missed :()
20:58 gtmanfred https://github.com/saltstack/salt/pull/31249
20:58 saltstackbot [#31249]title: add pillars to extmods sync_all commands | **INTERNAL NOTE: Merge to be delayed until 2016.3.0 is finalized**...
20:58 TomJepp joined #salt
20:59 kevinquinnyo ah ok cool, looking forward to that release then
20:59 gtmanfred yeah, then you can use salt://_pillar
21:06 srinivas joined #salt
21:06 tehsu gtmanfred: any ideas why I would be getting the image tag when building out with nova, this is using a already created block volume, [ERROR ] The required 'image' configuration setting is missing from the 'cent6' profile, which is configured under the 'rackspace' alias.
21:07 gtmanfred what version of salt are you on?
21:07 tehsu 2015.8.5
21:07 tehsu its a fresh build
21:07 gtmanfred and the volume already exists?
21:07 tehsu yes sir
21:07 gtmanfred put the image id on it, and see if it works
21:07 gtmanfred that might be a bug in the way I discover it
21:08 tehsu ok, let me try
21:08 gtmanfred uhh, actually, that shouldn't be a bug
21:11 gtmanfred yeah, i fixed that, one second
21:11 gtmanfred oh
21:11 gtmanfred i think i know what happened
21:11 tehsu ok
21:11 gtmanfred umm, one second
21:12 gtmanfred tehsu: yes
21:12 gtmanfred that is a bug
21:12 irctc781 HI all... I need some help to enable init.d services with a different priority. By default, the priority is 20, so it creates the right symlinks with S20 and K20, but I need to configure another service with priority 30. I couldn't find how to specify 30.
21:12 gtmanfred i have it all fixed in my shade branch
21:12 tehsu ok
21:12 gtmanfred but i need to get that finished and moved over for the next major release (not 2016.3)
21:12 gtmanfred then i am going to go back and fix nova
21:12 gtmanfred in the older releases
21:12 tehsu ok
21:13 tehsu is it something I can fix in the mean time by editing something?
21:13 gtmanfred https://github.com/saltstack/salt/pull/30335/files#diff-87e66d53ad1a09e0e96e344a932839f3R318
21:13 saltstackbot [#30335]title: [DO NOT MERGE] switch nova driver to using shade |
21:13 Manwe_ joined #salt
21:13 gtmanfred basiaclly, add those two lines, should fix the problem
21:13 tehsu awesome, thanks
21:14 gtmanfred it might be something else too
21:14 gtmanfred but i was testing with my shade stuff, and it was all working, just needed the keystone fix merged in upstream
21:16 tehsu ok, im building a test right now, so ill test it
21:16 gtmanfred that is weird.. that still shouldn't fail
21:19 jhauser joined #salt
21:19 egalano joined #salt
21:22 gtmanfred lemme test it
21:22 baweaver joined #salt
21:22 antpa joined #salt
21:22 tehsu so, just update /usr/lib/python2.7/site-packages/salt/cloud/clouds/nova.py? or the keystone as well
21:23 gtmanfred gimme a second, i am spinning up a server to test
21:23 tehsu ok
21:23 gtmanfred but i thought this all worked in 2015.8
21:23 irctc781 hi all... I need some help with init.d services...can anybody paste some example to enable a service with different boot order than the default, 20 ?
21:27 shaggy_surfer joined #salt
21:29 kevinquinnyo gtmanfred: do you know if there is any sort of race condition with the way modules are loaded if i'm trying to run __salt__['my_custom_module.do_something'](foo) from within a custom ext_pillar ?
21:29 gtmanfred tehsu: yup, that is weird, not sure why that is happening, gimme a bit
21:29 tehsu ok, thanks
21:30 UtahDave kevinquinnyo: remember that pillars get executed on the Salt master, not the minions
21:30 kevinquinnyo i can run __salt__['cmd.run']('ls /tmp') for instance, just fine, but the lazyloader is saying key error for __salt__['my_custom_module.do_something']
21:30 gtmanfred kevinquinnyo: the pillar runs on the master, nad should hand the data to the minion
21:30 gtmanfred kevinquinnyo: https://github.com/gtmanfred/openstack-salt-states/blob/master/_pillar/openstack_ips.py
21:30 gtmanfred which is why i initiate a runner to do my stuff
21:30 gtmanfred but you can use __salt__.runner
21:31 kevinquinnyo oh right
21:32 edeefelt joined #salt
21:34 evaryont joined #salt
21:34 toastedpenguin joined #salt
21:35 Borromini joined #salt
21:39 toastedpenguin joined #salt
21:42 Tyrm joined #salt
21:43 gtmanfred tehsu: found it
21:44 hasues joined #salt
21:47 akhter joined #salt
21:47 MindDrive joined #salt
21:48 gtmanfred tehsu: patch -Np1 -d /usr/lib/python2.7/site-packages/ < <( curl -sL https://patch-diff.githubusercontent.com/raw/saltstack/salt/pull/31253.patch)
21:48 gtmanfred that should fix it for now
21:48 tehsu ok
21:48 gtmanfred tehsu: https://github.com/saltstack/salt/pull/31253
21:48 saltstackbot [#31253]title: allow for nova servers to be built with premade volumes | if the boot_volume is specified, allow for that to be used instead of an image
21:48 gtmanfred change site to dist if you are on debian or ubuntu i think
21:49 tehsu got it
21:49 hightekvagabond joined #salt
21:50 gtmanfred git + patch is magic
21:50 jgarr joined #salt
21:51 Borromini hi guys. I'm looking into salt's ssh proxy minion to interface with my openwrt installations. I have a question though: do i understand right that i still need to install a python script on my openwrt devices (proxycmdshell)? Is there a way to run a proxy without needing python on the target system?
21:52 Borromini i have looked at the ssh minion instructions: https://docs.saltstack.com/en/latest/topics/proxyminion/ssh.html
21:53 UtahDave cro: ^^
21:55 kevinquinnyo Borromini: my understanding is that you don't have to install anything on the 'dumb device', the proxyminion communicates to the dumb device (however it can via a module you create)
21:55 kevinquinnyo but i've never used it successfully
21:55 irctc781 anybody could help me with some service startup for init.d? I cannot find any doc or examples
21:55 Borromini kevinquinnyo: yes i'm a bit at loss, i first put the proxycmdshell script in the minion's path but the salt proxy errors out
21:56 ageorgop joined #salt
21:57 Borromini i've set up a salt environment with some stuff pulled from pillars and some jinja variables in the state files, so i know my way around a bit, but the proxy instructions confuse me.
21:57 Borromini i understood the ssh proxy didn't need anything on the dumb device either.
21:58 kevinquinnyo Borromini: the proxycmdshell is just an example of a proxyminion right?
21:58 Borromini yes
21:58 Borromini afaict
21:58 Borromini should be a dummy to test, basically
21:59 kevinquinnyo i tried to get this to work when i first started playing with salt like 4 or 5 months ago and i could never get it to work, but i didn't try super hard on it.  i probably can't help more
21:59 garphy joined #salt
21:59 kevinquinnyo i just thought you didnt understand what it was supposed to do
21:59 doompatrol anyone aware of something similar to this for salt? https://github.com/fboender/ansible-cmdb
22:00 subsignal joined #salt
22:00 bet0x There is any plugin for salt to automate porn download based on tags wich i like?
22:00 UtahDave irctc781: what are you trying to do?
22:00 UtahDave bet0x: No, I don't think there is.
22:00 bet0x irctc781, distro?
22:02 gtmanfred doompatrol: i have been looking at this, but haven't tried it yet https://github.com/Lothiraldan/saltpad
22:02 doompatrol ah awesome ty
22:02 gtmanfred there are a bunch of other ones out there too
22:02 peters-tx joined #salt
22:03 gtmanfred doompatrol: the official one comes with the salt enterprise support
22:03 doompatrol OH ok didn't realize that ^
22:03 doompatrol i may need to check out that option
22:03 Borromini kevinquinnyo: i think i do... this is what the proxy spits out: https://paste.debian.net/392551/
22:06 edrocks joined #salt
22:08 peters-tx joined #salt
22:10 EO_ joined #salt
22:10 TomJepp joined #salt
22:11 EO_ Can salt-syndic work in a mutual multimaster config?  That is, can 2 masters syndic from each other?  And have the minions configured to connect to either of the 2 masters at random?  I suspect it might cause message loops between the syndics.
22:12 beardedeagle ow, that hurt my head
22:13 brianfeister joined #salt
22:17 giantlock joined #salt
22:17 tiadobatima joined #salt
22:18 rem5 joined #salt
22:19 Borromini well i'll try my luck in the next few days :) later guys
22:20 Borromini left #salt
22:30 pppingme joined #salt
22:30 jhauser joined #salt
22:31 TyrfingMjolnir joined #salt
22:31 totzky joined #salt
22:35 jorrel joined #salt
22:35 jorrel left #salt
22:35 nethershaw joined #salt
22:35 jorr-el joined #salt
22:39 nyx_ joined #salt
22:39 JDiPierro joined #salt
22:41 zenlot1 joined #salt
22:46 ifattah If it intentional that set_log_record_factory is not a member of SaltLoggingClass? https://github.com/saltstack/salt/issues/31251
22:46 saltstackbot [#31251]title: set_log_record_factory not member of SaltLoggingClass? | Is there a reason that set_log_record_factory is NOT a member of SaltLoggingClass?...
22:46 StevenGFX joined #salt
22:50 kalessin joined #salt
22:52 subsignal joined #salt
22:53 adelcast joined #salt
22:55 rem5 joined #salt
22:58 scoates joined #salt
22:58 joejoba joined #salt
23:01 west575 joined #salt
23:02 tehsu ok, so gtmanfred it works, but in https://github.com/saltstack/salt/pull/29765/files you have block_volume and in the patch you have boot_volume
23:02 saltstackbot [#29765]title: allow nova driver to be boot from volume | Thanks,...
23:03 tehsu I'm guessing the documentation is incorrect and its supposed to be boot_volume
23:05 hasues left #salt
23:06 baweaver joined #salt
23:15 bhosmer joined #salt
23:18 subsignal joined #salt
23:20 totzky joined #salt
23:21 MindDrive joined #salt
23:21 gtmanfred tehsu: they should both be boot_volume
23:22 gtmanfred i must have miss typed it
23:22 gtmanfred :/
23:22 gtmanfred yeah, doc was wrong
23:22 gtmanfred fixed
23:28 bevo joined #salt
23:28 gtmanfred tehsu: updated the docs in that pr https://github.com/saltstack/salt/pull/31253
23:28 saltstackbot [#31253]title: allow for nova servers to be built with premade volumes | if the boot_volume is specified, allow for that to be used instead of an image
23:30 bevo question, in a single sls file, i want to set a variable at the beginning of the file. eg: {% set my_env = salt['pillar.get']('my_env') %}, then in a template lookup a nested dict from pillars using the value of my_env....eg:     - defaults:      timezone:                    {{ salt['pillar.get']('config:{{ my_env }}:timezone', 'default') }}
23:30 frankS2_ joined #salt
23:31 iamtew_ joined #salt
23:31 rickflare2 joined #salt
23:31 Kelsar_ joined #salt
23:31 tmmt_ joined #salt
23:32 asoc_ joined #salt
23:32 CaptTofu___ joined #salt
23:32 justanot1eruser joined #salt
23:32 MTecknol1gy joined #salt
23:32 stickmac1 joined #salt
23:32 gtmanfred get rid of the {{ }} around my_env
23:32 gtmanfred and use a format string
23:32 rnts joined #salt
23:33 gtmanfred bevo: Subsystem sftp/usr/libexec/openssh/sftp-server
23:33 gtmanfred ...
23:33 gtmanfred not that
23:33 Phtes_ joined #salt
23:33 gtmanfred bevo: http://jinja.pocoo.org/docs/dev/templates/#format
23:33 gtmanfred 'config:%s:timezone'|format(my_env)
23:33 Ryan_Lane_ joined #salt
23:33 twodayslate_ joined #salt
23:34 bstaz_ joined #salt
23:34 johnkeates joined #salt
23:34 zmalone joined #salt
23:34 johnkeates left #salt
23:34 mikepea_ joined #salt
23:34 arapaho_ joined #salt
23:34 bbhoss_ joined #salt
23:34 kutenai_ joined #salt
23:34 mihait_ joined #salt
23:35 Sketch_ joined #salt
23:35 ramblinpeck_ joined #salt
23:35 themacproguy joined #salt
23:35 rideh- joined #salt
23:35 sjohnsen- joined #salt
23:36 rome_390_ joined #salt
23:36 Vaelater1 joined #salt
23:36 Neo-Vortex joined #salt
23:36 Neo-Vortex joined #salt
23:37 Cidan joined #salt
23:38 jcristau joined #salt
23:39 zmalone joined #salt
23:39 hexa- joined #salt
23:40 jor joined #salt
23:41 synical joined #salt
23:41 synical joined #salt
23:42 zmalone left #salt
23:43 pezus joined #salt
23:43 Horgix joined #salt
23:44 goki joined #salt
23:44 stopbyte joined #salt
23:45 MTecknology joined #salt
23:45 bmcorser joined #salt
23:45 jrgochan joined #salt
23:45 logandg joined #salt
23:47 baweaver joined #salt
23:47 knite joined #salt
23:47 Fabbe joined #salt
23:47 copelco joined #salt
23:47 dkrae joined #salt
23:47 amcorreia joined #salt
23:47 robinsmidsrod joined #salt
23:47 paolo joined #salt
23:47 Ouzo_12 joined #salt
23:47 copelco joined #salt
23:48 robinsmidsrod joined #salt
23:48 dijit joined #salt
23:49 aqua^c joined #salt
23:49 akhter joined #salt
23:49 theanalyst joined #salt
23:51 JDiPierro joined #salt
23:55 joshin joined #salt
23:55 shaggy_surfer joined #salt
23:56 cilkay Hello. I need to compare the value of a field in a local database with the same field in a remote db, both PostgreSQL. I know how to use module.run to use the postgres.psql_query module on both. How can I store the results that is returned from that state executing in a variable so that I can compare the two?
23:58 cilkay This is a masterless minion, if that makes any difference.

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary