Perl 6 - the future is here, just unevenly distributed

IRC log for #salt, 2017-02-04

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:03 rpb joined #salt
00:10 eThaD joined #salt
00:13 justanotheruser joined #salt
00:16 spuder joined #salt
00:19 gableroux joined #salt
00:24 swa_work joined #salt
00:28 druonysus_ joined #salt
00:33 ekristen joined #salt
00:36 ekristen I’m having a weird issue where salt-call pillar.items is returning a small set of pillar data and not everything that is actually applied to the host. If I run salt-call pillar.get <key> on a key that isn’t showing with items but I know it should be there, I actually get the pillar data I expect. Also my states are able to see all the pillar data, but I recently made a change and want to confirm the right pillar data wa
00:36 ekristen the host and pillar.items won’t show it to me
00:43 Neighbour what does salt-call test.get_opts give you regarding pillar data?
00:45 hlub joined #salt
00:46 amagawdd joined #salt
00:48 ekristen let me chekc
00:48 ekristen Neighbour: it shows me what I would expect to see
00:50 Neighbour if you run `salt-call -l debug pillar.items`, does that provide any extra clue as to why it's only partial? (just stabbing in the dark for me, I'm afraid)
00:51 eThaD joined #salt
00:51 ekristen nope :(
00:51 ekristen no errors, everything looks good
00:52 Neighbour I have no idea what's causing the issue then...sorry
00:59 whytewolf ekristen: if you just made the change i wonder if you broke something in your pillars and the pillar cache hasn't updated yet to reflect that [which is the only way i can see pillar.items not working but pillar.get working.]
01:01 amagawdd joined #salt
01:01 butters joined #salt
01:12 rpb joined #salt
01:16 Neighbour there's another one you could try (run this on your master): salt-run pillar.show_pillar minion=name_of_minion
01:17 druonysus_ joined #salt
01:32 eThaD joined #salt
01:34 ekristen whytewolf: interesting, let me check
01:35 ekristen huh, ok salt-run pillar.show_pillar is not showing all the data
01:40 ekristen Neighbour: whytewolf any idea on how to troubleshoot this?
01:44 ekristen hrm, maybe my gitfs pillar stuff isn’t setup right
01:44 ekristen but not sure how that could be when pillar.get works
01:44 whytewolf pillar.get works off of a pillar cache
01:44 whytewolf pillar.items doesn't
01:46 ekristen whytewolf: do you know how to setup ext_pillar so that the branch is chosen baed on the pillarenv/saltenv?
01:49 whytewolf ekristen: from what i am reading on git_pillar. it is all based on data in the top file now
01:50 whytewolf https://docs.saltstack.com/en/latest/ref/pillar/all/salt.pillar.git_pillar.html#module-salt.pillar.git_pillar
01:50 ekristen I’m using the __env__ trick
01:51 whytewolf are you using a salt before 2015.8?
01:51 ekristen 2016.11.2
01:52 ekristen hrm, perhaps my top file isn’t created properly
01:53 whytewolf if you are only getting some of that data that could be it
01:54 ekristen whytewolf: actually I’m not getting any data now
01:54 ekristen so I figured out why I was getting partial data, I had some left over data in /srv from the image creation :(
01:54 eThaD joined #salt
01:54 ekristen I cleared that out and now I am just not getting any pillar data when I do a pillar.items
01:55 ekristen interestingly enough pillar.get_opts still shows me my pillar data
01:55 whytewolf hasn't refreshed yet
01:55 whytewolf sounds like it is time to put the master into a debug mode
01:55 ekristen I just did
01:56 ekristen it seems to only be checking out a single branch on my pillar repo
01:56 ekristen instead of multiple ones
01:56 ekristen oh
01:57 ekristen pillarenv
02:00 ekristen pillar.items hows local: ——— as empty
02:00 ekristen but it seems to be resolving the correct pillar data now on the master side
02:05 whytewolf then if it is starting to work on the master side run salt-run -l debug git_pillar.update
02:06 ekristen ok so when I call pillar.items
02:07 ekristen it says that it pillar env is ‘test-env’ and then I see it render the sls files properly from the right branch
02:08 ekristen but before it returns the data, I see it switch back to saying that the ‘master’ branch is the right branch
02:08 ekristen and the return happens
02:08 ekristen and no data shows up on the minion side
02:08 * ekristen is going to go read the new git_pillar docs one more time
02:08 whytewolf that sounds like a top error
02:09 scsinutz joined #salt
02:11 scsinutz anyone copying ~50mb sized directory to ~100 minions using file.recurse?
02:12 whytewolf no, i like sanity
02:12 catpigger joined #salt
02:13 scsinutz what's a salt efficient want to copy a 50 mb dir to 100 minions?
02:13 scsinutz way*
02:14 whytewolf rsync. or compress it before hand and use archive.extracted
02:15 scsinutz does the rsync state copy over 4505?
02:15 whytewolf no
02:15 scsinutz port 4505
02:15 whytewolf i meant like run an rsync server
02:16 scsinutz I see, unfortunately I can only work with port 4505
02:16 whytewolf then archive.extracted
02:20 ekristen this has to be a bug with salt master
02:20 ekristen according to the docs my setup is 100% correct
02:20 ekristen I’ve stripped by top.sls file down to a single file that I know has zero errors in it
02:21 ekristen on the master I see it resolve the right branch and compile the right data
02:21 ekristen but the minion never gets it
02:21 whytewolf ekristen: don't forget to force updates after changing things. there is like 3 levels of cacheing going on
02:21 ekristen what command(s) should I run?
02:22 ekristen ok I see one error in the master logs around the time the pillar stuff runs
02:22 ekristen “2017-02-04 02:21:28,971 [salt.template    ][ERROR   ] Template does not exist:”
02:23 whytewolf ekristen: i typically run this orchestration i have ... https://github.com/whytewolf/salt-phase0-states/blob/master/orch/salt-core-update.sls
02:23 whytewolf [covers more then just pillar updates]
02:24 scoates joined #salt
02:25 barkingfoodog joined #salt
02:30 ekristen whytewolf: I’m pretty much convinced this is 100% a bug
02:31 whytewolf okay. post a bug report about it
02:31 evle joined #salt
02:32 scsinutz ekristen: try running ''salt-master -l debug"
02:32 ekristen I’m in debug mode already
02:32 whytewolf he already did
02:33 ekristen Basically it seems that the master does the right thing and replaces __env__ with the minions env information and resolves the correct pillar data, but before the final return statement is called, it does another pillar resolve and says that the master branch is the right branch (which is empty) and returns {} back to the minion
02:34 whytewolf I'm not sure if that is a bug or by design
02:34 whytewolf master typically resolves to base
02:34 ekristen I don’t use base, I use environments and 1 branch per env
02:34 whytewolf base is used no matter what
02:35 whytewolf it is the default enviroment
02:36 eThaD joined #salt
02:37 ekristen its worth me try it real quick
02:37 ekristen one sec
02:37 ekristen nope
02:37 ekristen even with some data there and a valid top, its returning nothing
02:38 ekristen I do have that template error
02:38 ekristen so I guess that could be the “real” problem
02:38 stooj joined #salt
02:38 whytewolf it very well could be.
02:39 whytewolf either way bug report
02:57 eThaD joined #salt
02:59 ekristen whytewolf: can you look at your logs and see if there is any salt.template logs in an near your pillar logs in the master when you run pillar.items
03:02 whytewolf master:2017-02-02 06:23:51,956 [salt.template    ][ERROR   ][8619] Template was specified incorrectly: False
03:02 whytewolf that is the only error i see
03:02 whytewolf and that only happened when i restarted the salt-master
03:04 whytewolf everything else is a jinja followed by a yaml render
03:06 ekristen hrm, I’m seeing https://github.com/saltstack/salt/issues/39025 in my logs
03:06 saltstackbot [#39025][OPEN] Could not LazyLoad config.merge: 'config.merge' is not available. | Description of Issue/Question...
03:07 whytewolf you are seeing config.merge not loading? yeah you have problems
03:07 ekristen yeah I’m seeing that
03:10 blu_ joined #salt
03:35 cro joined #salt
03:37 alexlatchford joined #salt
03:37 alexlatchford Hey guys what's the best way to output a highstate command as a summary view?
03:38 alexlatchford Running it in 60~ minions and it's painful to scroll!
03:38 alexlatchford Only thing I could find was this: https://github.com/saltstack/salt/issues/11199
03:38 saltstackbot [#11199][OPEN] Total changes from whole execution in state.highstate summary | When I execute `state.highstate` on many machines I'd like to know how many state changes were made _overall_. I think the `state.highstate` is missing the point here because I have to scroll through a lot of output to see whether any changes were applied or not. I suggest the following output for `state.highstate` when multiple (>1) minions are involved:...
03:39 eThaD joined #salt
04:19 sagerdearia joined #salt
04:20 amagawdd joined #salt
04:25 Jimlad joined #salt
05:11 sh123124213 joined #salt
05:26 yuhll joined #salt
05:28 yuhll_ joined #salt
05:44 eThaD joined #salt
06:06 eThaD joined #salt
06:09 preludedrew joined #salt
06:16 debian112 joined #salt
06:20 ekristen whytewolf: yeah this is a pretty bad bug, I’ve narrowed it down some
06:47 eThaD joined #salt
06:49 xet7 joined #salt
06:53 mavhq joined #salt
06:57 lompik joined #salt
07:09 eThaD joined #salt
07:18 scsinutz1 joined #salt
07:18 SpX joined #salt
07:32 jas02 joined #salt
07:34 SpX joined #salt
07:41 Inveracity joined #salt
07:48 stooj joined #salt
07:51 eThaD joined #salt
07:54 stooj joined #salt
08:02 stooj joined #salt
08:07 HarvesterOfBeer joined #salt
08:08 HarvesterOfBeer Howdy. Anybody know how to set a grain containing equals signs using grains.set?
08:08 HarvesterOfBeer When I try to escape the equals with a backslash, the backslashes appear in the grain value. When I omit the backslashes, grains.set fails to run
08:10 stooj joined #salt
08:16 Inveracity HarvesterOfBeer, this worked for me: salt '*' grains.set test val='one=1'
08:18 reric joined #salt
08:26 viccuad joined #salt
08:26 HarvesterOfBeer @Inveracity that worked! Thanks!
08:26 ronnix joined #salt
08:27 viccuad Hi folks. I get an error on a pilar file, and it instructs me to read the salt master log for details, yet I'm using salt masterless. Does anybody know where to find /var/log/salt/master then? Thanks in advance
08:34 stooj joined #salt
08:46 Inveracity not sure about that one, but a possible alternative is to run the minnion in debug bug: salt-minion -l debug
08:47 Inveracity debug mode even*
08:47 viccuad sadly, that's not enough (that's how I got to `Pillar render error: Rendering SLS 'role.workstation' failed. Please see master log for details`)
08:49 Klas joined #salt
08:54 Inveracity does it help if you put pillar_safe_render_error: False in your minion config?
08:59 viccuad Inveracity: yes it does, thanks :). I guess I can live with that, since I'm using masterless anyway
09:01 viccuad another question, why does salt fetch the gitfs in every and each state.apply? is there a way to make it use the cached ones?
09:02 Klas joined #salt
09:03 stooj joined #salt
09:12 Inveracity I thought default behavior was to use the cache first, and I'm not finding relevant info in docs, sorry :(
09:18 ronnix joined #salt
09:34 jas02 joined #salt
09:38 mswart joined #salt
09:42 reric left #salt
09:48 scsinutz joined #salt
09:51 inad922 joined #salt
09:53 mavhq joined #salt
09:56 eThaD joined #salt
10:04 ChubYann joined #salt
10:05 evle joined #salt
10:15 netcho joined #salt
10:18 eThaD joined #salt
10:19 Trauma joined #salt
10:24 nidr0x joined #salt
10:33 ivanjaros joined #salt
10:35 jas02 joined #salt
10:43 sjorge joined #salt
10:43 sjorge joined #salt
10:59 eThaD joined #salt
11:19 cyteen joined #salt
11:28 nickabbey joined #salt
11:36 jas02 joined #salt
11:41 eThaD joined #salt
12:03 eThaD joined #salt
12:07 inad922 joined #salt
12:24 swills joined #salt
12:35 nidr0x joined #salt
12:39 scoates joined #salt
12:44 eThaD joined #salt
13:03 jas02 joined #salt
13:08 netcho joined #salt
13:08 Rumbles joined #salt
13:27 cyborg-one joined #salt
13:41 austin_ joined #salt
13:41 austin_ does anyone have an example of s3 ext pillar?
13:49 APLU joined #salt
14:00 blu__ joined #salt
14:14 netcho joined #salt
14:22 jas02 joined #salt
14:25 blu_ joined #salt
14:29 scoates joined #salt
14:40 nidr0x joined #salt
14:50 eThaD joined #salt
14:58 Tanta joined #salt
15:12 eThaD joined #salt
15:15 swa_work joined #salt
15:23 jas02 joined #salt
15:26 swa_work joined #salt
15:44 cyteen joined #salt
15:51 Flying_Panda joined #salt
15:53 eThaD joined #salt
16:00 Flying_Panda Hi all I seem to be getting a weird error when running dockerng.image present it was working a few hours ago however now
16:00 Flying_Panda https://gist.github.com/anonymous/b7c4a5119dbff22ecea8da0f545e2030
16:01 Flying_Panda I dont know what its looking for with this ...
16:01 Flying_Panda TypeError: 'NoneType' object is not iterable
16:05 Flying_Panda a dockerbuld on the Dockerfile finishes sucessfully
16:12 p0rkbelly joined #salt
16:12 byteriot do you have any repotags?
16:12 Flying_Panda its tagged with :latest
16:13 cryptolukas joined #salt
16:14 cryptolukas Have anyone expierence with a manged dhcp server for linux? i found some formulas. which works in best? :D
16:14 bigjazzsound joined #salt
16:14 tom[] joined #salt
16:18 Flying_Panda exact state is on the gist
16:23 byteriot do you have any images present?
16:23 Flying_Panda yes
16:23 Flying_Panda but it should force the build from the dockerfile and retag should it not
16:23 byteriot i've no idea i'm just reading the python
16:23 byteriot dont know squat about docker here, sorry
16:24 Flying_Panda so I have 2 images present with same image id
16:24 byteriot <-- here, not #salt here ! sorry
16:24 jas02 joined #salt
16:24 Flying_Panda one on the localhost:5000\docker\sofootdb3
16:25 Flying_Panda and one on soproddocreg02:5000/blah/sofootdb3 dev
16:25 Flying_Panda and one on soproddocreg02:5000/blah/sofootdb3dev
16:26 Flying_Panda but even pushing somthing with only on localhost still hit the error
16:34 Flying_Panda so
16:34 Flying_Panda it looks like dockerng.list_tags is returning no tags
16:35 eThaD joined #salt
16:35 Flying_Panda although thats the output of docker images
16:35 Flying_Panda https://gist.github.com/DrunkenAngel/bf07e609690ebf28eb9f636eb52d949e
16:41 swa_work joined #salt
16:49 swa_work joined #salt
16:56 swa_work joined #salt
16:57 eThaD joined #salt
16:58 Inveracity Flying_Panda, It seems that a fix was implemented for this in august last year, using the latest version of salt?
16:58 Inveracity reference: https://github.com/saltstack/salt/pull/35447
16:58 saltstackbot [#35447][MERGED] [dockerng] RepoTags can be also be None with docker 1.12 | What does this PR do?...
17:07 Flying_Panda salt-minion 2015.8.7 (Beryllium)
17:07 Flying_Panda guessing thats a nice an old minion?
17:07 Inveracity yep, pretty old now
17:07 Flying_Panda Ill moan at Suse :p
17:08 Flying_Panda its the one they support with there new Suse-Salt
17:08 Flying_Panda might have  a new one lets see
17:09 Inveracity you can get the latest repos from saltstack if you wish http://repo.saltstack.com/#suse
17:09 Flying_Panda So I guess this went away when clearing the cache on the minion ?
17:10 Inveracity no idea
17:13 mswart left #salt
17:16 scoates joined #salt
17:22 swa_work joined #salt
17:24 ksoviero joined #salt
17:25 jas02 joined #salt
17:26 ksoviero Would it be possible to define something like this: https://bitbucket.org/snippets/ksoviero/74xon
17:26 Flying_Panda yea so this is caused when any image has the :none tag its breaks for everything quite the nasty bug thanks for your help!
17:38 eThaD joined #salt
17:40 ksoviero So, our top file looks like this: https://bitbucket.org/snippets/ksoviero/gpRo5
17:40 ksoviero Would it be possible to check if the role exists before just blindly attempting to import it?
17:41 ksoviero Google is returning overly complex solutions people have come up with, but it should be possible to just do something akin to `if role in roles`
17:47 Flying_Panda you mean
17:47 Flying_Panda {% if blah in grains['ec2_tags]['role']
17:48 Flying_Panda {% if blah in grains['ec2_tags]['role'] %}
17:49 ksoviero Flying_Panda: I'm not sure that's right... I want to only import a state if the role exists on the master. Otherwise I'm getting errors for new roles.
17:50 ksoviero Flying_Panda: But, I think I figured it out: salt-call cp.list_states will list all states using the roles.<role> syntax, so I should be able to just compare on that.
17:56 ksoviero Flying_Panda: like this: https://bitbucket.org/snippets/ksoviero/XpjXn
17:59 djgerm joined #salt
17:59 Flying_Panda oh if you mean if a statefile exists
18:00 eThaD joined #salt
18:00 Flying_Panda you can use the runner fileserver.file_list
18:01 oma[m] joined #salt
18:14 ksoviero Is there a way to add a hook to Salt that will force a git pull in /srv/salt everytime a client runs salt-call state.apply?
18:17 Flying_Panda ksolviero just use gitfs
18:20 ksoviero Flying_Panda: I'd love to, but Salt forces you to have separate repos for states and pillars. That's not really practical for us.
18:23 Flying_Panda could you not wite a webhook to watch git in reactor and do a pull when updated ?
18:23 austin_ joined #salt
18:25 ksoviero Flying_Panda: Looking into that...
18:25 austin_ i'm rather confused on ext_pillars
18:26 austin_ do i need to add any s3 fs ?
18:26 austin_ master config has the s3 ext_pillar
18:26 austin_ i see it pull down and cache
18:26 austin_ bu ti can't seem to access the pillar data
18:39 ivanjaros joined #salt
18:39 fracklen joined #salt
18:41 eThaD joined #salt
18:49 ksoviero Is there a way to check if a pillar file exists? The pillar.file_exists returns false for me no matter what I do.
18:50 ksoviero root@salt:~# salt 'salt.*' pillar.file_exists 'top.sls'
18:50 ksoviero salt.prod.kviero.com:
18:50 ksoviero False
18:50 ksoviero Whoops, didn't mean to do that, but it gets the job done I suppose.
19:01 Flying_Panda you mean the /srv/pillar/top.sls file ? or you mean see what pillar data the minions are pulling
19:06 prg3 joined #salt
19:07 demize Hm, when should I expect the newest changes to the acme module which landed in October to be released?
19:07 demize Sadly it won't work properly with newer versions of the script.
19:08 demize Err, rather, the released acme module version doesn't.
19:09 swa_work joined #salt
19:18 cryptolukas joined #salt
19:21 jas02 joined #salt
19:28 KaczuH joined #salt
19:38 swa_work joined #salt
20:00 oma[m] left #salt
20:05 fracklen joined #salt
20:09 fracklen joined #salt
20:21 netcho joined #salt
20:21 Poppabear joined #salt
20:22 Poppabear joined #salt
20:32 hk47 joined #salt
20:37 alex__ joined #salt
20:39 alex__ Hi! Was trying to understand what's the best way in salt to fetch informations about other minions. I come from chef so I'm used to assign a role to a node and do a chef search. Ohai automatically populates the node objects returned with all the info required. I tried assigning roles with pillar, but can't get multiple roles assigned to the same host so I decided to use nodegroups.
20:40 alex__ Would anyone please be so kind to help me understanding how to simple populate a file with all the hosts belonging to a certain nodegroup, adding for instance, hostname and ip address?
20:40 alex__ I'm basically trying to port the chef way on salt, but if there's a better way to achieve this I'm happy to go for it
20:42 alex__ Forgot to mention that I'm using sls files, so the configuration management part of salt
20:45 AndreasLutro alex__: look up mine data in the salt docs
20:47 eThaD joined #salt
20:47 alex__ AndreasLutro, do I have to add this to pillar in order to populate every host's interface? mine_functions:   network.interfaces: []
20:47 AndreasLutro correct
20:48 alex__ and what's the best option to assign multiple roles to the hosts?
20:49 alex__ because if done in pillar it gets overwritten by the last one parsed
20:50 debian112 joined #salt
20:51 AndreasLutro roles: { role1: true, role2: true }
20:51 AndreasLutro structure your data in dictionaries/maps and they will merge instead of overwrite
20:52 alex__ so roles can't be a normal list like: roles: - role1 - role2
20:52 alex__ (of course structuring it as a yaml snippet)
20:52 AndreasLutro it can but you'll need extra configuration to make list merging work and it can lead to other unexpected behaviour, I recommend just using maps
20:53 alex__ ok, many thanks for the advice! I'll give it a try. Much appreciated!
20:59 Eugene joined #salt
21:08 netcho joined #salt
21:08 scoates joined #salt
21:11 sagerdearia joined #salt
21:11 jas02 joined #salt
21:18 MTecknology how to do secrets securely without pillar ??!
21:18 viq MTecknology: vaultproject.io ?
21:19 * viq tries to remember the other projects for this
21:19 viq keywhiz was one
21:19 MTecknology I just engineered an endpoint salt master (for deploying my laptops and build boxes and the like) and I did it without pillar because I wanted to not need it.
21:20 MTecknology I'm kinda curious about vaultproject and other similar apps, but I probably won't roll them out at home.
21:22 MTecknology viq: how ya been?
21:23 viq MTecknology: ok, waiting to see what kind of changes I'll be facing at work now that we've been bought
21:23 viq you?
21:24 MTecknology still single and looking to remain that way until I leave $current_employer, but I'm at least down to 50% travel vs. my previous 100%.
21:25 viq ah, yeah, travelling that much can be a pain
21:28 MTecknology I used to leave Monday morning about 4AM to hop on a flight to be to work in LA by noon and then take off from work about noon two fridays later so I could get home by midnight, sleep half of saturday away, and then try to take care of bills and crap before leaving the coming monday.
21:29 viq ungh, that's no life...
21:31 MTecknology it's better now, but not great..
21:31 MTecknology what purchase were you a part of?
21:34 wgoulet joined #salt
21:41 fracklen joined #salt
21:52 fracklen joined #salt
21:59 SpX joined #salt
22:06 Tanta joined #salt
22:22 stooj joined #salt
22:23 jas02 joined #salt
22:31 austin_ is anyone using s3 ext pillar
22:49 stooj joined #salt
22:53 eThaD joined #salt
23:05 orion joined #salt
23:15 eThaD joined #salt
23:19 gmacon joined #salt
23:23 blueyed left #salt
23:23 netcho joined #salt
23:24 jas02 joined #salt
23:50 cliluw joined #salt
23:50 justanotheruser joined #salt
23:56 eThaD joined #salt

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary