Perl 6 - the future is here, just unevenly distributed

IRC log for #salt, 2017-01-30

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:47 ivanjaros joined #salt
01:00 sh123124213 joined #salt
01:02 mosen joined #salt
01:14 PatrolDoom joined #salt
01:18 cryptolukas joined #salt
01:33 bob_twinkles joined #salt
01:41 justanotheruser joined #salt
01:45 lorengordon joined #salt
01:54 stooj joined #salt
02:18 catpigger joined #salt
02:21 cacasmacas joined #salt
02:29 lorengordon joined #salt
02:33 sh123124213 joined #salt
02:47 ilbot3 joined #salt
02:47 Topic for #salt is now Welcome to #salt! <+> Latest Versions: 2016.3.4, 2016.11.1 <+> Support: https://www.saltstack.com/support/ <+> Logs: http://irclog.perlgeek.de/salt/ <+> Paste: https://gist.github.com/ (please don't multiline paste into channel) <+> See also: #salt-devel, #salt-offtopic <+> Ask with patience as we are volunteers and may not have immediate answers
02:48 DEger joined #salt
03:09 robinsmidsrod joined #salt
03:22 armyriad joined #salt
03:30 evle joined #salt
03:43 sh123124213 joined #salt
03:44 armyriad joined #salt
03:45 JPT joined #salt
03:46 scamander joined #salt
03:51 alexlist joined #salt
03:57 scamander joined #salt
04:03 scamander joined #salt
04:15 SaucyElf joined #salt
04:21 SaucyElf joined #salt
05:27 ruxu joined #salt
06:02 ruxu joined #salt
06:40 ruxu joined #salt
06:41 preludedrew joined #salt
06:46 ruxu joined #salt
06:50 teclator joined #salt
06:55 PatrolDoom joined #salt
06:56 yuhl___ joined #salt
07:10 rdas joined #salt
07:11 lord2y joined #salt
07:16 scristian joined #salt
07:16 sh123124213 joined #salt
07:21 impi joined #salt
07:46 eThaD joined #salt
07:53 darioleidi joined #salt
07:54 darioleidi joined #salt
08:05 candyman88 joined #salt
08:06 cacasmacas joined #salt
08:06 jeddi joined #salt
08:07 eThaD joined #salt
08:09 gladia2r joined #salt
08:13 sh123124213 joined #salt
08:14 samodid joined #salt
08:21 ronnix joined #salt
08:22 ksk joined #salt
08:25 ThomasJ joined #salt
08:27 sh123124213 joined #salt
09:08 barmaley joined #salt
09:09 bookwar joined #salt
09:10 ruxu joined #salt
09:14 teclator joined #salt
09:27 sfxandy joined #salt
09:32 bluenemo joined #salt
09:33 thebinary joined #salt
09:35 mikecmpbll joined #salt
09:37 kalessin joined #salt
09:42 eThaD joined #salt
09:43 s_kunk joined #salt
09:43 sh123124213 joined #salt
09:47 bookwar joined #salt
09:54 Mattch joined #salt
09:55 N-Mi_ joined #salt
10:03 Mattch joined #salt
10:04 sh123124213 joined #salt
10:15 johny_ joined #salt
10:16 theanalyst when trying to run flake8 for a salt execution modules I'm seeing F821 undefined name __opts__ etc. what is the std. way to silence these
10:17 AndreasLutro linters usually let you have some config file where you specify variables etc to not warn about
10:18 theanalyst ah ok, seeing pylintrc from salts own repo
10:32 CrummyGummy joined #salt
10:32 Yoda-BZH joined #salt
10:32 Yoda-BZH joined #salt
10:35 mrueg joined #salt
10:45 ravenx joined #salt
10:46 ravenx hi guys i'm currently doing deployments like: salt 'server1, server2' state.sls super-app
10:46 ravenx and for my app called:  tester-app, it is on server1, server2 and server3.
10:46 ravenx my question is, is there a way to map which apps go to which servers?
10:46 ravenx without using highstate?
10:56 babilen Write it in pillars and target a common (parametrised) SLS
11:00 ravenx coudl you please elaborate
11:00 ravenx i'm afraid i'm not following
11:00 viq ravenx: salt -I role:myapp state.apply myapp
11:02 ravenx aaah
11:02 ravenx what should i google for docs on that?
11:02 ravenx pillar roles?
11:02 AndreasLutro it's just pillars
11:02 ravenx oh
11:02 AndreasLutro there's no special pillar type "role", it's just the name of a dictionary key
11:03 viq Yeah, it's just pillars, and arbitrary key of 'role' with value 'myapp'
11:03 viq s/and/an/
11:03 ravenx so simply i make a:  /srv/pillars/role/
11:03 ravenx and in there i make an init.sls containig the K:V
11:03 AndreasLutro doesn't matter where the pillar is
11:03 AndreasLutro just make sure the correct minions have the  pillars you want
11:04 izrail joined #salt
11:04 ravenx i'm kinda confused as to what the pillar structure would like though
11:05 AndreasLutro that's entirely up to you
11:05 ravenx will it be on a per app basis, or, one pillar file containing all of it?
11:05 AndreasLutro could be /srv/pillars/apps/$APP_NAME.sls
11:05 AndreasLutro could be /srv/pillars/minions/$MINION.sls
11:05 ravenx ah, and so then in each of the $APP_NAME.sls that particular $APP_NAME, will have it's own mapping of servers to be deployed to?
11:05 AndreasLutro as long as you match the pillar to the minion in your pillar top.sls
11:06 AndreasLutro no, pillar SLSes don't know anything about which servers they're applied to
11:06 AndreasLutro top.sls defines that
11:06 ravenx ah i see
11:06 ravenx okay i'm going to give this shot
11:06 babilen ravenx: I was thinking of a SLS with a pillar lookup that defines which app state is being included/executed .. and a matching pillar in which you define the id <-> application mapping
11:07 babilen That way you can run "salt '*' your_special_state" and it'll do the right thing
11:07 ravenx that'd work too
11:07 ravenx however, this'll lose the ability to batch, rgith?
11:07 babilen (that is iff you requirement is that you have a single call to kick of the state run on all boxes)
11:08 babilen What will lose the ability to batch?
11:08 ravenx my salt commands.
11:08 babilen I don't see how that would be affected
11:08 ravenx cuz all the servers will be deployed to at the same time, no?
11:09 babilen Not if you define the run to be occur in batches
11:09 ravenx i see
11:09 babilen I mean, I strongly prefer the top.sls or I@role:foo approach, but your initial question looked as if you want to fire of the same state to all minions and have them do the right thing
11:11 Rumbles joined #salt
11:11 ravenx well, i want to fire the same state to minions, without having to specify them
11:11 ravenx i want it to be mapped somewhere
11:11 ravenx my devs don't know where each of the 15 apps we have, and where they are deployed
11:11 ravenx that is the problem i'm trying to solve :D
11:14 babilen And what's wrong with a highstate?
11:14 babilen I mean that is exactly what top.sls is for?!
11:14 ravenx true..
11:14 ravenx i remember highstate not working well without workflow
11:14 ravenx and so i was hoping for alternatives.
11:14 babilen And in there you can target in any way you want. Using a "role" pillar (or grain) is one way to unify targeting
11:15 ravenx i will try pillar roles :D
11:16 babilen But that doesn't solve your targeting problem
11:16 babilen It allows you to target the right boxes for a given service, but not the other way round
11:16 ravenx wait what?
11:16 ravenx i thoguth in the above, they mentoined that i could target via roles:pillars
11:16 babilen What do you want to do?
11:16 ravenx i would like to, in one command, have my apps deployed to thei respective servers
11:16 ravenx preferably without highstate.
11:17 babilen Just to make sure: Why do you think that a "highstate" is problematic?
11:19 ravenx our apps are constantly changing, and since we have one environment:  if i do a highstate
11:19 ravenx i may bring in unintended changes from app number 5 into it
11:21 Kelsar joined #salt
11:23 babilen How so?
11:23 ravenx cuz doesn't high state bring in all changes?
11:23 babilen It does, but why do you have changes that you don't want to deploy?
11:24 ravenx some apps are not ready
11:24 ravenx (we dont have a dev/prod/staging) env :<
11:25 babilen Either way: If you want to run k commands to deploy k services, then "salt -C 'I@roles:foo' state.apply foo" works for you, if you want *one* run that runs the respective foo1, foo2, foo3 state you either have to run a highstate in which you target *the applications you actually want to target* or write a "meta" state that uses a minion<->state mapping to include/run the right state
11:26 ravenx excellent
11:26 ravenx gonna give that a shot
11:26 ravenx another question while we're here
11:26 ravenx i'm adding an s3fs to my master's config
11:27 ravenx however, when i restar tthe salt-master, i am getting:  `[ERROR   ] Exception Failed s3 operation. AccessDenied: Access Denied occurred in file server update`
11:27 ravenx is ther anything i'm overlooking?  the keys are there, and i specified the location
11:28 Kelsar joined #salt
11:31 ivanjaros joined #salt
11:40 amcorreia joined #salt
11:42 ravi____ joined #salt
11:51 cuxtud joined #salt
11:52 cryptolukas joined #salt
11:53 cuxtud disappointed with saltstack sales team. Deal didn't went through coz of pricing for enterprise. the sales manager was upset and now he doen't want to give the salt open support package coz we are not going for enterprise
11:53 cuxtud sad when such sales ****** destroy the product
11:56 ravenx sounds like an adult just threw a tantrum cuz things didn't go his way
11:56 ravenx or her.
11:57 eThaD joined #salt
12:01 eThaD joined #salt
12:03 lasseknudsen2 joined #salt
12:05 kbaikov joined #salt
12:13 lasseknudsen joined #salt
12:13 eThaD joined #salt
12:15 eThaD joined #salt
12:17 Miouge joined #salt
12:22 kettlewell joined #salt
12:23 kettlewell joined #salt
12:30 gladia2r hey - anyone ideas if in an sls file, i can use a variable for source in path? eg. `- source: salt://path/to/file.{{ app_version }}`
12:31 gladia2r and I mean I'm trying but doesn't seems to be finding the 'source'
12:33 cuxtud where would it get the input for the variable from?
12:33 haam3r should be possible...how are you defining your variable?
12:33 evle1 joined #salt
12:35 gladia2r haam3r: https://gist.github.com/gladia2r/135aefee53ab899bdec16e15590ae3bc
12:36 Zachary_DuBois joined #salt
12:40 cuxtud gladia2r: missing - name
12:42 usernkey joined #salt
12:44 ALLmightySPIFF joined #salt
12:47 gladia2r cuxtud: oh? but the name is the file path be default (line 4)
12:47 gladia2r 's/be/by'
12:56 cuxtud sorry, just saw that.. I have a state similar to this which reacts on an api call and does the install. the only thing i would recheck if the grains app returns a value
12:58 cuxtud also try s/file_mode/mode
12:59 verdurin joined #salt
13:04 numkem joined #salt
13:04 _Cyclone_ joined #salt
13:06 Firewalll joined #salt
13:07 CrummyGummy joined #salt
13:07 gladia2r hm it does seems to be something with the grains check - as if I'm not using the variable there it works actually in the path, so perhaps its due to the fact that I'm using the variable inside an {% if %} ?
13:09 gladia2r - otherwise a 'salt-call grains.item app' returns the version, so its something with the variable inside the if
13:11 gableroux joined #salt
13:23 cuxtud can you try this as your if condition http://paste2.org/OMfsY0h0
13:26 gladia2r cuxtud: getting > "..failed: Jinja syntax error: expected token ':', got '}'; line 8" - which is that IF line
13:26 ravenx anyone here got s3fs working?
13:27 cuxtud gladia2r : let's give this a try : http://paste2.org/6KzAUpwA. not sure if yiu had a look at this https://groups.google.com/forum/#!topic/salt-users/6fJf4muYaZw
13:28 cuxtud s/yiu/you
13:30 eThaD joined #salt
13:33 Cottser joined #salt
13:33 lasseknudsen joined #salt
13:35 sgo_ joined #salt
13:35 gladia2r no luck so far cuxtud :| - see the comment in my gist: https://gist.github.com/gladia2r/135aefee53ab899bdec16e15590ae3bc
13:39 eThaD joined #salt
13:40 eThaD_ joined #salt
13:45 eThaD joined #salt
13:45 DEger joined #salt
13:45 eThaD joined #salt
13:46 Cottser joined #salt
13:54 cuxtud gladia2r : http://paste2.org/47dkUIXY might be whitespaces http://paste2.org/47dkUIXY
13:54 cuxtud https://github.com/saltstack/salt/issues/4231
13:54 saltstackbot [#4231][MERGED] Jinja file templates with if/elseif/endif statements insert a newline in place of the statement | Jinja template:...
14:01 ssplatt joined #salt
14:03 cuxtud or http://paste2.org/U1MdFnN6
14:05 verdurin What is the cleanest way of disabling scheduled tasks?
14:05 verdurin I removed the schedule.conf files from /etc/salt/minion.d but they re-appeared...
14:07 muxdaemon joined #salt
14:09 haam3r gladia2r: in your if statement try removing the curly braces around the app_version variable?
14:10 drawsmcgraw joined #salt
14:14 gladia2r cuxtud: still no luck with those - maybe that whitespace thing is too old - I'm running: 2016.11.1
14:14 gladia2r haam3r: I've tried without curly braces as well, still the same -- hmm
14:15 cuxtud verdurin : easiest is to replace schedule.present to absent or disabled
14:15 verdurin cuxtud: on the minions?
14:16 haam3r gladia2r: did you also remove the qoutes?
14:23 gladia2r yep haam3r; only without quotes, and without curly braces - but no go | {% if grains['app'] == app_version %} -
14:23 gladia2r updated last comment in gist: https://gist.github.com/gladia2r/135aefee53ab899bdec16e15590ae3bc - with the variants i've tried,
14:24 gladia2r also tried with cuxtud version here http://paste2.org/U1MdFnN6 - still the same, phrr - what the heck :)
14:24 brousch__ joined #salt
14:25 dyasny joined #salt
14:25 dyasny joined #salt
14:28 al joined #salt
14:29 gladia2r also tried not the grains way, still no luck: {% if salt['cmd.shell']('/usr/local/bin/app --version | cut -d. -f1') == '{{ app_version }}' %}
14:30 gladia2r with ".. == app_version %}" too
14:37 gladia2r hmm, sec
14:39 dyasny joined #salt
14:40 verdurin Managed it now, thanks cuxtud
14:40 Tanta_G joined #salt
14:44 krymzon joined #salt
14:45 gladia2r I made it work with the salt['cmd.shell'] finally, phew -- not sure whatup with the grains['app'] really - but i gave up on that | thanks for the hints cuxtud and haam3r ;)
14:46 haam3r gladia2r: curious...by the way did "grains.get app" return the correct value?
14:48 al joined #salt
14:50 PatrolDoom joined #salt
14:51 PatrolDoom joined #salt
14:51 Cottser joined #salt
14:57 anotherzero joined #salt
14:57 _JZ_ joined #salt
14:59 dyasny joined #salt
15:00 ALLmightySPIFF joined #salt
15:02 gladia2r haam3r: yes it did/does - last comment: https://gist.github.com/gladia2r/135aefee53ab899bdec16e15590ae3bc
15:03 JoeJulian joined #salt
15:04 ALLmightySPIFF joined #salt
15:05 xet7 joined #salt
15:06 cuxtud gladia2r: can you post your updated state please.
15:13 dyasny joined #salt
15:15 nickabbey joined #salt
15:17 cryptolukas joined #salt
15:18 yuhl___ joined #salt
15:24 tapoxi joined #salt
15:24 austin_ joined #salt
15:25 ravenx using pillar roles, i keep getting:  No minions matched the target. No command was sent, no jid was assigned.
15:25 ravenx ERROR: No return received
15:25 ravenx anyone know why?
15:26 babilen Why do you think it should work? Which command did you execute?
15:27 ravenx i executed this:
15:27 ravenx salt --pillar 'super-app-role:dev' state.apply
15:27 gladia2r cuxtud: sure, see last comment in the gist: https://gist.github.com/gladia2r/135aefee53ab899bdec16e15590ae3bc
15:27 austin_ what would be the most appropriate way to handle an ssh private key?
15:27 ravenx babilen: and i have:  /srv/pillar/top.sls
15:27 austin_ i have it as a pillar in a private repo
15:28 austin_ but having issues getting the content to file
15:28 babilen ravenx: Did you target 'supper-app-role:dev' to one of your minions?
15:28 ravenx babilen: and the top.sls looks like this: https://paste.debian.net/911593/   the 'one' and 'two are real servers
15:29 ravenx babilen: how do i target to one of the minions?  isn't that done via the top.sls file?
15:29 remyd1 joined #salt
15:30 babilen ravenx: So, what's the content of /srv/pillar/super-app/{dev,stag}.sls ? I'd also recommend to use underscores in filenames .. you can use dashes in the actual pillar data if you like though.
15:30 ravenx babilen:  let me show you:
15:30 cscf ravenx, pastebin, not paste, plz
15:31 babilen ravenx: You might also want to include the output of "salt 'one' pillar.get super-app-role:dev"
15:31 babilen err
15:31 babilen ravenx: You might also want to include the output of "salt 'one' pillar.get super-app-role"
15:32 ravenx babilen: http://pastebin.com/mdSehfU4
15:32 ravenx cscf: gotcha
15:32 * babilen begrudgingly opens a pastebin.com link
15:32 ravenx babilen: cscf told me to :<
15:32 cscf Well, I meant pastebins in general, not the specific site :P
15:33 cscf Just didn't want you pasting dozens of lines in channel and getting quieted
15:33 babilen No, cscf wanted you to use a pastebin (of which http://paste.debian.net is one) as opposed to pasting into the channel
15:33 ravenx this is the output of the salt 'one' pillar.get super-app-role http://pastebin.com/AYcPtpFK
15:33 ravenx babilen:ah i see.  yeah i use debian.
15:33 ravenx the debian one*
15:33 babilen ravenx: You have to target pillar data in the pillar SLS ..
15:33 ravenx o_O what does that mean?  i mean i thought it was simply K:V stores
15:34 babilen It is, but you don't have a "k:v" anywhere
15:34 ravenx isn't the "tasks-app-role: dev" as such?
15:34 babilen /srv/pillar/super-app/dev.sls should/might contain something like "super-app-role: dev"
15:35 ravenx right, and it does
15:35 gtmanfred not according to the cat in your pastbin
15:35 babilen ravenx: In which of your two pastes can I find "tasks-app-role: dev" ?
15:35 ravenx wha the heck.  let me take a look.
15:35 gtmanfred according to that, it contains the string super-app/dev.sls
15:35 ttbigc joined #salt
15:35 babilen Which is wrong and the reason for my comment
15:35 ravenx babilen: tasks-app is the actual project name.  i thought i shoudl censor it, to superapp.  i mean i know it's vague, but i failed at substitute and replace
15:35 ravenx superapp and tasks-app are the same thing lol
15:36 gtmanfred that is not a key: value
15:36 Brew joined #salt
15:36 gtmanfred that is just a string
15:36 cscf ravenx, "super-app/dev.sls" is not valid pillar contents
15:36 babilen ravenx: Why don't you create a *single* pastebin with all the information that has been pseudo anonymised in a consistent manner.
15:36 ravenx babilen:  i will do that.
15:36 babilen Thanks
15:38 ravenx https://paste.debian.net/911596/
15:39 edrocks joined #salt
15:39 ravenx with that setup, i run: salt 'one' pillar.get tasks-app-role:dev and it gives me emptiness.
15:40 babilen Did you run saltutil.refresh_pillar beforehand ?
15:40 ravenx :o
15:41 ravenx fuuuuuuuuu
15:41 ravenx hm okaynow that i did run that
15:41 cscf Yeah, pillar doesn't refresh automatically unless you run a highstate or similar operations
15:41 babilen All good now?
15:41 ttbigc Hello all, any suggestions on performance with using syndic's. Bit concern how it will scale as I did notice it was a bit slower to execute job. I was planning on having a multi-master of masters that supply around 20 syndic's which have 2,500 clients connected to each syndic (Plan on having minions having multiple masters (syndic's) in config for HA)
15:41 ravenx babilen: not quite, i am experiencing this:  https://paste.debian.net/911598/
15:42 babilen ravenx: Replace dashes with underscores
15:42 ravenx okay let me try this again
15:43 babilen ttbigc: https://docs.saltstack.com/en/latest/topics/tutorials/intro_scale.html has a couple of generic tips
15:44 ravenx still experiencing this now:  https://paste.debian.net/911599/
15:44 ttbigc Thanks babilen, I read that but did not mention much on topology design
15:44 babilen ttbigc: The individual masters won't have much of a problem, but I am not sure how those higher up in the hierarchy cope. I guess you'll have to run experiments and see for yourself. Generally speaking I'd recommend to run jobs asynchronously and query the job cache later
15:44 ravenx i have changed all the dashes in top.sls and tasks-app folder to tasks_app/
15:44 ravenx could this be something in the /srv/salt dir?
15:45 babilen ttbigc: Yes, it could be
15:46 babilen ENICK
15:46 babilen ravenx: ^
15:46 ravenx aaah
15:46 remyd1_ joined #salt
15:46 ravenx i think i would need to put my /srv/pillar/ into a dev/ and a stag/ dir?
15:46 DEger joined #salt
15:47 babilen ravenx: Could you run "salt --pillar 'tasks_app_role:dev' test.ping" please -- Does that work?
15:47 ravenx absolutely, hang on
15:47 ravenx yes it does
15:48 cscf you need '*', don't you?
15:48 ravenx i see the correct server returning "True"
15:48 babilen So, the pillar is fine
15:48 ravenx and same with stag.
15:48 babilen As is the targeting .. whatever problem you have is related to your states
15:48 ravenx babilen: thanks, so this rules out /srv/pillar problem.  but now it is /srv/salt problems :)
15:49 remyd1_ Hi folks. I would like to get the current ID of the running master (i have 3 masters) into an orchestrator. I tried to use the grains, but grains seem to be unavailable into orchestrator. Any idea on how to achieve that ?
15:49 babilen ttbigc: Unfortunately we don't run at quite that scale, so I can't really help you with it. I'd scale each master so that it can cope with its minions and syndicate those in a semantically meaningful hierarchy ..
15:49 babilen ttbigc: The tips in the "into scale" documentation helped us a lot, but you might want to chat to some people at EMC :)
15:50 ttbigc yeah I wanted to just have one spot to send commands, why looking at syndic's
15:50 babilen Makes sense
15:51 ttbigc hard to test these issues in lab, and hard to roll the dice sometimes when got lots of eyes watching
15:52 gtmanfred remyd1_: opts should be available, so you could probably pass that down to the minion in pillars
15:53 remyd1 in a python code/module ?
15:53 gtmanfred no, in the sls file
15:54 remyd1 Ok, I found the associated doc =)
15:54 remyd1 thanks, gtmanfred
15:55 babilen ttbigc: I totally understand - 2500 minions isn't much of an issue for a single master. As I can waste CPU and disk most of our masters have 16+ cores and quite a bit of memory. Had to tinker with reauth a little and switch to using --async, but that was about it. ping_on_rotate is something you might want to think about also.
15:55 bowhunter joined #salt
15:56 sgo_ joined #salt
15:56 heaje joined #salt
15:56 ttbigc Thanks Babilen for suggestions. Looking to replace mcollective, so tired of activemq and rabbitmq not much better
15:58 ttbigc Was hoping zeromq be more reliable. But looking at the async and querying job cache looks interesting.. Lot more intuitive than what was in mcollective, probably cause I dont like ruby
15:58 gtmanfred ttbigc: one of the reasons we are moving to the tcp transport layer is because zeromq is basically a black box ones packets go in
15:58 babilen ttbigc: Oh, you might also be interested in https://docs.saltstack.com/en/latest/topics/transports/tcp.html
15:58 gtmanfred https://docs.saltstack.com/en/latest/topics/transports/tcp.html
15:59 babilen :-þ
15:59 ttbigc so standard zeromq like UDP, can add TCP transport to make it more reliable basically?
16:00 gtmanfred no, zeromq uses tcp too
16:00 sarcasticadmin joined #salt
16:00 gtmanfred just our "tcp" transport layer just uses tornado
16:01 gtmanfred the plan is to eventually default to tcp
16:01 gtmanfred because we can get better debug information about where packets go missing
16:01 gtmanfred where as with zeromq, it is just a guess
16:01 cro joined #salt
16:02 babilen Debugging connectivity problems with 0mq is horrible
16:03 ttbigc so you running tornade on masters and sending zeromq TCP through that?
16:03 gtmanfred no
16:03 gtmanfred no more zeromq
16:04 bantone morning
16:04 drawsmcgraw we're working toward standardizing on the TCP transport as well
16:05 kojiro joined #salt
16:05 drawsmcgraw Seems to be working out so far. Haven't had any huge deployments but with smaller test deployments and dev environments there's no issues.
16:05 ttbigc basically no message broker, IE limit clients polling, instead push async with tornado
16:05 gtmanfred i believe that we have written the message broker in tornado and are using websockets?
16:05 gtmanfred but i am not positive on that
16:06 DEger joined #salt
16:09 lompik joined #salt
16:11 impi joined #salt
16:19 ttbigc you tested TCP with Syndic's?
16:20 gtmanfred I have not personally, but the syndic uses the minion code to communicate, and it should be pluggable, so in theory it works the same in all of them
16:20 gtmanfred I am sure someone else has tested it
16:23 ttbigc Thanks, I will play with both
16:25 darebwoi joined #salt
16:29 sfxandy joined #salt
16:31 nickabbey joined #salt
16:31 teclator joined #salt
16:37 Cadmus joined #salt
16:39 orianbsilva joined #salt
16:44 cryptolukas joined #salt
16:44 austin_ what is the proper way to store an ssh private key in pillar ?
16:44 gtmanfred this: |
16:45 gtmanfred --- beginnging key ---
16:45 gtmanfred lkjocxziuv
16:45 gtmanfred --- end key ---
16:45 austin_ hmmm
16:45 austin_ failed: could not found expected ':'; line 13
16:45 drawsmcgraw Formatting matters, including spaces
16:45 gtmanfred then use contents_pillar:
16:45 austin_ 100%
16:45 austin_ i seem to be missing something
16:45 drawsmcgraw We use Pillar to store SSH keys
16:45 austin_ so all tabs are spaces
16:46 austin_ gtmanfred: using that. yes.
16:46 gtmanfred that is how I do it... /shrug
16:46 austin_ hmmm
16:46 Cadmus Hello, I'm having a problem with Salt (version 2016.11.1 on CentOS 7). I have a file.managed statement which takes a URL, as the contents of this url are dynamic I've set "skip_verify: True", but I keep getting "Unable to manage file: 'hash_type'" the first time I run any the statement but it works a second time.
16:47 Cadmus Multi-line pillar with spacing mattering? Yes I use the "pipe, then indent one level" formatting for a lot of that
16:48 drawsmcgraw austin_: format it like this answer for cmd.run() - http://stackoverflow.com/a/19663174
16:48 babilen austin_: You might want to take a look at import_text to read the key directly from disk
16:48 thebinary joined #salt
16:48 austin_ we need to store those keys as pillars
16:48 babilen (as an alternative to storing it in YAML)
16:49 gtmanfred austin_: you could still store the key file on disk in the pillar root
16:49 babilen Yes, you would read it into pillars with import_text
16:49 babilen It's just that the *source* of the data would be the actual key and not your YAML SLS
16:52 austin_ as in using `salt://files/id_rsa` ?
16:53 austin_ i mean.. its pretty simple what i'm trying to do :) https://gist.github.com/austinpapp/9798b9d01ffd6e3538f5e2bdc1d4bdc7
16:53 austin_ which means i'm missing something simple
16:53 austin_ and obvious (but clearly not to me)
16:53 austin_ ha
16:54 drawsmcgraw austin_:  here's a copy/paste from ours -> http://pastebin.com/pa1ewiPw
16:54 drawsmcgraw The alignment's off
16:55 eThaD joined #salt
16:56 gtmanfred austin_: remove 2 spaces in front of the key
16:57 austin_ still dislikes it
16:57 austin_ what the
16:58 austin_ i refrshed pillar
16:58 ALLmightySPIFF joined #salt
16:58 austin_ i can see the pillar return back w/o issue
17:00 Cadmus What's bothering me is why it works a second time, like it's trying to do something to hash the file but it's not there the first time?
17:02 sp0097 joined #salt
17:02 babilen austin_: https://docs.saltstack.com/en/latest/ref/renderers/all/salt.renderers.jinja.html → import_text
17:02 babilen No more pesky YAML
17:04 austin_ babilen: ah ok. i see what you are referencing now
17:04 nickabbey joined #salt
17:05 abednarik joined #salt
17:06 austin_ btw, this seems to be an issue for any multiline text i add in this way
17:07 austin_ not just a key ( not that it should matter. maybe there was a char that it didnt like .. at this point testing anything )
17:07 austin_ however obvious it seems
17:10 gtmanfred austin_: you silly pants
17:10 gtmanfred austin_: - contents_pillar: {{ salt['pillar.get']('inf-private:github:key') }} should be contents_pillar inf-private:github:key
17:11 gtmanfred put a colon after contents_pillar
17:11 gtmanfred - contents_pillar: inf-private:github:key
17:11 gtmanfred in your gist
17:11 gtmanfred https://gist.github.com/austinpapp/9798b9d01ffd6e3538f5e2bdc1d4bdc7
17:12 gtmanfred if you want to do pillar.get which is what the file.managed state does on the string in contents_pillar, you would just use contents...
17:14 austin_ gtmanfred: like i said. something obvious just not to me! ugh. i believe that has fixed it
17:14 nickabbey joined #salt
17:14 Cadmus The fact there's so many ways to get a pillar is sometimes a bit of a headscrew
17:14 gtmanfred :D
17:15 austin_ originally i wasn't using contents_pillar and just using context via template
17:15 austin_ well its the ugly design decision that you have to way
17:15 Cadmus So any ideas on my hash_type problem? I did find a bug but it says it's fixed in my version
17:15 gtmanfred yeah, took me looking at it 3 times to find it :D
17:15 gtmanfred Cadmus: link?
17:15 austin_ consistency is a big deal
17:17 austin_ contents_pillar: x:y:z versus contents_pillar: {{ salt['pillar.get']('x:y:z') }}
17:17 Cadmus gtmanfred: Here's the output from the API and the most detailed version of the issue, but I'm seeing the same thing if I run it on the salt master directly. https://github.com/jenkinsci/saltstack-plugin/issues/50
17:17 saltstackbot [#50][MERGED] "comment": "Unable to manage file: 'hash_type'", | Hello, we're using this plugin for deploying freshly built jar files to our dev servers and we're getting the error in the title in the Salt output....
17:17 Cadmus It's on that github because I thought it was a problem with that plugin, but I've eliminated that now
17:21 gtmanfred is there an issue about it on the https://github.com/saltstack/salt/issues?
17:21 samodid joined #salt
17:23 Cadmus I found this https://github.com/saltstack/salt/issues/38472 but it seems to relate to an older version than the one I have installed. That activity is very recent though, am I misinterpreting it
17:23 saltstackbot [#38472][MERGED] file.managed Unable to manage file: 'hash_type' (2016.3.4) | Description of Issue/Question...
17:23 Cadmus Sorry, can you tell I'm a sysad just starting to try and do the devops thing :P
17:24 edrocks joined #salt
17:26 Cadmus I'm on 2016.11.1 for both master and minion
17:27 raspado joined #salt
17:28 Trauma joined #salt
17:29 wendall911 joined #salt
17:31 drawsmcgraw I don't suppose anyone knows anything about Saltconf 17? I haven't seen or heard anything about it so far.
17:38 Cadmus Oh I see, it's been merged but not packaged yet (I'm using the rpm repo), that's why I can't see an update.
17:40 ivanjaros joined #salt
17:40 ekristen joined #salt
17:41 cryptolukas joined #salt
17:42 tiwula joined #salt
17:46 keltim joined #salt
17:48 keltim in top.sls, will "match:grain" match the mere existence of the grain?
17:48 keltim or does it req. a value?
17:51 pipps joined #salt
17:51 whytewolf iirc it requires a value
17:53 debian112 joined #salt
17:55 leonkatz joined #salt
17:56 ruxu joined #salt
17:56 brousch__ How do I determine what release this PR made it into? https://github.com/saltstack/salt/pull/32373
17:56 saltstackbot [#32373][MERGED] Resolve memory leak in authentication | What does this PR do?...
18:01 whytewolf brousch__: a search for that pr in the online documentation [where the changelogs are held] shows that it is in https://docs.saltstack.com/en/latest/topics/releases/2015.8.9.html
18:02 nickabbey joined #salt
18:02 brousch__ Thanks. I could've sworn I looked at all of those.
18:03 whytewolf they are a pain to look through, and easy to miss things. only reason i foun it is because of the search feature
18:04 dyasny joined #salt
18:07 brousch__ OK, so if it's in 2015.8.9, what 2016.3 version would it be in?
18:13 brousch__ Based on dates, it seems like it should be in 2016.3.1, but I don't see it mentioned in the release notes
18:15 nebuchadnezzar joined #salt
18:16 ivanjaros joined #salt
18:16 whytewolf i actually see the code for it in 2016.3.0
18:19 aw110f joined #salt
18:19 brousch__ Maybe I don't understand the version scheme. How would an April bug fix make it into a March release?
18:20 whytewolf because it might have been fixed in the beta version before the bug was found in 2015.8
18:21 Rumbles joined #salt
18:22 whytewolf also iirc 2015.3 was WAY late on release
18:22 whytewolf err 2016.3
18:23 whytewolf but apperently that was merged forward from the bug. https://github.com/saltstack/salt/blame/v2016.3.0/salt/crypt.py#L460-L462
18:26 danlsgiga joined #salt
18:27 Sammichmaker joined #salt
18:30 Lebsky joined #salt
18:30 danlsgiga Hi everyone... anyone have an idea when 2016.11.2 is going to be out?
18:33 fxhp joined #salt
18:36 netcho joined #salt
18:36 gtmanfred danlsgiga: when it is ready
18:38 Inveracity joined #salt
18:38 DammitJim joined #salt
18:39 ruxu joined #salt
18:41 DammitJim is there something like a report that can tell you what minions are compliant for a state?
18:41 brousch__ Thanks whytewolf
18:45 cscf DammitJim, you could state.apply with test=True ?
18:46 DammitJim yeah, but that's not pretty
18:46 DammitJim let me try it again to make sure I am not comparing the wrong thing
18:48 cscf DammitJim, you want a simple True/False per minion, whether there were any changes?
18:48 DammitJim cscf, I just want to see what minions are compliant
18:50 gtmanfred DammitJim: there is, but requires the enterpise api and the UI
18:55 DammitJim thanks
18:58 PatrolDoom joined #salt
18:58 Edgan joined #salt
19:02 nickabbey joined #salt
19:02 bowhunter joined #salt
19:03 s_kunk joined #salt
19:06 Ahlee oh man, i missed it
19:06 nZac joined #salt
19:06 Ahlee but happy belated 3rd birthday 0.17.5
19:08 Praematura joined #salt
19:09 pipps joined #salt
19:12 k_sze[work] joined #salt
19:13 bookwar joined #salt
19:15 edrocks joined #salt
19:20 chowmein__ joined #salt
19:22 leonkatz joined #salt
19:22 nickabbey joined #salt
19:23 cliluw joined #salt
19:24 irctc081 joined #salt
19:26 nixjdm joined #salt
19:26 chowmeined joined #salt
19:27 ivanjaros3916 joined #salt
19:27 irctc081 hello, anybody here understand and can explain me how the pkg.install works for windows minions? Does the master first download the https://.exe and then send it to the minions or minions download the files individually from the internet?
19:30 netcho joined #salt
19:30 chowmein__ joined #salt
19:31 gtmanfred i believe that if it is not a salt:// the minion downloads it if you provide an http(s):// link
19:32 gtmanfred because the module runs on the minion, and there wouldn't be a way to tell the master to cache the exe for the minions
19:32 gtmanfred unless you did it in your repo yourself, and used salt://
19:33 chowmeined joined #salt
19:34 whytewolf was going to say even if using salt:// you still need to make sure the file is there for the minion.
19:34 whytewolf :P
19:35 whytewolf although i guess if no source is provided it uses win_repo
19:35 whytewolf https://docs.saltstack.com/en/latest/topics/windows/windows-package-manager.html
19:42 irctc081 Alright! Thank you for your answers! :D
19:42 keldwud joined #salt
19:48 PatrolDoom joined #salt
19:53 SaucyElf joined #salt
19:54 SaucyElf joined #salt
20:06 cyborg-one joined #salt
20:06 ChubYann joined #salt
20:14 nickabbey joined #salt
20:18 dyasny joined #salt
20:19 krymzon joined #salt
20:22 bakins joined #salt
20:29 cscf If I use the 'network' state, any time it changes an interface in /etc/network/interfaces it deletes any other lines, like 'source /etc/network/interfaces.d/*'
20:30 gtmanfred MTecknology: did your PR fix this? ^^
20:31 gtmanfred cscf: this might be worth testing https://github.com/saltstack/salt/pull/38043
20:31 saltstackbot [#38043][MERGED] Debian networking fix | Resolves #38042; regression introduced in 2016.11.0.
20:31 gtmanfred it will be in 2016.11.2
20:32 dyasny joined #salt
20:33 sh123124213 joined #salt
20:33 cscf gtmanfred, I don't think that's the same problem, it seems to be only for fancier ifaces like bonds.  this is something outside an iface.  I would assume it's simply parsing the ifaces, modifying them, then re-exporting them, and just losing comments & the source line along the way.
20:33 gtmanfred ahh, maybe
20:33 cscf I do mean to set up a VM running salt develop one of these days, though
20:35 MTecknology my changes /should/ be in 2016.11.1
20:36 gtmanfred oh thats right, we got it in right before the tag
20:36 MTecknology my only change in 2016.11.2 is a regression with the versions of python-psutil <= 6.0.0
20:37 MTecknology (ubuntu 12.04)
20:37 gtmanfred when is that end of lifed?
20:37 gtmanfred i felt like it should have been already
20:38 gtmanfred nope
20:38 gtmanfred but soon
20:40 DammitJim joined #salt
20:41 edrocks joined #salt
20:42 MTecknology I have a new bed! :D
20:44 MTecknology I dropped the mattress off the truck. Thought it was heavy enough to not need me going overkill with the straps. I underestimated the wind. oops... it's okay, though. New bed in and old bed now part of what I can almost call a guest room. :)
20:44 MTecknology and there was salt in the water the mattress fell into so it's relevant? :P
20:44 gtmanfred hah
20:50 sfxandy joined #salt
20:53 Miouge joined #salt
20:57 Brew1ForMe joined #salt
20:57 evidence joined #salt
21:00 xbglowx_ joined #salt
21:02 Brew1ForMe New deployment: I'm dealing with an issue where many of the minions will return "Minion did not return. [No response]" or [Not connected], after issuing a remote execution test.ping
21:03 MTecknology Brew1ForMe: watch top when you do that
21:03 jcocozzi joined #salt
21:03 Brew1ForMe ok
21:03 gtmanfred how many minions do you have?
21:03 irctc713 joined #salt
21:03 Brew1ForMe 534
21:04 gtmanfred you might need to increase the number of workers you have
21:04 gtmanfred https://docs.saltstack.com/en/latest/ref/configuration/master.html#worker-threads
21:04 bowhunter joined #salt
21:04 Brew1ForMe alright, I'll try that
21:04 gtmanfred also, 534 is probably a good time to stop relying on the return feedback to the commandline, and start using --async, and checking that it is returning by checking the job cache
21:04 gtmanfred https://docs.saltstack.com/en/latest/topics/jobs/job_cache.html
21:05 gtmanfred https://docs.saltstack.com/en/latest/topics/jobs/external_cache.html
21:05 gtmanfred https://docs.saltstack.com/en/latest/topics/tutorials/intro_scale.html
21:05 preludedrew joined #salt
21:05 jcocozzi Hi everyone. I am trying to provision an vagrant box using salt. Formerly I would use salt-ssh with extra_filerefs defined. When my salt state file is running using vagrant provisioning it seems like it is no longer finding these extra_filerefs. Where should they be definied? Thanks in advance
21:05 irctc713 hello! Anybody knows how to execute master commands on windows-minions as currently connected minion user and not SYSTEM user?
21:05 whytewolf hell I stop relying on the feedback from the command line at anything more then a single sls on a single minion :P
21:07 jcocozzi basically I'm asking where extra_filerefs should be defined if not using salt-ssh via the cli
21:08 andi^ joined #salt
21:08 abednarik joined #salt
21:08 gtmanfred jcocozzi: you should be able to put it in the master config
21:08 gtmanfred but it should still support it from the commandline
21:09 whytewolf isn't extra_filerefs purely a salt-ssh thing. if not using salt-ssh then the files that the minion has access to are avalible
21:09 gtmanfred i still see the option, if you could give us some simple steps to set this up, could you open an issue on github with that bug?
21:11 jcocozzi Since vagrant controls the command line call, I'm not sure how much control I have over it. Using Vagrant to provision using salt is still really new to me.
21:11 nickabbey joined #salt
21:12 jcocozzi I do not have a master file since I formally only ran this SLS using salt-ssh. I'm guessing I will have to make a master file and that might solve my problems
21:12 whytewolf jcocozzi: is this a masterless setup currently?
21:13 jcocozzi yes
21:13 jcocozzi git
21:13 jcocozzi (whoops, ignore that)
21:14 whytewolf and you are not using salt-ssh anymore just provisioning through the vagrent salt setup?
21:14 jcocozzi correct
21:14 whytewolf okay. then there is no extra_filerefs
21:14 gtmanfred ooohh, sorry my mistake, i got it backwards
21:15 whytewolf extra_filerefs is an option for salt-ssh to package extra files that it isn't able to determine through standard includes and yaml.
21:16 ALLmightySPIFF joined #salt
21:16 whytewolf but the minion should have access to all those files directly through the filesystem directly
21:17 jcocozzi I see
21:17 jcocozzi ls
21:17 whytewolf . .. wrong_window.txt
21:18 jcocozzi OK. I think I understand how to get this working. Thank you very much gtmanfred and whytewolf!
21:20 pipps joined #salt
21:23 leonkatz joined #salt
21:23 abednarik joined #salt
21:32 pipps joined #salt
21:38 abednarik joined #salt
21:46 SaucyElf joined #salt
21:48 SaucyElf joined #salt
22:00 pipps joined #salt
22:01 xbglowx joined #salt
22:01 eThaD joined #salt
22:03 leonkatz joined #salt
22:05 pipps99 joined #salt
22:14 Tanta_G joined #salt
22:16 nickabbey joined #salt
22:22 Brew left #salt
22:22 pipps joined #salt
22:22 gtmanfred danlsgiga: now
22:23 eThaD joined #salt
22:24 Topic for #salt is now Welcome to #salt! <+> Latest Versions: 2016.3.4, 2016.11.1 <+> Support: https://www.saltstack.com/support/ <+> Logs: http://irclog.perlgeek.de/salt/ <+> Paste: https://gist.github.com/ (please don't multiline paste into channel) <+> See also: #salt-devel, #salt-offtopic <+> Ask with patience as we are volunteers and may not have immediate answers
22:24 Topic for #salt is now Welcome to #salt! <+> Latest Versions: 2016.3.5, 2016.11.2 <+> Support: https://www.saltstack.com/support/ <+> Logs: http://irclog.perlgeek.de/salt/ <+> Paste: https://gist.github.com/ (please don't multiline paste into channel) <+> See also: #salt-devel, #salt-offtopic <+> Ask with patience as we are volunteers and may not have immediate answers
22:25 sfxandy joined #salt
22:32 nZac joined #salt
22:35 gableroux joined #salt
22:36 sarcasticadmin joined #salt
22:38 danlsgiga gtmanfred, ZOMG!!! :D
22:39 danlsgiga gtmanfred, Thanks for the heads up!
22:40 Deliant joined #salt
22:42 evidence joined #salt
22:53 xbglowx joined #salt
22:58 fenlee joined #salt
22:59 fenlee hi guys, I need just quick help to start one of existent config, I'm so familiar with saltstack. May I ask you please ?
23:00 leonkatz joined #salt
23:02 whiteinge fenlee: yes :)
23:02 fenlee huge thanks :)
23:04 fenlee so the question is. What I see in salt config... one folder is \common-> with subfolders /pillar and /states
23:04 eThaD joined #salt
23:05 sh123124213 joined #salt
23:06 fenlee I'm interested with apply the file firewall.sls wich placed in /states/system/firewall.sls
23:06 fenlee as far I got I can target this config to specific minion
23:06 druonysus_ joined #salt
23:07 fenlee by salt '*' test.ping I found the minion I need to apply firewall config. minion_21
23:08 fenlee I'n not sure :( how to do it
23:09 fenlee but I know this kind. salt 'minion_21' state.apply (and I don't know what next)
23:09 whiteinge you can see all available sls files by running `salt 'minion_21' cp.list_states` the syntax that is returned is the same syntax accepted by `state.apply`
23:10 fenlee tried to find the manual about format of commands in https://docs.saltstack.com/en/latest/ref/cli/salt.html but no luck :(
23:10 fenlee oh thanks, let me try :)
23:11 fenlee I'm fearing destroy my remote minion_21
23:12 abednarik joined #salt
23:13 fenlee one question, is it only showing the list to me or something will be actioned on the minion_21 ?
23:13 whiteinge it's a function that tells minion_21 to ask the master what .sls files are available under `file_roots`. so it queries only.
23:14 whiteinge it's safe :)
23:15 fenlee oh thank you much :) trying
23:16 nZac joined #salt
23:22 kizeni joined #salt
23:23 fenlee I see many lines which looks like "- minion_web.iptables"  "minion_tools"  "- minion_tools.system"
23:23 fenlee how can I use it to apply on my minion_21 ?
23:24 fenlee ' salt 'minion_21' state.apply minion_web.iptables ' ?
23:25 whiteinge yes, exactly
23:25 fenlee oh god... seems my heart attack comming...
23:26 eThaD joined #salt
23:27 kizeni Hey, guys. It appears pypi has a salt package that looks to be officially supported, but I'm not seeing mention of it in the saltstack documentation. Is the pip installation a stable medium to install from?
23:36 whiteinge kizeni: yes. the official packages are built from the sdist that is uploaded to pypi.
23:37 whiteinge fenlee: breathe into a paper bag!  ;-)
23:39 lionel joined #salt
23:41 guerby joined #salt
23:45 APLU joined #salt
23:46 sh123124213 joined #salt
23:47 fenlee whiteinge: thank you :) now I know how to do it. have a good time !
23:49 whiteinge woot :)
23:52 abednarik joined #salt
23:56 guerby joined #salt

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary