Perl 6 - the future is here, just unevenly distributed

IRC log for #salt, 2016-09-03

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:00 iggy or returner or whatever
00:00 mattp_ well technically you are affecting the state of a ticet
00:00 fracklen joined #salt
00:00 mattp_ iggy: its not clear to me how you would conditionally log with a returner, that is a firehose
00:00 edrocks joined #salt
00:01 mattp_ I'm trying to update a ticket when milestones of a run are reached - i dont want every single step to be sent. id like to say when I send an update explicitly
00:01 iggy log everything, and filter on the other end (at the point things are viewed
00:02 iggy if you are dead set on doing it this way, then yes, I'd use a module
00:02 mattp_ iggy: sadly my deadsetting is a forced hand from legacy :)
00:03 mattp_ iggy: similar issue, if I need to track state for a single run.. how is this done?
00:03 mattp_ thank you for taking some time to field my nub qs by the way
00:03 iggy modules have access to __context__
00:05 mattp_ YES, i knew this was a thing
00:05 mattp_ but lost it at some point
00:05 mattp_ does this persist across master to minion in an orch run too?
00:06 iggy no
00:06 iggy you would have to pass data around via pillar/args
00:07 mattp_ iggy: thanks. I owe you a beer
00:07 iggy and context only exists inside of a single state run... so if you have multiple states that run via orchestrate, they wouldn't have access to each other's __context__
00:08 mattp_ ah
00:08 iggy if I were in your shoes, I'd probably write a custom runner and let it do all the heavy lifting/data passing
00:09 iggy I really wish I could show you an example of what I'm talking about, but I'd have big red on my ass in a hot minute if any of the stuff I wrote ended up outside the office
00:10 mattp_ haha. i hear ya
00:10 mattp_ iggy: https://github.com/saltstack/salt/blob/develop/salt/runners
00:10 mattp_ perhaps you can point to one here that would demonstrate your point?
00:11 flowstate joined #salt
00:11 iggy maybe pagerduty?
00:13 onlyanegg Does anyone know the status of https://github.com/saltstack/salt/issues/22063 ?
00:13 saltstackbot [#22063][OPEN] Wildcard inside top.sls file for pillar | NOTE: Works for states, this is now an issue for adding this functionality for pillar...
00:14 iggy probably some good stuff in the jobs runner as well
00:14 iggy (as far as running commands on minion and doing something with the return data)
00:14 iggy onlyanegg: not being worked on afaik
00:15 onlyanegg k, thx
00:16 mattp_ damnit, salt is too complex
00:16 mattp_ its hurting my brain :)
00:16 onlyanegg I'm looking into it, cuz it would be nice to have. Not sure if I have the chops to do it though.
00:16 s0undt3ch joined #salt
00:19 mattp_ iggy: is there any functional difference between a runner and an execution module
00:19 mattp_ other than an implicit rule that runners are master only?
00:19 iggy that's mostly it
00:22 mattp_ and runners can run runners. ok haha
00:22 mattp_ my problem is Id need to pass data across an orch run
00:23 mattp_ iggy: do you work at saltstack?
00:23 iggy no
00:23 iggy Utah is the pits
00:25 mattp_ haha. (I agree)
00:32 onlyanegg SLC is pretty nice
00:33 mattp_ no its not :)
00:38 iggy ^ I'm sure there are people that like it, but it's definitely not for me
00:39 onlyanegg only been there for a day or so and just in SLC
00:40 iggy they have a surprisingly large homeless problem (considering how cold it gets)
00:46 edrocks joined #salt
00:58 ivanjaros joined #salt
01:04 amcorreia joined #salt
01:17 flowstate joined #salt
01:19 fannet joined #salt
01:22 amy_ joined #salt
01:27 Nahual joined #salt
01:28 DEger joined #salt
01:33 kevc joined #salt
01:39 mavhq joined #salt
01:42 catpigger joined #salt
01:46 cyborg-one joined #salt
01:52 Brijesh1 joined #salt
01:52 Brijesh1 joined #salt
01:53 ivanjaros joined #salt
02:01 filippos joined #salt
02:02 lilvim joined #salt
02:13 bastiand1 joined #salt
02:16 ZachLanich joined #salt
02:57 ivanjaros joined #salt
02:57 jaybocc2 joined #salt
03:04 flowstate joined #salt
03:04 flowstate joined #salt
03:20 fannet joined #salt
03:32 stooj joined #salt
03:34 DEger joined #salt
03:45 ivanjaros joined #salt
03:47 ageorgop joined #salt
03:48 berto- joined #salt
03:49 sp0097 joined #salt
03:52 flowstate joined #salt
03:55 Nahual joined #salt
03:56 ivanjaros joined #salt
03:59 jaybocc2 joined #salt
04:05 mavhq joined #salt
04:30 mikea joined #salt
04:31 mikea Is there a way for one salt master in a central location manage minions connected to remote salt masters spread out all over the world?
04:32 mikea like, I'd like to be able to run salt '*' test.ping and get results from every salt minion in our enterprise
04:33 edrocks joined #salt
04:34 MTecknology mikea: salt-syndic
04:34 mikea ah, that is exactly what I wanted
04:34 mikea thanks!
04:39 LotR joined #salt
04:44 alxchk joined #salt
04:44 ub1quit33 joined #salt
04:45 ivanjaros joined #salt
04:49 sp0097 joined #salt
04:52 flowstate joined #salt
04:55 cmarzullo joined #salt
04:58 amy_ joined #salt
04:59 ninjada joined #salt
05:06 mikea MTecknology, can you run salt-api on a syndic?
05:06 MTecknology I've never touched salt-api
05:11 zer0def joined #salt
05:13 iggy it would run on the MoM
05:14 iggy test syndic carefully... it has some drawbacks that make it less than ideal for some people (but it works great for others)
05:15 jaybocc2 joined #salt
05:21 ZachLanich joined #salt
05:25 notnotpeter joined #salt
05:27 mikea iggy, examples?
05:27 iggy when I tried it, there were grains caching issues and mine issues (at least)
05:27 iggy but your best bet is to search the issue tracker to see what is still open
05:31 MTecknology I started using salt-syndic when I reached capacity w/ a single salt master w/ what I was doing. When some bugs were resolved and I got to stop doing four syndics, a master, and each minion connected to a syndic, the world got a million times better
05:32 MTecknology the bugs fixed let me drop to a single master and nothing but smiles were had
05:33 mikea my issue is that my minions are in datacenters all over the world
05:34 mikea my thought was to have a syndic in each datacenter report to a master in a central location
05:34 mikea and I'd write saltstates for the syndic to ensure all of the files exist on each syndic
05:36 mikea about how many minions per syndic?
05:36 mikea my use case would be 300-500 or so
05:39 mikea and out masters/syndics would be vms on ESX clusters, so I wasn't going to bother with HA beyond what vmware provides
05:46 iggy we just use multiple levels of masters and "nest" the commands from the MoM
05:47 iggy but generally we don't have people doing stuff across our entire collection of servers
05:47 iggy someone will be working in a single pop and just log into that master
05:50 jaybocc2 joined #salt
05:50 mikea yeah, we could do that also but I want to pull all of the logs into one place and create a nice dashboard and use the grains to populate our CMDB
05:51 mikea so it's convenient from an integration standpoint to have all of the minions addressable from a single master
05:51 mikea rather than having to keep track of which minion is where, etc
05:52 flowstate joined #salt
05:52 mikea if the syndic is that bad I should start looking at the issue tracker and fixing things
05:54 iggy you'll have probably have to just try it
05:54 mikea which is more proper, reading the event data or creating a custom returner?
05:54 mikea or using the elasticsearch returner, which already exists and probably does what I want
05:55 iggy that is one of those features that just has an incomprehensible matrix of features vs versions
05:55 iggy yeah, that depends on your needs... if you can get away with it, use what's there
05:55 mikea right now we have all of these different locations which are all managed differently and by different tools and all the builds are different and everything is a mess
05:56 mikea I'm trying to create one infrastructure tool set to rule them all
05:56 mikea one salt, one elk, one auth, one dns
05:56 mikea etc
05:56 iggy sounds ambitious
05:56 mikea probably
05:56 iggy how many systems are we talking?
05:57 mikea like 15,000 or so
05:57 mikea most of those are in two large data centers
05:57 mikea and then we have smaller footprints all over the world
05:58 mikea a big chunk of them are ESX servers running VMs for customers
05:58 iggy sounds like my setup (but smaller)
05:58 mikea and we don't manage customer VMs
05:58 mikea I'll share mine if you share yours =p
05:59 iggy sounds similar... ~25k systems by eoy (working on a big build out right now) except we are primarly bare metal
06:00 mikea I'm glad we're all vmware
06:01 mikea it makes things so much easier
06:01 mikea HA and whatnot
06:01 mikea especially because I don't have to deal with vmware or the hardware it sits on
06:01 mikea We do have some bare metal, and I'm about to deploy more
06:02 mikea I'm looking at a 20 node elasticsearch cluster
06:02 mikea but the more I look at it, the more I worry if that's going to be big enough
06:03 mikea I want to consolidate all the logs from all of our servers and network devices
06:05 DEger joined #salt
06:05 manji joined #salt
06:10 fannet joined #salt
06:10 Satyajit joined #salt
06:11 iggy we have way more than 20
06:11 iggy I want to say closer to 150 (but then that's not all ES... hadoop, etc)
06:16 justanotheruser joined #salt
06:16 fracklen joined #salt
06:16 justanotheruser joined #salt
06:25 mikea iggy, any recommendations for long term retention?
06:25 mikea these elastic search boxes I'm about to buy are pretty pricey, 4TB ssds aren't cheap
06:26 mikea I was thinking hadoop with cheap big sata drives
06:26 mikea or a big netapp filled with big cheap sata drives
06:26 iggy that's not really my area... I think they have a tiered setup (recent data on SSDs, older data on rust)
06:27 mikea yeah, we're going to keep 3 months on ssd, after that I'm not sure where to put it
06:27 mikea we have to keep a year for compliance purposes
06:50 AndreasLutro joined #salt
06:53 flowstate joined #salt
07:09 debian112 joined #salt
07:13 justanotheruser joined #salt
07:23 dariusjs joined #salt
07:25 ninjada joined #salt
07:27 jaybocc2 joined #salt
07:35 Lionel_Debroux joined #salt
07:36 ninjada joined #salt
07:36 Lionel_Debroux joined #salt
07:42 Rumbles joined #salt
07:47 chrichip joined #salt
07:51 catpig joined #salt
07:51 flowstate joined #salt
07:53 catpig joined #salt
08:14 debian112 joined #salt
08:16 flowstate joined #salt
08:24 bocaneri joined #salt
08:37 edrocks joined #salt
08:50 flowstate joined #salt
09:00 capri joined #salt
09:30 DEger joined #salt
09:36 DEger joined #salt
09:38 jaybocc2 joined #salt
09:42 zz_capri joined #salt
09:49 DEger joined #salt
09:50 Lionel_Debroux joined #salt
09:50 flowstate joined #salt
09:53 q1x joined #salt
09:54 ivanjaros joined #salt
09:54 jaybocc2 joined #salt
09:58 CeBe joined #salt
10:14 mikecmpbll joined #salt
10:50 flowstate joined #salt
10:55 debian112 joined #salt
11:01 om joined #salt
11:20 Taters_ joined #salt
11:20 inad922 joined #salt
11:39 Pulp joined #salt
11:46 capri joined #salt
11:51 flowstate joined #salt
12:05 jaybocc2 joined #salt
12:19 WKNiGHT joined #salt
12:21 jaybocc2 joined #salt
12:31 amcorreia joined #salt
12:36 oida joined #salt
12:39 edrocks joined #salt
12:39 N-Mi joined #salt
12:50 flowstate joined #salt
13:02 mikecmpbll joined #salt
13:07 oida joined #salt
13:12 xmj joined #salt
13:13 xmj__ joined #salt
13:17 amy_ joined #salt
13:36 ninjada joined #salt
13:50 flowstate joined #salt
14:14 bluenemo joined #salt
14:22 amy_ joined #salt
14:33 jaybocc2 joined #salt
14:38 rootforce joined #salt
14:46 amy_ joined #salt
14:48 jaybocc2 joined #salt
14:50 flowstate joined #salt
14:51 cmarzullo joined #salt
14:57 marie1972 joined #salt
14:59 cmarzullo joined #salt
15:03 marie1972 left #salt
15:04 catpigger joined #salt
15:06 catpiggest joined #salt
15:06 west575 joined #salt
15:10 mikeywaites joined #salt
15:10 mikeywaites Hey - anyone know how to specify EBS backed block_device_mapping with salt cloud profile ?
15:11 mikeywaites the aim/size i want to use doesn't support instance_store which seems to be the default.
15:11 justanotheruser joined #salt
15:11 west575 joined #salt
15:12 mikeywaites ami*
15:19 Nahual joined #salt
15:27 mikeywaites ah.  just realised i was using he wrong instance type
15:41 flowstate joined #salt
15:53 catpigger joined #salt
15:54 danieloliveira joined #salt
15:55 catpig joined #salt
16:06 danieloliveira hi all, for what reason a module placed in srv/salt/_modules would not be loaded
16:06 danieloliveira I am applying a patch using https://github.com/saltstack/salt/pull/35285
16:06 saltstackbot [#35285][MERGED] Fixes #30577 - Add log_config option | What does this PR do?...
16:07 danieloliveira it is fix to dockerng module
16:07 danieloliveira to use syslog options
16:07 danieloliveira I added _modules and _states to /srv/salt/
16:07 devster31 joined #salt
16:07 danieloliveira and I can see that state is loading ok
16:07 danieloliveira but it cant import from module
16:07 cmarzullo joined #salt
16:08 devster31 joined #salt
16:08 devster31 joined #salt
16:08 danieloliveira I have files: /srv/salt/_modules/dockerng.py and /srv/salt/_states/dockerng.py
16:08 devster31 joined #salt
16:09 devster31 joined #salt
16:09 danieloliveira however from salt.modules.dockerng import (     CLIENT_TIMEOUT,     STOP_TIMEOUT,     VALID_CREATE_OPTS,     _validate_input,     _get_repo_tag )
16:09 devster31 joined #salt
16:09 devster31 joined #salt
16:09 danieloliveira is not importing VALID_CREATE_OPTS from the custom dockerng.py
16:10 danieloliveira any suggestion?
16:25 dariusjs joined #salt
16:27 sp0097 joined #salt
16:27 Taters_ joined #salt
16:29 barmaley joined #salt
16:29 sp0097 joined #salt
16:34 danieloliveira should a module placed in _modules override any previously loaded that have the same __virtual__ name?
16:40 mikeywaites1 joined #salt
16:41 DEger joined #salt
16:42 catpigger joined #salt
16:42 edrocks joined #salt
16:51 flowstate joined #salt
17:00 jaybocc2 joined #salt
17:01 iggy you don't normally load modules like that
17:02 iggy salt.modules (and salt.states/returners/etc) aren't traditional python modules
17:02 iggy they use Salt's module loader instead of the normal python loader
17:11 catpiggest joined #salt
17:13 catpig joined #salt
17:14 justanotheruser joined #salt
17:15 ninjada joined #salt
17:15 jaybocc2 joined #salt
17:32 amcorreia joined #salt
17:36 danieloliveira tks iggy
17:36 danieloliveira I decided by another approach and will be waiting for the new official release of Salt
17:37 danieloliveira my problem is related to the dockerng module
17:37 danieloliveira which on the current salt version 2016.3 there is no support for select log_driver
17:37 danieloliveira thank you
17:39 rvaldes joined #salt
17:45 haam3r joined #salt
17:47 ageorgop joined #salt
17:50 flowstate joined #salt
17:51 jaybocc2 joined #salt
17:51 tuxx joined #salt
17:51 sjmh joined #salt
17:54 mike25de joined #salt
18:13 edrocks joined #salt
18:14 colegatron_origi joined #salt
18:23 edrocks_ joined #salt
18:26 sp0097 joined #salt
18:28 Taters_ joined #salt
18:45 justanotheruser joined #salt
18:55 mikeywaites joined #salt
19:01 justanotheruser joined #salt
19:01 justanotheruser joined #salt
19:13 edrocks joined #salt
19:16 ninjada joined #salt
19:23 ajolo_ joined #salt
19:23 FreeSpencer joined #salt
19:24 FreeSpencer joined #salt
19:24 justanotheruser joined #salt
19:30 Nahual joined #salt
19:50 mikeywaites1 joined #salt
19:52 lilvim joined #salt
19:52 philhuk joined #salt
20:06 justanotheruser joined #salt
20:14 haam3r joined #salt
20:16 kojiro joined #salt
20:17 ninjada joined #salt
20:19 kojiro I want to use salt-cloud with salt-ssh. It seems like it should work if my minion config indicates file_local. Are there any gotchas I should watch out for?
20:19 DEger joined #salt
20:36 DEger joined #salt
20:37 sjmh joined #salt
20:48 wych joined #salt
20:51 ZachLanich joined #salt
20:54 kojiro joined #salt
21:22 intr1nsic joined #salt
21:25 debian112 joined #salt
21:37 xenoxaos joined #salt
21:38 pfallenop joined #salt
21:44 thejrose1984 joined #salt
21:44 debian112 joined #salt
21:45 hopthrisC joined #salt
21:46 ageorgop joined #salt
21:49 dyaln joined #salt
21:57 intr1nsic joined #salt
21:57 xenoxaos joined #salt
21:58 flowstate joined #salt
22:06 intr1nsic joined #salt
22:06 debian112 joined #salt
22:14 oida joined #salt
22:15 xenoxaos joined #salt
22:18 johnkeates joined #salt
22:23 dyaln joined #salt
22:24 ZachLanich joined #salt
22:25 ageorgop joined #salt
22:31 debian112 joined #salt
22:34 DEger joined #salt
22:50 Satyajit joined #salt
22:55 xenoxaos joined #salt
22:56 debian112 joined #salt
22:56 cyborg-one joined #salt
23:14 debian112 joined #salt
23:19 dyaln joined #salt
23:35 nidr0x joined #salt
23:36 DEger joined #salt
23:38 dyaln joined #salt
23:40 oida joined #salt
23:41 kojiro joined #salt
23:42 debian112 joined #salt
23:43 xenoxaos joined #salt

| Channels | #salt index | Today | | Search | Google Search | Plain-Text | summary