Perl 6 - the future is here, just unevenly distributed

IRC log for #fuel, 2014-09-08

| Channels | #fuel index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
00:24 jaranovich joined #fuel
02:19 harybahh joined #fuel
02:34 geekinutah joined #fuel
04:03 Alexander joined #fuel
04:19 harybahh joined #fuel
04:31 ArminderS joined #fuel
04:48 adanin joined #fuel
06:19 Obi-Wan joined #fuel
06:19 Obi-Wan joined #fuel
06:20 harybahh joined #fuel
06:24 eshumkher joined #fuel
06:30 hyperbaba joined #fuel
07:02 pasquier-s joined #fuel
07:03 pasquier-s_ joined #fuel
07:04 harybahh joined #fuel
07:16 Longgeek joined #fuel
07:19 eshumkher joined #fuel
07:22 e0ne joined #fuel
07:46 eshumkher joined #fuel
07:55 HeOS joined #fuel
07:57 Llew joined #fuel
08:04 adanin joined #fuel
08:07 Longgeek joined #fuel
08:20 e0ne joined #fuel
08:38 ddmitriev joined #fuel
09:00 tuvenen joined #fuel
09:04 brain461 joined #fuel
09:12 dkaigarodsev joined #fuel
09:31 geekinut1h joined #fuel
10:06 taj joined #fuel
10:11 e0ne joined #fuel
10:35 pal_bth joined #fuel
10:46 adanin joined #fuel
10:52 pal_bth left #fuel
10:55 evg lethal-gr: hi, you can add additional (centos 6.5) repository for your nodes and install the packages you need. (if i've got your question)
11:16 omelchek joined #fuel
12:11 pal_bth joined #fuel
12:11 harybahh joined #fuel
12:15 pal_bth Hej, anybody successfully installed on Dell PowerEdge R715 or R415 devices? If so, any hints?
12:16 kaliya pal_bth: which errors are you getting?
12:16 Picachu joined #fuel
12:19 pal_bth It just say 'Error' look at these nodes (list of nodes). the log files on the nodes are not that clear...
12:19 kaliya how many Dell nodes are you trying to deploy?
12:22 pal_bth 3; 2 compute nodes, 1 controller. The "OS" (Ubuntu) installs, then when openstack starts, some minutes passes, then
12:22 pal_bth 'Error'..
12:28 evg pal_bth: is it the same on all your dell nodes?
12:29 kaliya pal_bth: can you find more detailed errors from /var/log/docker-logs/nailgun or /var/log/docker-logs/astute ?
12:29 pasquier-s__ joined #fuel
12:30 evg pal_bth: we've seen some problem ( a lot of) with dell servers, let me remember the models exaclty...
12:34 pal_bth Ok; I've also noticed that the Fuel version was quite old (3.2.1). Sadly, its the version that the XIFI project uses, so I guess I'll be alone on this journey .
12:40 evg pal_bth: There are a few people still using 3.2.1, you're not the only one
12:44 evg pal_bth: let's try to clear what's happening. Network problems? Missing drivers? You can see last logs from the errors nodes in fuel's pannel
12:46 pal_bth 1) Network validation, reports Ok. From /var/log/nailgun/api, (tail) I get  "Response code '409 Conflict' for POST /api/nodes/ from 10.20.0.14:46113"
12:49 pal_bth From the web; other_servers;(controller); agent log: "Could not get url from configuration file: No such file or directory - /etc/nailgun-agent/config.yaml, trying other ways.." This is listed as info...
12:50 mattymo that agent warning about config.yaml is ok. it always happens
12:50 mattymo the 409 conflict, however, is bad
12:50 pal_bth What does it indicate?
12:55 pal_bth I see a lot of the 409 conflicts, for at least two different IPs, and then each IP has a reasonable set of port numbers...
12:56 manashkin_ joined #fuel
13:09 e0ne joined #fuel
13:11 Longgeek joined #fuel
13:11 kaliya pal_bth: '409 Conflict' for POST /api/nodes/ from 10.20.0.14:46113' that's all? or there is more?
13:11 youellet_ joined #fuel
13:13 pal_bth There are quite many of those, when greping for Conflict, the only number showing up is 409..
13:16 kaliya pal_bth: are you trying to overwrite a previously existing environment, say by deleting and readding nodes?
13:18 pal_bth Well, I've deleted both environments and nodes... Usually I delete the entire environment when it failed...
13:18 pal_bth Sometimes, I've also overwritten the mbr on the nodes as to 'force' an install...
13:25 manashkin__ joined #fuel
13:25 kaliya pal_bth: I cannot find anything similar in our bugs or docs, could you please try to remove the nodes from the env, readd, and then rerun the verify network?
13:29 pal_bth kaliya: Sure, removing nodes.. Re-adding them, verifying network.
13:36 jobewan joined #fuel
13:46 Miroslav_ joined #fuel
13:50 manashkin__ pal_bth, Please check your configuration has no overlapping IP address ranges.
13:51 manashkin__ You may also generate diagnostic snapshot, upload it somewhere and share a link so we may look at your settings.
13:53 manashkin__ If your hardware has set manually programmed MAC addresses - please check these addresses are all different.
13:54 mattymo you can look for duplicate MACs in arp from master
13:55 jaypipes joined #fuel
14:00 eshumkher joined #fuel
14:03 pal_bth_ joined #fuel
14:04 pal_bth_ kaliya: completed, same result.
14:04 pal_bth_ manashkin
14:05 pal_bth_ manashkin: Here is the URL https://www.dropbox.com/s/trvxo9qtsus3uop/fuel-snapshot-2014-09-08_13-55-45.tgz?dl=0 64Mbytes..
14:05 pal_bth_ manashkin: have not messed with the MAC nrs. Should be as found on the NICs.
14:05 pal_bth_ mattymo: arp reports no duplicates..
14:29 mattgriffin joined #fuel
14:32 Miroslav_ joined #fuel
14:40 mpetason joined #fuel
14:43 Miroslav_ joined #fuel
14:43 vtzan joined #fuel
14:44 angdraug joined #fuel
14:44 [HeOS] joined #fuel
14:45 manashkin__ joined #fuel
15:22 taj joined #fuel
15:23 eshumkher joined #fuel
16:07 adanin joined #fuel
16:08 rmoe joined #fuel
16:13 taj joined #fuel
16:44 eshumkher joined #fuel
16:54 e0ne joined #fuel
16:55 Miroslav_ joined #fuel
17:05 dburmistrov joined #fuel
17:13 artem_panchenko left #fuel
17:17 xarses joined #fuel
17:18 eshumkher joined #fuel
17:22 Miroslav_ joined #fuel
17:33 kaliya_ joined #fuel
17:45 emagana joined #fuel
17:45 [HeOS] joined #fuel
17:45 angdraug joined #fuel
18:03 angdraug joined #fuel
18:23 xarses joined #fuel
18:31 angdraug joined #fuel
18:34 ianunruh I've been plauged by an issue with rsyslog for like 3 days now on my OpenStack deployment.. nova-api/glance-api will busy-spin trying to write to the rsyslog socket forever
18:35 ianunruh causing all my cores on the controller node to be pegged at 100%
18:36 ianunruh it happens randomly, but I can force it to happen when I do `service rsyslog restart`
18:36 ianunruh looks a fix will be in Fuel 5.1 .. any work around?
19:00 xarses ianunruh: correct, it should mostly only be caused by rsyslog reloading and sometimes rotating files
19:00 xarses the fix is to update python to the version including the fix
19:01 ianunruh update python? or python-eventlet?
19:01 xarses python
19:02 xarses alternatly, you could disable syslog
19:03 ianunruh in the nova/glance logging.conf?
19:03 xarses every service
19:03 xarses using python is at risk of the issue
19:03 xarses if it uses syslog logging
19:03 ianunruh I see
19:04 manashkin__ pal_bth_, Looks like known issue with Dell PERC controllers. Please ask here for workaround when you'll be back on this channel. In brief - you have to add "rootdelay=90" to the GRUB settings
19:16 emagana joined #fuel
19:22 emagana joined #fuel
19:34 ianunruh xarses: where should I upgrade python from?
19:37 ianunruh apt-get won't upgrade me past 2.7.3
19:48 eshumkher joined #fuel
19:51 emagana_ joined #fuel
20:05 thehybridtech joined #fuel
20:32 eshumkher joined #fuel
20:41 eshumkher joined #fuel
20:56 eshumkher joined #fuel
20:59 adanin joined #fuel
21:01 emagana joined #fuel
21:18 eshumkher joined #fuel
21:22 kat_pimenova joined #fuel
21:24 kupo24z joined #fuel
21:34 kupo24z xarses: Say you needed to deploy more than a /24 of servers in an environment, is there a way to assign an additional range to each network for deployments?
21:35 xarses kupo in a single cluster?
21:35 kupo24z single env, yes
21:35 xarses You would want https://blueprints.launchpad.net/fuel/+spec/multiple-cluster-networks
21:36 xarses or deploy the initial cluster with a larger network
21:36 kupo24z That allows say a /24 for each rack and all on the same env?
21:37 xarses it allows for any size for each network per group (which easily maps to racks)
21:38 kupo24z Neat
21:38 xarses there is a caveat with the controllers, at the moment, you need to deploy them in the same group
21:39 xarses or the vip won't be accessible when it moves
21:39 eshumkher joined #fuel
21:40 kupo24z So when this BP gets completed you will be able to assign nodes to groups and each group will have a set of networks?
21:40 xarses yes
21:40 kupo24z How will storage be done with that, distributed accross all groups or individual per group?
21:41 xarses however you assign your node-roles
21:41 xarses the only limitation is the controllers because of the HA VIP
21:41 kupo24z Interesting
21:42 kupo24z In the current version are you able to upgrade controllers by adding 3 and removing 3?
21:44 xarses for patching, its in place. For upgrades, AFAICT its only related to upgrading Fuel, Upgrades for OpenStack wont occur untill 6x
21:45 kupo24z Er sorry, i meant upgrading the physical hardware, same OS/Fuel versions
21:45 kupo24z eg, reaching the limits on outgoing/incoming traffic for the env and need more ports
21:45 xarses We are referring to that as patching
21:46 xarses erm
21:46 xarses oh
21:46 kupo24z I guess replacing the controllers with higher capacity hardware is what I would need to do
21:46 xarses you mean, you want to replace your controllers with newer hardware... I think you would deploy new nodes, and then remove the old ones in separate tasks
21:47 kupo24z Would it be better to do them in groups? Add 3 deploy task, then remove the old 3?
21:47 xarses That should be fine
21:48 xarses what version are you doing this on?
21:48 kupo24z 5.1/latest
21:48 xarses ok, ya that should work correctly
21:48 kupo24z we went with that since it has the reworked HA stuff afaik
21:50 eshumkher joined #fuel
21:53 kupo24z xarses: with that BP does it affect floating networks at all?
21:55 xarses no, in the bp we won't be able to support having the controllers on a separate group
21:57 kupo24z ah looks like the multiple floating is a part of it https://blueprints.launchpad.net/fuel/+spec/separate-public-floating
21:57 kupo24z im pretty sure that depends on the 6.0 neutron changes as well
21:58 eshumkher joined #fuel
21:59 emagana joined #fuel
22:02 kupo24z fyi https://bugs.launchpad.net/nova/+bug/1362129 was fixed for j3 and backport pending for current
22:04 eshumkher joined #fuel
22:16 xarses kupo, yea make sure to deploy your new nodes first
22:18 kupo24z re: controller upgrade?
22:23 emagana joined #fuel
22:26 eshumkher joined #fuel
22:30 emagana joined #fuel
22:32 xarses yes
22:39 adanin joined #fuel
22:43 eshumkher joined #fuel
23:02 eshumkher joined #fuel
23:02 emagana joined #fuel
23:09 emagana joined #fuel
23:58 mattgriffin joined #fuel

| Channels | #fuel index | Today | | Search | Google Search | Plain-Text | summary