Perl 6 - the future is here, just unevenly distributed

IRC log for #fuel, 2014-05-16

| Channels | #fuel index | Today | | Search | Google Search | Plain-Text | summary

All times shown according to UTC.

Time Nick Message
01:32 xarses joined #fuel
02:41 evgeniyl joined #fuel
03:47 Ch00k joined #fuel
06:17 Ch00k joined #fuel
06:30 al_ex joined #fuel
07:04 ivan-borisov joined #fuel
07:04 ivan-borisov Hello eveyone!
07:04 ivan-borisov Anyone can help me with bootstrap modification?
07:06 ivan-borisov I want to install Mellanox OFED into bootstrap image. Installer is a perl script, so I need perl in bootstrap and perl needs more dependencies. All these packages are impossible to manage without yum.
07:08 ivan-borisov And yum itself also need a lot of dependencies. How can I add yum to bootstrap or build another bootstrap image with yum builtin?
07:35 e0ne joined #fuel
08:40 ivan-borisov_ joined #fuel
08:46 alex_didenko ivan-borisov: in order to add some additional packages to bootstrap image you can try to do the following:
08:46 alex_didenko # run this:
08:46 alex_didenko git clone https://github.com/stackforge/fuel-main
08:46 alex_didenko cd fuel-main
08:46 alex_didenko vim bootstrap/module.mk
08:46 alex_didenko # modify BOOTSTRAP_RPMS variable and run:
08:46 alex_didenko make bootstrap
08:46 alex_didenko # after that ./build/bootstrap/initramfs.img would be your new bootstrap img
08:49 artem_panchenko joined #fuel
08:52 ivan-borisov_ alex_didenko, as I understand all packages listed in BOOTSTRAP_RPMS are being installed by yum, so it handles all dependencies?
08:52 alex_didenko yes
08:52 ivan-borisov_ alex_didenko: Great! Thank you.
08:54 alex_didenko yw :)
09:48 brain461 joined #fuel
10:29 xdeller joined #fuel
10:46 racingferret joined #fuel
11:31 evg ivan-borisov_: Ivan, are you slill here?
11:43 anotchenko joined #fuel
11:44 Teduardo joined #fuel
11:45 ivan-borisov_ evg, yes, I'm here.
11:53 Teduardo has 5 been released yet? i heard a rumor it was supposed to be out today =)
11:53 evg ivan-borisov_: reading your doc about eipoib, cannot get where is the difference beetwin eipoib and ipoib from user point of view
11:54 evg ivan-borisov_: in both case you get ethX devices?
11:57 ivan-borisov_ evg: No. In case you choose IPoIB you still use ibX devices, but you can use IP on top of infiniband. If you use eIPoIB you get ethX devices which acts exactly like real ethernet with one exception.
11:58 TVR_ MiroslavAnashkin you on?
11:58 ivan-borisov_ evg: On Mellanox ConnectX cards you can not get more than 128 VLANs.
11:58 Teduardo why not just use 40G or nX10g instead of infiniband
11:59 ivan-borisov_ evg: Besides that limitation, with eIPoIB you get fully functional ethernet devices.
12:00 Teduardo (i.e. just use ethernet if ethernet is what you want)
12:00 ivan-borisov_ evg: So, with IPoIB we get ibX L3 interfaces and with eIPoIB we get ethX L2 interfaces.
12:04 ivan-borisov_ Teduardo: That's silly, but it's state university! I have to work with what I got. And I've got 12 supermicro servers with ConnectX-2 VPI cards connected to Mellanox IS5031 Switch.
12:05 ivan-borisov_ Teduardo: ConnectX-2 cards can work in 10G ethernet mode, but switch is infiniband only.
12:05 evg ivan-borisov_: ok, i've got it. But why do you want to use puppet to configure it? Won't it be better to do all this during installation?
12:06 evg ivan-borisov_: you've got experience...
12:07 ivan-borisov_ evg: It certainly would be better, but I don't see how exactly I can do all needed configuration during installation process.
12:08 ivan-borisov_ evg: For successfull OS deployment with eIPoIB support I need to:
12:09 ivan-borisov_ evg: 1) Install ethtool  2) Get OFED installation files  3) Run OFED perl install script  4) edit one line in openibd config and restart this daemon.
12:10 ivan-borisov_ evg: That should be enough.
12:18 anotchenko joined #fuel
12:18 evg ivan-borisov_: so, at the end state you have to get new kernel modules, a changed config and additional .deb in your bootstrap/install-img.
12:19 evg ivan-borisov_: not a huge job seeing that you have already done.
12:20 evg ivan-borisov_: I just don't think using puppet is the right way...
12:22 ivan-borisov_ evg: Well, yes. All I've done before was just the wrong way :)  In the end I just need bootstrap with OFED installed and eIPoIB enabled and install-img with one additional .deb package  and OFED installed the same way as in bootstrap.
12:23 ivan-borisov_ evg: I think additional deb will not be a problem (I have just to edit repo indexes by hand and after that add ethtool package to preseed)
12:26 ivan-borisov_ evg: I don't sure when OFED installation should be done - I didn't look what exactly it does. But maybe it also can be done using preseed as well as config change after everything else is set up. Puppet was just my first thought.
12:32 evg ivan-borisov_: it was a worthy work.
12:34 ivan-borisov_ evg: Not sure if it was :) I still have to try to do it all and see if it will work.
12:35 evg ivan-borisov_: the best way is to make your devices up during bootstrap and os install
12:36 evg ivan-borisov_: not a deal changing your hw configuration during deployment
12:42 ivan-borisov_ evg: Yes, you are right. I need just to calm down and think of the best way to install all OFED components during OS install. As for bootstrap, for tests I'll just rebuild it with yum and then chroot into it's fs and do everything that needs to be done. But for real production use it's better to carefully install all components during bootstrap build process.
12:42 ivan-borisov_ evg: There's still much work to be done.
12:50 justif joined #fuel
12:52 ivan-borisov_ evg: Are you interested in my progress? Shall I report how the things goes?
12:57 evg ivan-borisov_: sure, Ivan. We're waiting news from you.
12:58 ivan-borisov_ evg: Good to know. :) I'll be back when I'll have some news.
13:00 evg ivan-borisov_: we'll wait you here and/or on zendesk.
13:46 jseutter joined #fuel
13:46 ogelbukh joined #fuel
13:54 anotchenko left #fuel
13:55 anotchenko joined #fuel
14:45 anotchenko joined #fuel
14:46 TVR_ MiroslavAnashkin you on?
15:02 mattymo|summit joined #fuel
15:07 odyssey4me joined #fuel
15:09 xarses joined #fuel
15:10 odyssey4me When's the Fuel 5.0 ISO being released? It's scheduled for release today according to launchpad.
15:13 saibarspeis joined #fuel
15:38 MiroslavAnashkin TVR_: yes, but mostly out of machine.
15:39 MiroslavAnashkin TVR_: Again fighting with old HP hardware...
15:45 MiroslavAnashkin odyssey4me: There are at least 2 critical issues remained in 5.0. 5.0 will not be released until we fix both.
15:45 MiroslavAnashkin So, no release today and even not on upcoming Monday.
15:49 mattymo|summit joined #fuel
15:52 odyssey4me MiroslavAnashkin - awesome, thanks.... which bugs are holding it up?
15:56 MiroslavAnashkin Cluster reassemble after controller failure and unstable OS provisioning. First one also exist in 4.1, and stakeholders ordered us to fix it by any means.
15:58 odyssey4me Is there a launchpad ticket for it?
15:59 odyssey4me (That sounds like a nasty bug, by the way)
16:00 MiroslavAnashkin https://bugs.launchpad.net/fuel/+bug/1318936 - first one
16:01 MiroslavAnashkin and https://bugs.launchpad.net/fuel/+bug/1319995
16:03 odyssey4me Thanks - is there a way to download a recent build ISO for testing purposes, or do we need to build the ISO ourselves?
16:04 odyssey4me The second issue looks like a test-specific situation. Running OSD's on Controller's would not be a production recommendation.
16:07 odyssey4me The first can survive a workaround, I would think. Not ideal, but it would give us the opportunity to get familiar with the updated platform.
16:07 MiroslavAnashkin I hope everyone still may build ISO. While it is getting harder and harder... Because of it, starting from yesterday we made our internal ISO builds available to everyone.
16:09 odyssey4me Is there a URL available for the ISO? We're wanting to test the deployment and figure out how to migrate from an existing deployment to a Fuel-based deployment.
16:09 e0ne joined #fuel
16:10 MiroslavAnashkin It is not documented so far, and even may not work :-)
16:11 bookwar odyssey4me: it is not yet really announced so wait a sec, i'll check if we are ready to provide the links
16:12 odyssey4me We're happy to help with improvements, code, etc... although we're a little new to Fuel itself.
16:12 odyssey4me bookwar - no problem, we're happy to wait until Monday or so
16:14 odyssey4me I'm just trying to get a sense of when we can expect something to help with our own plans.
16:14 TVR_ sorry.. was in a meeting...
16:17 TVR_ so MiroslavAnashkin, is there a good way to restart the network:router_gateway in neutron? Running fuel 4.1 and mine reads | status                | DOWN
16:23 MiroslavAnashkin TVR_: What router is down?
16:23 TVR_ network:router_gateway shows as down
16:24 TVR_ so here is the deal... ip for instances=10.4.200.0/24 so ip of 10.4.200.3
16:24 TVR_ tracepath 10.4.200.1 == good
16:24 TVR_ other side of neutron is 208.118.226.145
16:25 MiroslavAnashkin Hmm, probably kill it and Neutron or Pacemaker restart it.
16:25 TVR_ tracepath 208.118.226.145 is good
16:26 TVR_ actual GW for the 208.118.226.128/26 is 208.118.226.129
16:26 TVR_ tracepath 208.118.226.129 it goes to 10.4.200.1 and then I get to 208.118.226.129 but with a !H
16:31 bookwar odyssey4me: can't reach the guys responsible at the moment, but i'll post here as soon as i get the data. And there will be announce on a mailing list in a couple of days.
16:33 odyssey4me bookwar - alright, I'll be offline for the weekend, but appreciate the feedback... I'll keep an eye on the mailing list. Have a great weekend and good luck!
16:37 TVR_ and... should I be able to ping my own floating IP from the instance that holds it... yes?
16:40 MiroslavAnashkin TVR_: For last one - no. Or more exactly - only from external network or from the namespace which contains the appropriate router
16:41 TVR_ ok... so each controller has an 208.118.226 address... should they be able to ping the floating IP I assigned to an instance?
16:42 TVR_ so, controller 1 has 208.118.226.131 ....should it be able to ping 208.118.226.150 the IP I asigned as a floater?
16:43 TVR_ they are able to hit the network:router_gateway address of 208.118.226.145 of the Neutron router
16:44 MiroslavAnashkin TVR_: Only from node where L3 agent is currently running you may ping this IP within the proper namespace.
16:45 TVR_ ok.. let me see where that is running..
16:48 TVR_ | 3b968cd0-eb38-4f49-995d-a268aefca6dd | L3 agent           | node-40.wakefield.yottaa.com | :-)   | True           |
16:49 TVR_ [root@node-40 ~]# ping 208.118.226.150 PING 208.118.226.150 (208.118.226.150) 56(84) bytes of data. From 208.118.226.134 icmp_seq=2 Destination Host Unreachable From 208.118.226.134 icmp_seq=3 Destination Host Unreachable
16:49 TVR_ so it looks like even within the same namespace, the IP is not reachable
16:52 MiroslavAnashkin ssh to the machine where the L3 agent is currently running
16:52 MiroslavAnashkin run `source openrc`
16:52 MiroslavAnashkin Run `ip netns list`
16:52 MiroslavAnashkin neutron router list`
16:52 MiroslavAnashkin Find namespace, where qrouter-* is running
16:52 MiroslavAnashkin Run `ip netns exec qrouter-* ping <internal IP of the instance>`
16:52 MiroslavAnashkin You may also run `ip netns exec qrouter-* ip a` to see the list of available IP
16:52 MiroslavAnashkin s/internal/external/
16:52 TVR_ one sec..
16:56 TVR_ L3 agent           | node-40 [root@node-40 ~]#  ip netns list [root@node-40 ~]#
16:56 TVR_ sorry.. truncated..
16:56 TVR_ L3 agent           | node-40.wakefield.yottaa.com | :-)   | True
16:56 TVR_ [root@node-40 ~]#  ip netns list [root@node-40 ~]#
16:56 TVR_ so nothing
16:56 TVR_ let me find where it thinks it is
16:57 e0ne joined #fuel
16:57 MiroslavAnashkin Does `crm status` report the l3 agent is running on node-40?
17:00 e0ne joined #fuel
17:03 TVR_ http://pastebin.com/CHHFuuva
17:05 TVR_ so... does this look like the L3 agent is running on the wrong box?
17:10 TVR_ here is some other info... might be relevant ...   http://pastebin.com/jRYb2e1m
17:11 TVR_ all the IP's from 130 on are on an HP switch with link agragates to a Juniper router, which holds .129
17:13 TVR_ 129 pings fine, but the !H makes me wonder..... but I can ping 208.118.226.145 from the real world, so routing and networking works.
17:19 MiroslavAnashkin Is node-37 offline or online?
17:21 crshman joined #fuel
17:24 mattymo|summit joined #fuel
17:27 xarses joined #fuel
17:29 TVR_ all nodes are up... and look healthy
17:29 TVR_ FYI... this is a fresh install... so I can do whatever AI want to it
17:30 MiroslavAnashkin crm claims openVswitch agent is down on node-37
17:30 MiroslavAnashkin and HAProxy
17:35 TVR_ so.. looking at crm status... looks like I need to reboot or restart all sorts of services on node-37
17:42 TVR_ is there a command line way to 'reboot' the router?
17:45 TVR_ rebooting node-37 fixed it
17:46 TVR_ so.. I will leave you alone after one question... what order would I reboot services in, or do I simply do a reboot of a box when it is in "that" state?
17:47 TVR_ I can get to the instance remotely now... as well
17:47 TVR_ tracepath gave me bogus results
17:53 MiroslavAnashkin Hmm. Haproxy, then RabbitMQ, then MySQL, then neutron-service, then neutron services managed by crm, then remained openstack services
18:02 TVR_ OK.. cool... and thank you....
18:18 jobewan joined #fuel
18:25 xarses joined #fuel
18:56 xarses joined #fuel
19:12 tatyana joined #fuel
19:13 e0ne joined #fuel
19:18 mattymo|summit joined #fuel
19:40 derrickb joined #fuel
19:44 derrickb Hi All.. have a quick question.. Added a couple nodes, and now my "progress" is stuck at 100% and everything (tests, configs, resets) are locked.. is there a way to force a completion of a task?
19:45 Kupo24z derrickb: check server/nodes console?
19:46 Kupo24z nodes will fail after a timeout has been reached, ive only seen that take place when it cant get a package or something and it sits there
19:46 derrickb they all show up running:
19:46 derrickb [root@fuel ~]# fuel node
19:46 derrickb id | status | name                 | cluster | mac               | roles           | pending_roles | online
19:46 derrickb ---|--------|----------------------|---------|-------------------|-----------------|---------------|-------
19:46 derrickb 8  | ready  | Untitled (F5:D8)     | 2       | 7e:23:1a:b8:00:47 | [u'compute']    | []            | True
19:46 derrickb 2  | ready  | Node01 (60:a4)       | 2       | 52:ba:c5:d9:ae:4f | [u'compute']    | []            | True
19:46 derrickb 3  | ready  | Node02 (71:D1)       | 2       | ce:a2:14:ea:d8:4f | [u'compute']    | []            | True
19:46 derrickb 4  | ready  | Node03 (76:24)       | 2       | a2:ff:6d:d1:52:4d | [u'compute']    | []            | True
19:46 derrickb 7  | ready  | Untitled (9C:0A)     | 2       | 26:f4:7c:20:f6:44 | [u'compute']    | []            | True
19:46 derrickb 1  | ready  | Controller01 (da:a6) | 2       | 56:e8:0a:74:6c:48 | [u'controller'] | []            | True
19:46 derrickb (they are the "untitled" nodes that seem to be stuck)
19:46 derrickb [root@fuel ~]# fuel task
19:46 derrickb id | status  | name         | cluster | progress | uuid
19:46 derrickb ---|---------|--------------|---------|----------|-------------------------------------
19:46 derrickb 36 | ready   | capacity_log | None    | 100      | 857521f7-739b-48f0-b668-9c0521aab1f8
19:46 derrickb 38 | ready   | dump         | None    | 100      | 0053dde0-6e44-4299-bda8-4e2f93efc774
19:46 derrickb 31 | running | deploy       | 2       | 100      | fd8443c9-d8a6-4bc9-a81a-c00f8b735dee
19:46 derrickb 35 | ready   | deployment   | 2       | 100      | 680bc299-85ac-451a-ac60-00fee0546194
19:46 derrickb 34 | running | provision    | 2       | 100      | 5ef39695-f66f-4152-8c42-93d5b52e55b5
19:47 derrickb I've rebooted the nodes, fuel server, everything other than completely resetting my environment....
19:49 e0ne joined #fuel
19:50 derrickb looking in the logs, it looks like the node may think it's still provisioning...
19:51 aleksandr_null joined #fuel
20:00 xarses joined #fuel
20:01 derrickb Going to start fresh.. wiped environment,
20:36 zinovik joined #fuel
21:23 e0ne joined #fuel
21:25 e0ne joined #fuel
21:51 e0ne joined #fuel
21:53 e0ne_ joined #fuel
22:06 e0ne joined #fuel
22:23 e0ne joined #fuel
22:35 jkirnosova joined #fuel
22:35 holser joined #fuel
22:35 MorAle_ joined #fuel
22:35 teran[p] joined #fuel
22:35 nurla joined #fuel
22:35 mrasskazov joined #fuel
22:35 monester joined #fuel
22:35 mihgen joined #fuel
22:35 xenolog joined #fuel
22:35 MiroslavAnashkin joined #fuel
22:35 vkramskikh joined #fuel
22:35 book` joined #fuel
22:35 dpyzhov joined #fuel
22:35 dburmistrov joined #fuel
22:35 aglarendil joined #fuel
22:35 evg joined #fuel
22:35 apalkina joined #fuel
22:35 meow-nofer joined #fuel
22:35 akislitsky joined #fuel
22:36 sanek joined #fuel
22:36 rsFF joined #fuel
22:36 Arminder joined #fuel
22:36 gleam joined #fuel

| Channels | #fuel index | Today | | Search | Google Search | Plain-Text | summary