Category: Openstack Cloud

Generally this issue is caused by the Qppid or rabbitmq not synchronizing messages across the cluster , it can be debugged by looking into the Qppid messages stack , also you may try the simple fix below .

Make sure all compute services are up and running

Check the compute services are running on horizon dashboard

or you may execute the following command on the controller node

nova-manager service list

if all the compute services are up and running try restarting the Qppid service on the controller node , keep in mind that restarting Qppid would only reset the service and not flush the Qppid stack .

 

Information you should know about this article

Openstack Version : Havana

Operating System : Centos 6.5

 

This issue is mainly caused by conductor service returning 0 ,

[Solution]
-Restart Conductor on controller
-Restart Each Compute Node Nova Service

 

Information you should know about this article

Openstack Version : Havana

Operating System : Centos 6.5

To Rebuild Router Information follow the steps below :

• Restart the openvswitch service on the controller node
• Restart the openvswitch service and the openvswitch agent on the network node

This will cause the router configuration to rebuild and the router should work without any issue.

In case of L3 agents being down on the dashboard , you can update the agent state by applying the solution suggested below.

 

 

ISSUE  : Single L3 Agents has the state down on the horizon dashboard

SOLUTION : Restart the neutron server service on the controller node then restart openvswitch and openvswitch agent on the hypervisor of the affected node

ISSUE  : All L3 Agents Are Down on the horizon dashboard

SOLUTION : Restart openstack-nova-network on the controller node and on the affected machine

 

Information you should know about this article

Openstack Version : Havana

Operating System : Centos 6.5

This issue happens when too many connections are being traced by the firewall to check the error do a simple “dmesg” and you should be able to find the following:

 

nf_conntrack: table full, dropping packet.

To get the current connection tracking number use the following commands

 /sbin/sysctl -a|grep -i nf_conntrack_max

To Count the current connection tracking use the following command

 cat /proc/net/nf_conntrack | wc -l

Note this wont give you the actual result when applied to the network node itself because every router is self contained you need to execute this command inside exec command see the example below

ip net exec qrouter-764f663e-db21-4ddb-8fbe-044826f6267f cat /proc/net/nf_conntrack | wc -l

To increase the connection tracking use the command below

echo 1656360 > /proc/sys/net/nf_conntrack_max

All commands above can be executed inside any openstack router

 

Information you should know about this article

Openstack Version : Havana

Operating System : Centos 6.5