Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fr: support setting kubelet --node-ip using workers' primary NIC #442

Open
andrewbonney opened this issue Oct 18, 2024 · 1 comment
Open

Comments

@andrewbonney
Copy link
Contributor

We are using secondary networking in some Kubernetes clusters via Multus. Unfortunately, when we attach additional Neutron ports to k8s worker VMs (or if bare metal nodes have additional NICs), the IP addresses for these are automatically added to the node's list of InternalIPs. As the secondary network is not universally available (for example it's not used by controller nodes), attaching these interfaces can break connectivity to pods' log output and the ability to run kubectl exec.

It would be helpful if --node-ip could be set for the kubelet at deploy time based on the IP it is allocated. I can't immediately think of a reason this would need to be restricted to this use case, so it may be possible to do so universally.

@jrosser
Copy link
Contributor

jrosser commented Oct 18, 2024

@mnaser we discussed briefly on irc about adding something here

But we are not sure how to identify the correct interface, because we see this in the openstackmachine status

kubectl -n magnum-system describe machine/kube-yxpub-default-worker-j8lnw-6fwzm-cgm4

<snip>
Status:
  Addresses:
    Address:        172.16.129.102
    Type:           InternalIP
    Address:        10.0.0.44
    Type:           InternalIP
    Address:        kube-yxpub-default-worker-2s4lc-s96zc
    Type:           InternalDNS

We need to either know up front what the node IP is, or have a way of distinguising the primary interface from any others which are present.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants