Nodes are not ready

[haseebshaikh48]

I've been following this tutorial and till bootstrapping the worker nodes but seems they are not coming up.
I'm able to view those nodes from my master node but they arn't in ready state when i checked my kubelet logs on node-0
i'm seeing this error -

root@node-0:~# journalctl -u kubelet -f
Dec 02 14:22:52 node-0 kubelet[42965]: W1202 14:22:52.923538 42965 transport.go:356] Unable to cancel request for *otelhttp.Transport
Dec 02 14:22:52 node-0 kubelet[42965]: E1202 14:22:52.923640 42965 controller.go:145] "Failed to ensure lease exists, will retry" err="Get "https://server.kubernetes.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/node-0?timeout=10s\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" interval="7s"
Dec 02 14:22:55 node-0 kubelet[42965]: E1202 14:22:55.038219 42965 kubelet_node_status.go:95] "Unable to register node with API server" err="Post "https://server.kubernetes.local:6443/api/v1/nodes\": dial tcp 172.30.1.4:6443: i/o timeout" node="node-0"
Dec 02 14:22:58 node-0 kubelet[42965]: E1202 14:22:58.325829 42965 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node "node-0" not found"
Dec 02 14:22:58 node-0 kubelet[42965]: E1202 14:22:58.554919 42965 event.go:368] "Unable to write event (may retry after sleeping)" err="Post "https://server.kubernetes.local:6443/api/v1/namespaces/default/events\": dial tcp 172.30.1.4:6443: i/o timeout" event="&Event{ObjectMeta:{node-0.180d613b24799619 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:node-0,UID:node-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node node-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:node-0,},FirstTimestamp:2024-12-02 14:05:38.250421785 +0000 UTC m=+0.111070730,LastTimestamp:2024-12-02 14:05:38.250421785 +0000 UTC m=+0.111070730,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:node-0,}"
Dec 02 14:23:02 node-0 kubelet[42965]: I1202 14:23:02.038956 42965 kubelet_node_status.go:355] "Setting node annotation to enable volume controller attach/detach"
Dec 02 14:23:02 node-0 kubelet[42965]: I1202 14:23:02.039708 42965 kubelet_node_status.go:674] "Recording event message for node" node="node-0" event="NodeHasSufficientMemory"
Dec 02 14:23:02 node-0 kubelet[42965]: I1202 14:23:02.039743 42965 kubelet_node_status.go:674] "Recording event message for node" node="node-0" event="NodeHasNoDiskPressure"
Dec 02 14:23:02 node-0 kubelet[42965]: I1202 14:23:02.039754 42965 kubelet_node_status.go:674] "Recording event message for node" node="node-0" event="NodeHasSufficientPID"
Dec 02 14:23:02 node-0 kubelet[42965]: I1202 14:23:02.039778 42965 kubelet_node_status.go:72] "Attempting to register node" node="node-0"
Dec 02 14:23:08 node-0 kubelet[42965]: E1202 14:23:08.326467 42965 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node "node-0" not found"
Dec 02 14:23:09 node-0 kubelet[42965]: W1202 14:23:09.924316 42965 transport.go:356] Unable to cancel request for *otelhttp.Transport
Dec 02 14:23:09 node-0 kubelet[42965]: E1202 14:23:09.924460 42965 controller.go:145] "Failed to ensure lease exists, will retry" err="Get "https://server.kubernetes.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/node-0?timeout=10s\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" interval="7s"
Dec 02 14:23:11 node-0 kubelet[42965]: I1202 14:23:11.214341 42965 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://server.kubernetes.local:6443/apis/storage.k8s.io/v1/csinodes/node-0?resourceVersion=0": dial tcp 172.30.1.4:6443: i/o timeout
Dec 02 14:23:14 node-0 kubelet[42965]: W1202 14:23:14.338647 42965 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://server.kubernetes.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.30.1.4:6443: i/o timeout
Dec 02 14:23:14 node-0 kubelet[42965]: I1202 14:23:14.338719 42965 trace.go:236] Trace[1130032662]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (02-Dec-2024 14:22:44.337) (total time: 30000ms):
Dec 02 14:23:14 node-0 kubelet[42965]: Trace[1130032662]: ---"Objects listed" error:Get "https://server.kubernetes.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.30.1.4:6443: i/o timeout 30000ms (14:23:14.338)
Dec 02 14:23:14 node-0 kubelet[42965]: Trace[1130032662]: [30.000701063s] [30.000701063s] END
Dec 02 14:23:14 node-0 kubelet[42965]: E1202 14:23:14.338739 42965 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://server.kubernetes.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.30.1.4:6443: i/o timeout" logger="UnhandledError"
Dec 02 14:23:18 node-0 kubelet[42965]: E1202 14:23:18.327453 42965 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node "node-0" not found"
Dec 02 14:23:26 node-0 kubelet[42965]: W1202 14:23:26.925108 42965 transport.go:356] Unable to cancel request for *otelhttp.Transport
Dec 02 14:23:26 node-0 kubelet[42965]: E1202 14:23:26.925213 42965 controller.go:145] "Failed to ensure lease exists, will retry" err="Get "https://server.kubernetes.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/node-0?timeout=10s\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" interval="7s"
Dec 02 14:23:28 node-0 kubelet[42965]: E1202 14:23:28.328208 42965 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node "node-0" not found"
Dec 02 14:23:32 node-0 kubelet[42965]: E1202 14:23:32.040893 42965 kubelet_node_status.go:95] "Unable to register node with API server" err="Post "https://server.kubernetes.local:6443/api/v1/nodes\": dial tcp 172.30.1.4:6443: i/o timeout" node="node-0"
Dec 02 14:23:33 node-0 kubelet[42965]: W1202 14:23:33.633143 42965 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://server.kubernetes.local:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 172.30.1.4:6443: i/o timeout
Dec 02 14:23:33 node-0 kubelet[42965]: I1202 14:23:33.633231 42965 trace.go:236] Trace[488492132]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (02-Dec-2024 14:23:03.632) (total time: 30000ms):
Dec 02 14:23:33 node-0 kubelet[42965]: Trace[488492132]: ---"Objects listed" error:Get "https://server.kubernetes.local:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 172.30.1.4:6443: i/o timeout 30000ms (14:23:33.633)
Dec 02 14:23:33 node-0 kubelet[42965]: Trace[488492132]: [30.000471906s] [30.000471906s] END
Dec 02 14:23:33 node-0 kubelet[42965]: E1202 14:23:33.633258 42965 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://server.kubernetes.local:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.30.1.4:6443: i/o timeout" logger="UnhandledError"

[vladsf]

same here

[vladsf]

Add server.kubernetes.local and node01, node-1 to /etc/hosts evreywhere

[haseebshaikh48]

Ok i'll try. Did this work for you ?