Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The pod state using subnet is in ContainerCreating for a long time. #4376

Open
bingerambo opened this issue Dec 10, 2024 · 5 comments
Open
Assignees
Labels

Comments

@bingerambo
Copy link

bingerambo commented Dec 10, 2024

Spiderpool Version

0.9.7

Main CNI

calico

bug description

First, subnet is created, and then deployment load is created with subnet annotation. The pod startup process waits for ContainerCreating to last for 60s.

What did you expect to happen?

Expect pod to run immediately.

How to reproduce it (as minimally and precisely as possible)

  1. create subnet
apiVersion: spiderpool.spidernet.io/v2beta1
kind: SpiderSubnet
metadata:
  name: default-subnet-ipv4
spec:
  subnet: 10.233.68.0/24
  ips:
    - 10.233.68.1-10.233.68.254
  1. create deployment
apiVersion: apps/v1
kind: Deployment
metadata:
  name: default-subnet-deploy
spec:
  replicas: 3
  selector:
    matchLabels:
      app: custom-ippool-deploy
  template:
    metadata:
      annotations:
        ipam.spidernet.io/subnet: '{"ipv4": ["default-subnet-ipv4"]}'
      labels:
        app: custom-ippool-deploy
    spec:
      containers:
        - name: custom-ippool-deploy
          image: busybox
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh", "-c", "trap : TERM INT; sleep infinity & wait"]
  1. get pod status
NAMESPACE     NAME                                           READY   STATUS              RESTARTS       AGE     IP               NODE       NOMINATED NODE   READINESS GATES
default       default-subnet-deploy-7cbb487685-j7rkw         0/1     ContainerCreating   0              14s     <none>           ksdragon   <none>           <none>
default       default-subnet-deploy-7cbb487685-phsz9         0/1     ContainerCreating   0              14s     <none>           ksdragon   <none>           <none>
default       default-subnet-deploy-7cbb487685-ss876         0/1     ContainerCreating   0              14s     <none>           ksdragon   <none>           <none>
kube-system   calico-kube-controllers-75c587cc8d-xmskg       1/1     Running             36 (32m ago)   53d     10.233.64.2      ksdragon   <none>           <none>
kube-system   calico-node-nspjq                              1/1     Running             1 (32m ago)    18h     192.168.85.128   ksdragon   <none>           <none>
kube-system   coredns-d64b87bb8-6m5qc                        1/1     Running             1 (32m ago)    18h     10.233.64.4      ksdragon   <none>           <none>
kube-system   coredns-d64b87bb8-dkwz4                        1/1     Running             36 (32m ago)   53d     10.233.64.3      ksdragon   <none>           <none>
kube-system   kube-apiserver-ksdragon                        1/1     Running             64 (32m ago)   53d     192.168.85.128   ksdragon   <none>           <none>
kube-system   kube-controller-manager-ksdragon               1/1     Running             43 (32m ago)   53d     192.168.85.128   ksdragon   <none>           <none>
kube-system   kube-proxy-48rpr                               1/1     Running             38 (32m ago)   53d     192.168.85.128   ksdragon   <none>           <none>
kube-system   kube-scheduler-ksdragon                        1/1     Running             42 (32m ago)   53d     192.168.85.128   ksdragon   <none>           <none>
kube-system   nodelocaldns-g9k2z                             1/1     Running             39 (32m ago)   53d     192.168.85.128   ksdragon   <none>           <none>
kube-system   openebs-localpv-provisioner-69b4dfd865-gr8m4   1/1     Running             37 (32m ago)   53d     10.233.64.1      ksdragon   <none>           <none>
kube-system   spiderpool-agent-hb2ql                         2/2     Running             18 (32m ago)   6d22h   192.168.85.128   ksdragon   <none>           <none>
kube-system   spiderpool-controller-7b98dd8d49-59gtw         1/1     Running             10 (32m ago)   6d22h   192.168.85.128   ksdragon   <none>           <none>
kube-system   spiderpool-init-5c6wj                          0/1     Completed           0              6d22h   192.168.85.128   ksdragon   <none>           <none>
  1. pod describe info
[root@ksdragon ~]# kd po default-subnet-deploy-7cbb487685-j7rkw
Name:             default-subnet-deploy-7cbb487685-j7rkw
Namespace:        default
Priority:         0
Service Account:  default
Node:             ksdragon/192.168.85.128
Start Time:       Tue, 10 Dec 2024 09:25:43 +0800
Labels:           app=custom-ippool-deploy
                  pod-template-hash=7cbb487685
Annotations:      ipam.spidernet.io/subnet: {"ipv4": ["default-subnet-ipv4"]}
Status:           Pending
IP:
IPs:              <none>
Controlled By:    ReplicaSet/default-subnet-deploy-7cbb487685
Containers:
  custom-ippool-deploy:
    Container ID:
    Image:         busybox
    Image ID:
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/sh
      -c
      trap : TERM INT; sleep infinity & wait
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4b4t2 (ro)
Conditions:
  Type                        Status
  PodReadyToStartContainers   False
  Initialized                 True
  Ready                       False
  ContainersReady             False
  PodScheduled                True
Volumes:
  kube-api-access-4b4t2:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age   From               Message
  ----    ------     ----  ----               -------
  Normal  Scheduled  22s   default-scheduler  Successfully assigned default/default-subnet-deploy-7cbb487685-j7rkw to ksdragon
[root@ksdragon ~]#

Additional Context

  1. calico config, ipam use spiderpool
{
  "name": "k8s-pod-network",
  "cniVersion": "0.3.1",
  "plugins": [
    {
      "type": "calico",
      "log_level": "info",
      "log_file_path": "/var/log/calico/cni/cni.log",
      "datastore_type": "kubernetes",
      "nodename": "ksdragon",
      "mtu": 0,
      "ipam": {
          "type": "spiderpool"
      },
      "policy": {
          "type": "k8s"
      },
      "kubernetes": {
          "kubeconfig": "/etc/cni/net.d/calico-kubeconfig"
      }
    },
    {
      "type": "portmap",
      "snat": true,
      "capabilities": {"portMappings": true}
    },
    {
      "type": "bandwidth",
      "capabilities": {"bandwidth": true}
    }
  ]
}
  1. spiderpool-agent log info
{"level":"INFO","ts":"2024-12-10T01:25:44.416Z","logger":"IPAM","caller":"ipam/allocate.go:40","msg":"Start to allocate","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:25:44.416Z","logger":"IPAM","caller":"ipam/allocate.go:107","msg":"Allocate IP addresses in standard mode","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:44.416Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 1 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:25:44.436Z","logger":"IPAM","caller":"ipam/allocate.go:40","msg":"Start to allocate","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:25:44.436Z","logger":"IPAM","caller":"ipam/allocate.go:107","msg":"Allocate IP addresses in standard mode","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:44.436Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 1 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:25:44.451Z","logger":"IPAM","caller":"ipam/allocate.go:40","msg":"Start to allocate","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:25:44.452Z","logger":"IPAM","caller":"ipam/allocate.go:107","msg":"Allocate IP addresses in standard mode","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:44.452Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 1 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:46.417Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 2 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:46.437Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 2 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:46.452Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 2 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:48.417Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 3 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:48.438Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 3 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:48.453Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 3 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:50.418Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 4 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:50.439Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 4 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:50.454Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 4 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:52.420Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 5 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:52.440Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 5 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:52.454Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 5 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:54.421Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 6 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:54.442Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 6 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:54.455Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 6 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:56.421Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 7 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:56.443Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 7 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:56.456Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 7 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:58.423Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 8 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:58.444Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 8 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:25:58.457Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 8 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:00.423Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 9 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:00.445Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 9 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:00.457Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 9 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:02.424Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 10 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:02.446Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 10 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:02.458Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 10 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:04.425Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 11 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:04.448Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 11 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:04.459Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 11 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:06.427Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 12 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:06.448Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 12 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:06.459Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 12 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:08.427Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 13 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:08.449Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 13 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:08.461Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 13 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:10.429Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 14 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:10.450Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 14 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:10.461Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 14 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:12.429Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 15 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:12.451Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 15 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:12.462Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 15 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:14.430Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 16 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:14.452Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 16 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:14.463Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 16 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:16.431Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 17 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:16.453Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 17 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:16.463Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 17 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:18.432Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 18 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:18.455Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 18 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:18.464Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 18 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:20.433Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 19 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:20.456Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 19 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:20.464Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 19 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:22.435Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 20 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:22.457Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 20 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:22.465Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 20 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:24.436Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 21 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:24.458Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 21 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:24.467Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 21 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:26.436Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 22 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:26.460Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 22 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:26.467Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 22 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:28.437Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 23 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:28.461Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 23 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:28.467Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 23 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:30.439Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 24 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:30.462Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 24 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:30.468Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 24 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:32.439Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 25 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:32.463Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 25 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"WARN","ts":"2024-12-10T01:26:32.469Z","logger":"IPAM","caller":"ipam/pool_selections.go:233","msg":"fetch SubnetIPPool 25 times: retrieved IPPool 'auto4-default-subnet-deploy-eth0-bc4b5' but doesn't have the desiredIPNumber IPs, wait for a second and get a retry","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.440Z","logger":"IPAM","caller":"ipam/allocate.go:390","msg":"Preliminary IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.440Z","logger":"IPAM","caller":"ipam/config.go:47","msg":"Dual stack network","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.440Z","logger":"IPAM","caller":"ipam/allocate.go:401","msg":"Prechecked IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.440Z","logger":"IPAM","caller":"ipam/allocate.go:409","msg":"Filtered IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.440Z","logger":"IPAM","caller":"ipam/allocate.go:415","msg":"All IPPool candidates are valid","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.449Z","logger":"IPAM","caller":"ipam/allocate.go:508","msg":"Allocate IPv4 IP 10.233.68.1/24 to NIC eth0 from IPPool auto4-default-subnet-deploy-eth0-bc4b5","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":"","AllocateHash":"eth0-4-[auto4-default-subnet-deploy-eth0-bc4b5]"}
{"level":"INFO","ts":"2024-12-10T01:26:34.449Z","logger":"IPAM","caller":"workloadendpointmanager/workloadendpoint_manager.go:159","msg":"try to create SpiderEndpoint &SpiderEndpoint{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [{v1 Pod default-subnet-deploy-7cbb487685-j7rkw c94dd65f-e6f2-43a3-a55a-ec216530a3fd <nil> <nil>}] [spiderpool.spidernet.io] []},Status:&WorkloadEndpointStatus{Current:&PodIPAllocation{UID:c94dd65f-e6f2-43a3-a55a-ec216530a3fd,Node:ksdragon,IPs:[]IPs{IPAllocationDetail{NIC:eth0,IPv4:*10.233.68.1/24,IPv6:nil,IPv4Pool:*auto4-default-subnet-deploy-eth0-bc4b5,IPv6Pool:nil,Vlan:*0,IPv4Gateway:nil,IPv6Gateway:nil,CleanGateway:nil,Routes:[],},},},OwnerControllerType:Deployment,OwnerControllerName:default-subnet-deploy,},}","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.457Z","logger":"IPAM","caller":"ipam/allocate.go:376","msg":"Succeed to allocate: {\"ips\":[{\"address\":\"10.233.68.1/24\",\"ipPool\":\"auto4-default-subnet-deploy-eth0-bc4b5\",\"nic\":\"eth0\",\"version\":4}],\"routes\":null}","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.457Z","logger":"IPAM","caller":"cmd/ipam.go:56","msg":"IPAM allocation duration: 50.040498778","CNICommand":"ADD","ContainerID":"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa","IfName":"eth0","NetNamespace":"/proc/35152/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-j7rkw","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.463Z","logger":"IPAM","caller":"ipam/allocate.go:390","msg":"Preliminary IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.463Z","logger":"IPAM","caller":"ipam/config.go:47","msg":"Dual stack network","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.463Z","logger":"IPAM","caller":"ipam/allocate.go:401","msg":"Prechecked IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.463Z","logger":"IPAM","caller":"ipam/allocate.go:409","msg":"Filtered IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.463Z","logger":"IPAM","caller":"ipam/allocate.go:415","msg":"All IPPool candidates are valid","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.470Z","logger":"IPAM","caller":"ipam/allocate.go:390","msg":"Preliminary IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.470Z","logger":"IPAM","caller":"ipam/config.go:47","msg":"Dual stack network","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.470Z","logger":"IPAM","caller":"ipam/allocate.go:401","msg":"Prechecked IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.470Z","logger":"IPAM","caller":"ipam/allocate.go:409","msg":"Filtered IPPool candidates: [{NIC:eth0 CleanGateway:false PoolCandidates:[{IPVersion:4 Pools:[auto4-default-subnet-deploy-eth0-bc4b5] PToIPPool:*}]}]","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.470Z","logger":"IPAM","caller":"ipam/allocate.go:415","msg":"All IPPool candidates are valid","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.489Z","logger":"IPAM","caller":"ipam/allocate.go:508","msg":"Allocate IPv4 IP 10.233.68.2/24 to NIC eth0 from IPPool auto4-default-subnet-deploy-eth0-bc4b5","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":"","AllocateHash":"eth0-4-[auto4-default-subnet-deploy-eth0-bc4b5]"}
{"level":"INFO","ts":"2024-12-10T01:26:34.489Z","logger":"IPAM","caller":"workloadendpointmanager/workloadendpoint_manager.go:159","msg":"try to create SpiderEndpoint &SpiderEndpoint{ObjectMeta:{default-subnet-deploy-7cbb487685-phsz9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [{v1 Pod default-subnet-deploy-7cbb487685-phsz9 c1d97530-75c6-428c-8d54-18ce961aee56 <nil> <nil>}] [spiderpool.spidernet.io] []},Status:&WorkloadEndpointStatus{Current:&PodIPAllocation{UID:c1d97530-75c6-428c-8d54-18ce961aee56,Node:ksdragon,IPs:[]IPs{IPAllocationDetail{NIC:eth0,IPv4:*10.233.68.2/24,IPv6:nil,IPv4Pool:*auto4-default-subnet-deploy-eth0-bc4b5,IPv6Pool:nil,Vlan:*0,IPv4Gateway:nil,IPv6Gateway:nil,CleanGateway:nil,Routes:[],},},},OwnerControllerType:Deployment,OwnerControllerName:default-subnet-deploy,},}","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.497Z","logger":"IPAM","caller":"ipam/allocate.go:376","msg":"Succeed to allocate: {\"ips\":[{\"address\":\"10.233.68.2/24\",\"ipPool\":\"auto4-default-subnet-deploy-eth0-bc4b5\",\"nic\":\"eth0\",\"version\":4}],\"routes\":null}","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.497Z","logger":"IPAM","caller":"cmd/ipam.go:56","msg":"IPAM allocation duration: 50.060345749","CNICommand":"ADD","ContainerID":"a50bc6efb7e874438b16c3b86105962c104409ef8b95f382af8bd80cdcebf38d","IfName":"eth0","NetNamespace":"/proc/35135/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-phsz9","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.505Z","logger":"IPAM","caller":"ipam/allocate.go:508","msg":"Allocate IPv4 IP 10.233.68.3/24 to NIC eth0 from IPPool auto4-default-subnet-deploy-eth0-bc4b5","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":"","AllocateHash":"eth0-4-[auto4-default-subnet-deploy-eth0-bc4b5]"}
{"level":"INFO","ts":"2024-12-10T01:26:34.505Z","logger":"IPAM","caller":"workloadendpointmanager/workloadendpoint_manager.go:159","msg":"try to create SpiderEndpoint &SpiderEndpoint{ObjectMeta:{default-subnet-deploy-7cbb487685-ss876  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [{v1 Pod default-subnet-deploy-7cbb487685-ss876 f9e6221e-edb4-4ae8-ae36-280d2aa33363 <nil> <nil>}] [spiderpool.spidernet.io] []},Status:&WorkloadEndpointStatus{Current:&PodIPAllocation{UID:f9e6221e-edb4-4ae8-ae36-280d2aa33363,Node:ksdragon,IPs:[]IPs{IPAllocationDetail{NIC:eth0,IPv4:*10.233.68.3/24,IPv6:nil,IPv4Pool:*auto4-default-subnet-deploy-eth0-bc4b5,IPv6Pool:nil,Vlan:*0,IPv4Gateway:nil,IPv6Gateway:nil,CleanGateway:nil,Routes:[],},},},OwnerControllerType:Deployment,OwnerControllerName:default-subnet-deploy,},}","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.511Z","logger":"IPAM","caller":"ipam/allocate.go:376","msg":"Succeed to allocate: {\"ips\":[{\"address\":\"10.233.68.3/24\",\"ipPool\":\"auto4-default-subnet-deploy-eth0-bc4b5\",\"nic\":\"eth0\",\"version\":4}],\"routes\":null}","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
{"level":"INFO","ts":"2024-12-10T01:26:34.511Z","logger":"IPAM","caller":"cmd/ipam.go:56","msg":"IPAM allocation duration: 50.060059881","CNICommand":"ADD","ContainerID":"1139dad8e5b9ba0f847301c7d91ce80287144e4046482eb9d6fa2d930ca83c7f","IfName":"eth0","NetNamespace":"/proc/35168/ns/net","PodNamespace":"default","PodName":"default-subnet-deploy-7cbb487685-ss876","PodUID":""}
  1. kubelet log about pod default-subnet-deploy-7cbb487685-j7rkw
Dec 10 09:25:43 ksdragon kubelet: I1210 09:25:43.595735    2127 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4t2\" (UniqueName: \"kubernetes.io/projected/c94dd65f-e6f2-43a3-a55a-ec216530a3fd-kube-api-access-4b4t2\") pod \"default-subnet-deploy-7cbb487685-j7rkw\" (UID: \"c94dd65f-e6f2-43a3-a55a-ec216530a3fd\") " pod="default/default-subnet-deploy-7cbb487685-j7rkw"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CmdAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, <nil>, <nil>
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetK8sArgs: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetDefaultNetworks: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] getKubernetesDelegate: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{k8s-pod-network kube-system []     [] <nil>  <nil> <nil>}, /etc/cni/net.d/, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] TryLoadPodDelegates: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] tryLoadK8sPodDefaultNetwork: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetPodNetwork: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CreateCNIRuntimeConf: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, eth0, &{[] <nil> []    } &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] delegateAdd: <nil>, &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}, &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] conflistAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }, {
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.383 [INFO][35272] plugin.go 327: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0 default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685 projectcalico.org/namespace:default projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:default] map[] [] [] []} {k8s  ksdragon  default-subnet-deploy-7cbb487685-j7rkw eth0 default [] []   [kns.default ksa.default.default] calia62f9cffd74  [] []}} ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.384 [INFO][35272] k8s.go 76: Extracted identifiers for CmdAddK8s ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 385: Populated endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 386: Calico CNI using IPs: [10.233.68.1/32] ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] dataplane_linux.go 68: Setting the host side veth name to calia62f9cffd74 ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] dataplane_linux.go 479: Disabling IPv4 forwarding ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] k8s.go 413: Added Mac, interface name, and active container ID to endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"ae:c5:14:fc:3f:eb", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.478 [INFO][35272] k8s.go 498: Wrote updated endpoint to datastore ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [verbose] Add: default:default-subnet-deploy-7cbb487685-j7rkw:c94dd65f-e6f2-43a3-a55a-ec216530a3fd:kube-system/k8s-pod-network(k8s-pod-network):eth0 {"cniVersion":"0.3.1","interfaces":[{"name":"calia62f9cffd74"}],"ips":[{"version":"4","address":"10.233.68.1/32"}],"dns":{}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [debug] SetNetworkStatus: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, [{kube-system/k8s-pod-network  [10.233.68.1]  true {[]  [] []} <nil>}], &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: I1210 09:26:34.517026   35246 event.go:282] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"default-subnet-deploy-7cbb487685-j7rkw", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", APIVersion:"v1", ResourceVersion:"635600", FieldPath:""}): type: 'Normal' reason: 'AddedInterface' Add eth0 [10.233.68.1/32] from kube-system/k8s-pod-network
Dec 10 14:39:27 ksdragon kubelet: I1210 14:39:27.250926    2127 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/default-subnet-deploy-7cbb487685-j7rkw" podStartSLOduration=18824.250522929 podStartE2EDuration="5h13m44.250522929s" podCreationTimestamp="2024-12-10 09:25:43 +0800 CST" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-12-10 09:26:34.96425529 +0800 CST m=+1993.975744386" watchObservedRunningTime="2024-12-10 14:39:27.250522929 +0800 CST m=+20766.262012020"

  1. kubelet log about pod default-subnet-deploy-7cbb487685-j7rkw
Dec 10 09:25:43 ksdragon kubelet: I1210 09:25:43.595735    2127 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4t2\" (UniqueName: \"kubernetes.io/projected/c94dd65f-e6f2-43a3-a55a-ec216530a3fd-kube-api-access-4b4t2\") pod \"default-subnet-deploy-7cbb487685-j7rkw\" (UID: \"c94dd65f-e6f2-43a3-a55a-ec216530a3fd\") " pod="default/default-subnet-deploy-7cbb487685-j7rkw"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CmdAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, <nil>, <nil>
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetK8sArgs: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetDefaultNetworks: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] getKubernetesDelegate: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{k8s-pod-network kube-system []     [] <nil>  <nil> <nil>}, /etc/cni/net.d/, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] TryLoadPodDelegates: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] tryLoadK8sPodDefaultNetwork: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetPodNetwork: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CreateCNIRuntimeConf: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, eth0, &{[] <nil> []    } &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] delegateAdd: <nil>, &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}, &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] conflistAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }, {
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.383 [INFO][35272] plugin.go 327: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0 default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685 projectcalico.org/namespace:default projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:default] map[] [] [] []} {k8s  ksdragon  default-subnet-deploy-7cbb487685-j7rkw eth0 default [] []   [kns.default ksa.default.default] calia62f9cffd74  [] []}} ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.384 [INFO][35272] k8s.go 76: Extracted identifiers for CmdAddK8s ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 385: Populated endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 386: Calico CNI using IPs: [10.233.68.1/32] ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] dataplane_linux.go 68: Setting the host side veth name to calia62f9cffd74 ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] dataplane_linux.go 479: Disabling IPv4 forwarding ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] k8s.go 413: Added Mac, interface name, and active container ID to endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"ae:c5:14:fc:3f:eb", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.478 [INFO][35272] k8s.go 498: Wrote updated endpoint to datastore ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [verbose] Add: default:default-subnet-deploy-7cbb487685-j7rkw:c94dd65f-e6f2-43a3-a55a-ec216530a3fd:kube-system/k8s-pod-network(k8s-pod-network):eth0 {"cniVersion":"0.3.1","interfaces":[{"name":"calia62f9cffd74"}],"ips":[{"version":"4","address":"10.233.68.1/32"}],"dns":{}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [debug] SetNetworkStatus: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, [{kube-system/k8s-pod-network  [10.233.68.1]  true {[]  [] []} <nil>}], &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: I1210 09:26:34.517026   35246 event.go:282] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"default-subnet-deploy-7cbb487685-j7rkw", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", APIVersion:"v1", ResourceVersion:"635600", FieldPath:""}): type: 'Normal' reason: 'AddedInterface' Add eth0 [10.233.68.1/32] from kube-system/k8s-pod-network
Dec 10 14:39:27 ksdragon kubelet: I1210 14:39:27.250926    2127 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/default-subnet-deploy-7cbb487685-j7rkw" podStartSLOduration=18824.250522929 podStartE2EDuration="5h13m44.250522929s" podCreationTimestamp="2024-12-10 09:25:43 +0800 CST" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-12-10 09:26:34.96425529 +0800 CST m=+1993.975744386" watchObservedRunningTime="2024-12-10 14:39:27.250522929 +0800 CST m=+20766.262012020"

@cyclinder
Copy link
Collaborator

From the pod's events you provided, It seems CNI and spiderpool have not been called. Can you also provide the logs about the pod in kubelet?

@bingerambo
Copy link
Author

From the pod's events you provided, It seems CNI and spiderpool have not been called. Can you also provide the logs about the pod in kubelet?

get kubelet about pod default-subnet-deploy-7cbb487685-j7rkw

Dec 10 09:25:43 ksdragon kubelet: I1210 09:25:43.595735    2127 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4t2\" (UniqueName: \"kubernetes.io/projected/c94dd65f-e6f2-43a3-a55a-ec216530a3fd-kube-api-access-4b4t2\") pod \"default-subnet-deploy-7cbb487685-j7rkw\" (UID: \"c94dd65f-e6f2-43a3-a55a-ec216530a3fd\") " pod="default/default-subnet-deploy-7cbb487685-j7rkw"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CmdAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, <nil>, <nil>
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetK8sArgs: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetDefaultNetworks: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] getKubernetesDelegate: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{k8s-pod-network kube-system []     [] <nil>  <nil> <nil>}, /etc/cni/net.d/, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, map[]
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] TryLoadPodDelegates: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}, &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] tryLoadK8sPodDefaultNetwork: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}, &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] GetPodNetwork: &Pod{ObjectMeta:{default-subnet-deploy-7cbb487685-j7rkw default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685] map[ipam.spidernet.io/subnet:{"ipv4": ["default-subnet-ipv4"]}] [{apps/v1 ReplicaSet default-subnet-deploy-7cbb487685 a778a661-6912-4c15-9a1b-f9968ccf8ae3 0xc0000482c7 0xc0000482c8}] []  [{kube-controller-manager Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:ipam.spidernet.io/subnet":{}},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"a778a661-6912-4c15-9a1b-f9968ccf8ae3\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"custom-ippool-deploy\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2024-12-10 09:25:43 +0800 CST FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PodReadyToStartContainers\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:hostIPs":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4b4t2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:custom-ippool-deploy,Image:busybox,Command:[/bin/sh -c trap : TERM INT; sleep infinity & wait],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4b4t2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:ksdragon,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodReadyToStartContainers,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:ContainersNotReady,Message:containers with unready status: [custom-ippool-deploy],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2024-12-10 09:25:43 +0800 CST,Reason:,Message:,},},Message:,Reason:,HostIP:192.168.85.128,PodIP:,StartTime:2024-12-10 09:25:43 +0800 CST,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:custom-ippool-deploy,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:busybox,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] CreateCNIRuntimeConf: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 IgnoreUnknown=1;K8S_POD_NAMESPACE=default;K8S_POD_NAME=default-subnet-deploy-7cbb487685-j7rkw;K8S_POD_INFRA_CONTAINER_ID=baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /opt/cni/bin [123 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 123 34 98 97 110 100 119 105 100 116 104 34 58 116 114 117 101 44 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 116 114 117 101 125 44 34 99 108 117 115 116 101 114 78 101 116 119 111 114 107 34 58 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 34 99 110 105 86 101 114 115 105 111 110 34 58 34 48 46 51 46 49 34 44 34 99 111 110 102 68 105 114 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 34 44 34 100 101 102 97 117 108 116 78 101 116 119 111 114 107 115 34 58 91 93 44 34 107 117 98 101 99 111 110 102 105 103 34 58 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 109 117 108 116 117 115 46 100 47 109 117 108 116 117 115 46 107 117 98 101 99 111 110 102 105 103 34 44 34 108 111 103 70 105 108 101 34 58 34 47 118 97 114 47 108 111 103 47 109 117 108 116 117 115 46 108 111 103 34 44 34 108 111 103 76 101 118 101 108 34 58 34 100 101 98 117 103 34 44 34 109 117 108 116 117 115 78 97 109 101 115 112 97 99 101 34 58 34 107 117 98 101 45 115 121 115 116 101 109 34 44 34 110 97 109 101 34 58 34 109 117 108 116 117 115 45 99 110 105 45 110 101 116 119 111 114 107 34 44 34 110 97 109 101 115 112 97 99 101 73 115 111 108 97 116 105 111 110 34 58 102 97 108 115 101 44 34 114 117 110 116 105 109 101 67 111 110 102 105 103 34 58 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 91 93 125 44 34 115 121 115 116 101 109 78 97 109 101 115 112 97 99 101 115 34 58 91 93 44 34 116 121 112 101 34 58 34 109 117 108 116 117 115 34 125]}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, eth0, &{[] <nil> []    } &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] delegateAdd: <nil>, &{{0.3.1 k8s-pod-network  map[] {} {[]  [] []} map[] <nil>} {0.3.1 k8s-pod-network false [0xc0004b6f00 0xc0004b6fc0 0xc0004b7080]} kube-system/k8s-pod-network    [] [] <nil> <nil> false false true true   [123 10 32 32 34 110 97 109 101 34 58 32 34 107 56 115 45 112 111 100 45 110 101 116 119 111 114 107 34 44 10 32 32 34 99 110 105 86 101 114 115 105 111 110 34 58 32 34 48 46 51 46 49 34 44 10 32 32 34 112 108 117 103 105 110 115 34 58 32 91 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 99 97 108 105 99 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 108 101 118 101 108 34 58 32 34 105 110 102 111 34 44 10 32 32 32 32 32 32 34 108 111 103 95 102 105 108 101 95 112 97 116 104 34 58 32 34 47 118 97 114 47 108 111 103 47 99 97 108 105 99 111 47 99 110 105 47 99 110 105 46 108 111 103 34 44 10 32 32 32 32 32 32 34 100 97 116 97 115 116 111 114 101 95 116 121 112 101 34 58 32 34 107 117 98 101 114 110 101 116 101 115 34 44 10 32 32 32 32 32 32 34 110 111 100 101 110 97 109 101 34 58 32 34 107 115 100 114 97 103 111 110 34 44 10 32 32 32 32 32 32 34 109 116 117 34 58 32 48 44 10 32 32 32 32 32 32 34 105 112 97 109 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 115 112 105 100 101 114 112 111 111 108 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 112 111 108 105 99 121 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 107 56 115 34 10 32 32 32 32 32 32 125 44 10 32 32 32 32 32 32 34 107 117 98 101 114 110 101 116 101 115 34 58 32 123 10 32 32 32 32 32 32 32 32 32 32 34 107 117 98 101 99 111 110 102 105 103 34 58 32 34 47 101 116 99 47 99 110 105 47 110 101 116 46 100 47 99 97 108 105 99 111 45 107 117 98 101 99 111 110 102 105 103 34 10 32 32 32 32 32 32 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 112 111 114 116 109 97 112 34 44 10 32 32 32 32 32 32 34 115 110 97 116 34 58 32 116 114 117 101 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 112 111 114 116 77 97 112 112 105 110 103 115 34 58 32 116 114 117 101 125 10 32 32 32 32 125 44 10 32 32 32 32 123 10 32 32 32 32 32 32 34 116 121 112 101 34 58 32 34 98 97 110 100 119 105 100 116 104 34 44 10 32 32 32 32 32 32 34 99 97 112 97 98 105 108 105 116 105 101 115 34 58 32 123 34 98 97 110 100 119 105 100 116 104 34 58 32 116 114 117 101 125 10 32 32 32 32 125 10 32 32 93 10 125]}, &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:25:44+08:00 [debug] conflistAdd: &{baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa /proc/35152/ns/net eth0 [[IgnoreUnknown true] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa] [K8S_POD_UID ] [IgnoreUnknown 1] [K8S_POD_NAMESPACE default] [K8S_POD_NAME default-subnet-deploy-7cbb487685-j7rkw] [K8S_POD_INFRA_CONTAINER_ID baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa]] map[] }, {
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.383 [INFO][35272] plugin.go 327: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0 default-subnet-deploy-7cbb487685- default  c94dd65f-e6f2-43a3-a55a-ec216530a3fd 635600 0 2024-12-10 09:25:43 +0800 CST <nil> <nil> map[app:custom-ippool-deploy pod-template-hash:7cbb487685 projectcalico.org/namespace:default projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:default] map[] [] [] []} {k8s  ksdragon  default-subnet-deploy-7cbb487685-j7rkw eth0 default [] []   [kns.default ksa.default.default] calia62f9cffd74  [] []}} ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:25:44.384 [INFO][35272] k8s.go 76: Extracted identifiers for CmdAddK8s ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 385: Populated endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] k8s.go 386: Calico CNI using IPs: [10.233.68.1/32] ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.460 [INFO][35272] dataplane_linux.go 68: Setting the host side veth name to calia62f9cffd74 ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] dataplane_linux.go 479: Disabling IPv4 forwarding ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.464 [INFO][35272] k8s.go 413: Added Mac, interface name, and active container ID to endpoint ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0", GenerateName:"default-subnet-deploy-7cbb487685-", Namespace:"default", SelfLink:"", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", ResourceVersion:"635600", Generation:0, CreationTimestamp:time.Date(2024, time.December, 10, 9, 25, 43, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"custom-ippool-deploy", "pod-template-hash":"7cbb487685", "projectcalico.org/namespace":"default", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"default"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ksdragon", ContainerID:"baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa", Pod:"default-subnet-deploy-7cbb487685-j7rkw", Endpoint:"eth0", ServiceAccountName:"default", IPNetworks:[]string{"10.233.68.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.default", "ksa.default.default"}, InterfaceName:"calia62f9cffd74", MAC:"ae:c5:14:fc:3f:eb", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10 09:26:34.478 [INFO][35272] k8s.go 498: Wrote updated endpoint to datastore ContainerID="baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa" Namespace="default" Pod="default-subnet-deploy-7cbb487685-j7rkw" WorkloadEndpoint="ksdragon-k8s-default--subnet--deploy--7cbb487685--j7rkw-eth0"
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [verbose] Add: default:default-subnet-deploy-7cbb487685-j7rkw:c94dd65f-e6f2-43a3-a55a-ec216530a3fd:kube-system/k8s-pod-network(k8s-pod-network):eth0 {"cniVersion":"0.3.1","interfaces":[{"name":"calia62f9cffd74"}],"ips":[{"version":"4","address":"10.233.68.1/32"}],"dns":{}}
Dec 10 09:26:34 ksdragon cri-dockerd: 2024-12-10T09:26:34+08:00 [debug] SetNetworkStatus: &{0xc0003809a0 0xc0000c0c30 0xc00040c9c0 0xc000441a80}, &{{true} <nil> default-subnet-deploy-7cbb487685-j7rkw default baa5b5f133c6baf191d4a74847565d30bc99813188b2b39e7f9e3d2c7bd11faa }, [{kube-system/k8s-pod-network  [10.233.68.1]  true {[]  [] []} <nil>}], &{{0.3.1 multus-cni-network multus map[bandwidth:true portMappings:true] {} {[]  [] []} map[] <nil>} <nil> <nil> /etc/cni/net.d/ /var/lib/cni/multus /opt/cni/bin [] [0xc00012aa80] /etc/cni/net.d/multus.d/multus.kubeconfig k8s-pod-network [] /var/log/multus.log debug true <nil> 0xc000427600  false  [default] [kube-system] kube-system}
Dec 10 09:26:34 ksdragon cri-dockerd: I1210 09:26:34.517026   35246 event.go:282] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"default-subnet-deploy-7cbb487685-j7rkw", UID:"c94dd65f-e6f2-43a3-a55a-ec216530a3fd", APIVersion:"v1", ResourceVersion:"635600", FieldPath:""}): type: 'Normal' reason: 'AddedInterface' Add eth0 [10.233.68.1/32] from kube-system/k8s-pod-network
Dec 10 14:39:27 ksdragon kubelet: I1210 14:39:27.250926    2127 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/default-subnet-deploy-7cbb487685-j7rkw" podStartSLOduration=18824.250522929 podStartE2EDuration="5h13m44.250522929s" podCreationTimestamp="2024-12-10 09:25:43 +0800 CST" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-12-10 09:26:34.96425529 +0800 CST m=+1993.975744386" watchObservedRunningTime="2024-12-10 14:39:27.250522929 +0800 CST m=+20766.262012020"

@cyclinder
Copy link
Collaborator

Thanks, We'll look into this further.

@haribhusal2025
Copy link

Hi @cyclinder, does spiderpool allows to define 'mtu' size in macvlan interface ?

@cyclinder
Copy link
Collaborator

Hi @haribhusal2025, Are you talking about the macvlan master interface or the macvlan sub-interface? The sub-interface's mtu should inherit directly from the master interface, the configuration has no effect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants