Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dispatch logic in nftables #9323

Merged

Conversation

caseydavenport
Copy link
Member

@caseydavenport caseydavenport commented Oct 9, 2024

Description

Update dispatch logic in nftables mode to use verdict maps instead of a list of dispatch chains.

Using verdict maps allows us to look up the correct policy rules to execute in constant time, instead of traversing a list of chains proportional to the number of locally running pods.

I expect the savings here to be minimal in most cases - iptables mode already mitigates this by using a dispatch trie to minimize the number rules traversed. Still worthwhile, especially as the number of pods per node some users are pushing grows over time.

Related issues/PRs

Todos

  • Tests
  • Documentation
  • Release note

Release Note

TBD

Reminder for the reviewer

Make sure that this PR has the correct labels and milestone set.

Every PR needs one docs-* label.

  • docs-pr-required: This change requires a change to the documentation that has not been completed yet.
  • docs-completed: This change has all necessary documentation completed.
  • docs-not-required: This change has no user-facing impact and requires no docs.

Every PR needs one release-note-* label.

  • release-note-required: This PR has user-facing changes. Most PRs should have this label.
  • release-note-not-required: This PR has no user-facing changes.

Other optional labels:

  • cherry-pick-candidate: This PR should be cherry-picked to an earlier release. For bug fixes only.
  • needs-operator-pr: This PR is related to install and requires a corresponding change to the operator.

@caseydavenport caseydavenport requested a review from a team as a code owner October 9, 2024 21:52
@marvin-tigera marvin-tigera added this to the Calico v3.30.0 milestone Oct 9, 2024
@marvin-tigera marvin-tigera added release-note-required Change has user-facing impact (no matter how small) docs-pr-required Change is not yet documented labels Oct 9, 2024
@caseydavenport caseydavenport marked this pull request as draft October 9, 2024 21:52
@caseydavenport caseydavenport force-pushed the casey-nft-dispatch branch 2 times, most recently from 5dd25a8 to cfe6c1c Compare October 14, 2024 21:19
@caseydavenport caseydavenport added the docs-not-required Docs not required for this change label Oct 14, 2024
@marvin-tigera marvin-tigera removed the docs-pr-required Change is not yet documented label Oct 14, 2024
@caseydavenport caseydavenport added the release-note-not-required Change has no user-facing impact label Oct 14, 2024
@marvin-tigera marvin-tigera removed the release-note-required Change has user-facing impact (no matter how small) label Oct 14, 2024
@caseydavenport caseydavenport changed the title [WIP] Update dispatch logic in nftables Update dispatch logic in nftables Oct 14, 2024
@caseydavenport caseydavenport marked this pull request as ready for review October 18, 2024 16:56
@caseydavenport caseydavenport force-pushed the casey-nft-dispatch branch 2 times, most recently from a2bd27e to dae33d7 Compare October 28, 2024 20:14
@caseydavenport caseydavenport force-pushed the casey-nft-dispatch branch 2 times, most recently from 234a737 to 7d1c1a8 Compare November 21, 2024 21:47
felix/dataplane/linux/endpoint_mgr.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
felix/dataplane/linux/int_dataplane.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
Copy link
Member

@fasaxc fasaxc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, think you were planning some more tests?

felix/nftables/ipsets.go Outdated Show resolved Hide resolved
@caseydavenport
Copy link
Member Author

@fasaxc thanks for the reviews! I've updated to use errgroup as well as adding some new UTs for the map code + table integration.

felix/nftables/ipsets.go Outdated Show resolved Hide resolved
felix/nftables/ipsets.go Outdated Show resolved Hide resolved
felix/nftables/ipsets.go Outdated Show resolved Hide resolved
felix/nftables/maps.go Outdated Show resolved Hide resolved
@caseydavenport caseydavenport merged commit 9690018 into projectcalico:master Jan 8, 2025
2 of 3 checks passed
@caseydavenport caseydavenport deleted the casey-nft-dispatch branch January 8, 2025 18:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs-not-required Docs not required for this change release-note-not-required Change has no user-facing impact
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants