Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[inetstack] Enhancement: Remove circular dependencies #1464

Merged
merged 2 commits into from
Nov 26, 2024
Merged

[inetstack] Enhancement: Remove circular dependencies #1464

merged 2 commits into from
Nov 26, 2024

Conversation

iyzhang
Copy link
Contributor

@iyzhang iyzhang commented Nov 21, 2024

This PR removes circular dependencies between the sender, receiver and control block in established TCP sockets. We move all state into the control block structure, per the TCP recommendation, and to make it easier to move the state later. However, we pass the control block to static functions in the receiver and sender for receive and send path processing.

@iyzhang iyzhang requested a review from anandbonde November 21, 2024 21:24
@iyzhang iyzhang self-assigned this Nov 21, 2024
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 7cc5ed9

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 18841023.90 699.38 301.63 85.64
bgc::inetstack::poll_recv 9420511.95 1639.86 707.23 53.83
bgc::inetstack::tcp::established::background 11053.30 1641.71 706.72 0.20
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11053.30 478.35 207.87 23.25
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11044.96 389.22 167.46 29.59
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11003.02 916.30 389.21 24.17
ioc::network::libos::pop 9030.55 511.95 221.06 0.06
demikernel::sgafree 8772.60 105.07 45.92 0.02
ioc::network::libos::push;inetstack::push 8762.80 6108.75 2652.35 2.31
ioc::network::libos::push 8073.74 33495552.39 14966753.98 40.42
demikernel::push 8073.74 643.44 277.73 0.06
demikernel::sgaalloc 6556.29 171.14 73.84 0.03
demikernel::pop 6035.06 585.14 253.56 0.04
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5278.36 2501.45 1078.86 1.35
ioc::network::libos::pushto 1104.00 4264.80 1902.02 4.27
ioc::network::libos::pushto;inetstack::push 1104.00 3855.64 1719.33 90.41
demikernel::pushto 1104.00 461.76 206.26 0.46
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 201.33 199.07 91.02 62.39
ioc::network::libos::close 47.48 6626.57 2850.69 0.11
ioc::network::libos::connect 41.86 40338.53 17467.12 0.51
bgc::inetstack::tcp::passiveopen::background 41.86 31718.20 13893.89 0.01
ioc::network::libos::accept 38.07 2026.57 885.05 0.00
demikernel::async_close 32.50 677.99 285.97 0.01
demikernel::accept 21.86 1214.71 530.46 0.00
demikernel::connect 20.93 4155.00 1795.31 0.02
demikernel::socket 10.30 1907.87 830.49 0.00
bgc::inetstack::arp::background 6.27 2102.74 909.12 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 6218.58 2685.93 83.88
bgc::inetstack::icmp::background 1.03 3200.22 1379.90 0.00
demikernel::new 1.00 92702843.55 40065043.19 19.62
demikernel::bind 1.00 28271.25 12175.90 0.00
bgc::inetstack::poll_recv;inetstack::poll 1.00 14763.77 6374.86 0.04
demikernel::listen 1.00 3584.43 1547.80 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = 7cc5ed9

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 29405758.00 337.16 145.62 75.58
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 29405758.00 197.60 85.34 58.73
bgc::inetstack::poll_recv 14702879.00 897.48 388.06 35.51
bgc::inetstack::tcp::established::background 11094.96 1106.99 469.94 0.11
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11094.96 331.30 139.73 26.95
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11083.84 349.37 150.57 32.40
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11041.68 298.92 121.40 14.47
ioc::network::libos::pop 9062.67 366.81 157.47 0.02
demikernel::sgafree 8777.36 85.84 36.96 0.01
ioc::network::libos::push;inetstack::push 8762.80 2041.68 908.54 0.69
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8762.80 332.16 146.90 15.46
ioc::network::libos::push 8073.74 33413461.40 13539617.88 25.94
demikernel::push 8073.74 772.12 335.86 0.04
demikernel::sgaalloc 6532.33 158.40 67.45 0.01
demikernel::pop 6051.24 544.06 232.95 0.02
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4585.29 1925.97 796.57 2.07
ioc::network::libos::pushto 1188.00 1311.38 590.51 0.05
ioc::network::libos::pushto;inetstack::push 1188.00 702.40 317.04 53.79
demikernel::pushto 1188.00 506.80 229.46 0.02
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 1188.00 253.08 113.88 35.93
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 544.00 359.94 163.45 77.10
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;catnip::runtime::transmit 60.14 613.71 267.00 3.40
ioc::network::libos::close 49.47 5930.76 2558.98 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 36063.27 16252.73 0.01
ioc::network::libos::connect 41.86 30443.18 13171.62 0.04
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6335.06 2734.09 22.31
ioc::network::libos::accept 38.21 2041.76 903.83 0.00
demikernel::async_close 32.50 585.72 235.87 0.00
demikernel::accept 21.86 1424.16 625.84 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 17260.28 7864.07 17.63
demikernel::connect 20.93 2737.40 1187.94 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 20.93 579.55 250.98 11.57
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 13.00 1403.65 562.72 18.09
demikernel::socket 10.30 1733.37 751.48 0.00
bgc::inetstack::arp::background 6.47 2311.82 998.26 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 20622.90 8901.54 95.37
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 2.00 18479.80 7976.93 89.57
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 1.75 817.75 351.31 0.50
bgc::inetstack::icmp::background 1.05 3244.87 1407.47 0.00
demikernel::new 1.00 1758666898.68 758985943.78 47.85
bgc::inetstack::poll_recv;inetstack::poll 1.00 43234.83 18661.07 0.18
demikernel::bind 1.00 11005.50 4742.23 0.00
demikernel::listen 1.00 3297.93 1407.95 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 7cc5ed9

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 13588311.38 2126.05 939.20 33.28
demikernel::sgafree 11569.98 71.39 30.71 0.05
demikernel::sgaalloc 11358.92 119.17 52.20 0.11
ioc::network::libos::push;catnap::linux::transport::push 9066.12 648.77 283.49 3.98
ioc::network::libos::push 8800.49 17032.11 7462.24 7.18
demikernel::push 8800.49 556.93 242.91 0.17
ioc::network::libos::pop;catnap::linux::transport::pop 8031.19 416.82 179.64 4.87
ioc::network::libos::pop 7822.52 6116812.80 2316087.24 25.27
demikernel::pop 7822.52 578.69 249.02 0.13
ioc::network::libos::pushto 1929.67 7784.82 3037.75 23.78
demikernel::pushto 1929.67 438.63 172.27 1.48
ioc::network::libos::pushto;catnap::linux::transport::push 1929.67 420.37 165.40 5.55
demikernel::async_close 32.50 922.75 377.84 0.02
ioc::network::libos::connect 24.95 4928274.30 2206781.13 23.71
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 75652.63 33202.97 3.09
demikernel::connect 24.95 2042.36 905.04 0.01
ioc::network::libos::close 18.35 24191.97 10430.25 0.07
ioc::network::libos::close;catnap::linux::transport::close 18.35 22895.58 9871.45 94.70
ioc::network::libos::accept 15.42 913942841.35 390821600.32 44.92
demikernel::accept 15.42 1523.25 654.66 0.00
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 7681.11 3278.16 0.00
demikernel::socket 9.50 157093.85 67349.64 0.28
demikernel::socket;catnap::linux::transport::socket 9.50 154838.61 66379.23 96.57
demikernel::new 1.00 265083.15 114378.55 0.12
demikernel::bind 1.00 29105.58 12415.40 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 24596.95 10496.57 84.40
demikernel::listen 1.00 15496.97 6660.58 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 14343.97 6165.90 92.51
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = bf14926

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 13360750.51 2015.43 885.61 32.75
demikernel::sgafree 11555.42 76.99 32.79 0.05
demikernel::sgaalloc 11318.40 121.40 52.34 0.10
ioc::network::libos::push;catnap::linux::transport::push 9066.12 630.65 276.34 3.95
ioc::network::libos::push 8800.49 16693.33 7328.42 6.48
demikernel::push 8800.49 548.41 239.21 0.15
ioc::network::libos::pop;catnap::linux::transport::pop 8031.05 420.60 181.13 4.51
ioc::network::libos::pop 7822.39 6390593.37 2615608.17 25.77
demikernel::pop 7822.39 557.73 239.83 0.11
ioc::network::libos::pushto 1361.67 7341.66 3159.36 23.86
demikernel::pushto 1361.67 468.60 201.58 1.53
ioc::network::libos::pushto;catnap::linux::transport::push 1361.67 420.96 181.49 5.77
demikernel::async_close 32.50 870.34 346.02 0.01
ioc::network::libos::connect 24.95 4547729.36 1977278.40 25.54
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 80135.07 34488.92 2.97
demikernel::connect 24.95 2045.10 880.72 0.01
ioc::network::libos::close 18.35 25840.91 11101.85 0.06
ioc::network::libos::close;catnap::linux::transport::close 18.35 24379.36 10472.63 94.80
demikernel::accept 15.42 1561.46 680.45 0.00
ioc::network::libos::accept 15.39 890231259.97 384216592.72 45.08
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 4253.04 1862.31 0.00
demikernel::socket 9.50 156323.51 67279.73 0.26
demikernel::socket;catnap::linux::transport::socket 9.50 154047.89 66294.46 96.59
demikernel::new 1.00 262063.74 113229.24 0.08
demikernel::bind 1.00 29686.98 12872.12 0.00
demikernel::bind;catnap::linux::transport::bind 1.00 24550.92 10667.69 83.64
demikernel::listen 1.00 14893.24 6463.47 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 13878.21 6023.54 93.06
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = bf14926

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 19039665.93 699.62 308.42 85.90
bgc::inetstack::poll_recv 9519832.97 1633.08 719.74 53.47
bgc::inetstack::tcp::established::background 11053.52 1630.49 701.05 0.20
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11053.52 477.70 203.08 23.21
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11045.38 391.85 170.72 29.54
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11003.45 882.31 375.14 23.88
ioc::network::libos::pop 9030.41 427.50 189.01 0.04
ioc::network::libos::push;inetstack::push 8762.80 6114.64 2722.97 2.34
demikernel::sgafree 8748.00 101.29 50.18 0.01
ioc::network::libos::push 8073.74 33474487.66 14635938.33 39.67
demikernel::push 8073.74 583.25 258.11 0.06
demikernel::sgaalloc 6502.58 140.78 62.59 0.02
demikernel::pop 6034.96 576.08 253.54 0.04
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5277.75 2381.64 1024.55 1.25
ioc::network::libos::pushto 669.33 4463.45 1974.79 3.00
ioc::network::libos::pushto;inetstack::push 669.33 4040.98 1787.88 90.53
demikernel::pushto 669.33 502.73 222.41 0.33
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 190.00 194.11 100.46 61.46
ioc::network::libos::close 47.33 6421.92 2860.40 0.11
ioc::network::libos::connect 41.86 42063.85 18278.24 0.56
bgc::inetstack::tcp::passiveopen::background 41.86 32137.08 14457.13 0.01
ioc::network::libos::accept 38.04 2091.44 943.28 0.00
demikernel::async_close 32.50 780.95 331.63 0.01
demikernel::accept 21.86 1235.44 549.83 0.00
demikernel::connect 20.93 7346.55 3245.31 0.03
demikernel::socket 10.30 2344.32 1029.11 0.00
bgc::inetstack::arp::background 6.38 1972.20 869.41 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 6799.87 3019.46 84.55
bgc::inetstack::icmp::background 1.03 3098.90 1370.58 0.00
demikernel::new 1.00 94405915.40 41788798.25 20.52
demikernel::bind 1.00 26875.06 11821.40 0.00
bgc::inetstack::poll_recv;inetstack::poll 1.00 16021.80 7107.01 0.07
demikernel::listen 1.00 3853.86 1695.08 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = bf14926

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 29440153.83 339.23 151.09 76.07
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 29440153.83 197.02 87.69 58.22
bgc::inetstack::poll_recv 14720076.92 897.25 399.81 35.73
bgc::inetstack::tcp::established::background 11133.88 1094.33 479.11 0.11
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11133.88 330.02 142.90 26.75
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11123.52 342.65 153.31 32.60
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11081.36 293.18 119.58 14.59
ioc::network::libos::pop 9082.08 352.58 156.34 0.02
demikernel::sgafree 8775.87 79.57 35.76 0.01
ioc::network::libos::push;inetstack::push 8762.74 1982.39 934.85 0.66
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8762.74 326.82 154.04 15.79
ioc::network::libos::push 8073.71 33393466.66 15601165.73 25.76
demikernel::push 8073.71 709.13 327.74 0.04
demikernel::sgaalloc 6530.71 148.35 67.30 0.01
demikernel::pop 6050.16 560.01 247.56 0.03
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4621.80 1734.85 739.46 2.02
ioc::network::libos::pushto 1162.00 1330.06 598.65 0.05
ioc::network::libos::pushto;inetstack::push 1162.00 709.79 319.37 53.59
demikernel::pushto 1162.00 477.65 214.89 0.02
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 1162.00 261.82 117.77 36.84
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 482.33 247.92 111.90 70.18
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;catnip::runtime::transmit 99.93 648.44 293.23 3.62
ioc::network::libos::close 49.48 5667.35 2538.53 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 35055.32 16185.50 0.01
ioc::network::libos::connect 41.86 29362.17 13365.13 0.04
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6451.00 3019.72 22.72
ioc::network::libos::accept 37.89 2143.88 976.91 0.00
demikernel::async_close 32.50 569.21 225.89 0.00
demikernel::accept 21.86 1373.88 634.70 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 17725.30 8317.08 17.86
demikernel::connect 20.93 2567.71 1192.47 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 20.93 631.15 286.72 12.17
demikernel::socket 10.30 1630.81 736.50 0.00
bgc::inetstack::arp::background 6.47 2277.01 1010.86 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 4.33 2377.15 961.38 15.76
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 21473.80 9552.47 95.83
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 2.00 19236.35 8560.06 89.35
bgc::inetstack::icmp::background 1.05 3033.83 1345.53 0.00
demikernel::new 1.00 1764360544.37 785260785.53 47.75
bgc::inetstack::poll_recv;inetstack::poll 1.00 44775.60 19918.29 0.20
demikernel::bind 1.00 10949.19 4853.15 0.00
demikernel::listen 1.00 3384.07 1494.63 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 1.00 449.00 186.72 0.68
demikernel::close 0.00 nan nan 0.00

@iyzhang iyzhang force-pushed the enhancement-inetstack-reorg-receiver branch from bf14926 to 5147098 Compare November 22, 2024 22:01
@github-actions GitHub Actions
Copy link

libos = catnip
commit id = 5147098

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 29423206.57 337.56 150.64 76.02
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 29423206.57 196.74 87.62 58.40
bgc::inetstack::poll_recv 14711603.28 894.16 400.20 34.76
bgc::inetstack::tcp::established::background 11201.41 1122.59 493.88 0.11
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11201.41 352.91 155.59 26.48
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11191.04 342.76 152.77 32.62
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11148.96 294.85 121.15 14.69
ioc::network::libos::pop 9126.55 379.90 170.47 0.02
demikernel::sgafree 8783.36 81.57 36.58 0.01
ioc::network::libos::push;inetstack::push 8762.80 1935.01 894.31 0.67
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8762.80 311.87 143.69 15.75
ioc::network::libos::push 8073.74 33382121.57 13539446.21 25.91
demikernel::push 8073.74 688.02 308.17 0.04
demikernel::sgaalloc 6539.08 119.90 52.69 0.01
demikernel::pop 6054.18 562.99 252.24 0.03
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4664.85 1737.39 742.81 1.99
ioc::network::libos::pushto 1294.00 1316.56 587.65 0.06
ioc::network::libos::pushto;inetstack::push 1294.00 697.54 310.83 53.22
demikernel::pushto 1294.00 477.46 212.48 0.02
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 1294.00 259.71 115.85 37.19
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 572.00 251.46 114.94 71.60
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;catnip::runtime::transmit 165.79 625.86 280.13 3.59
ioc::network::libos::close 49.45 5766.41 2595.48 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 35811.38 16528.42 0.01
ioc::network::libos::connect 41.86 30826.90 14209.91 0.04
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6586.93 2985.87 22.75
ioc::network::libos::accept 38.21 2148.02 965.19 0.00
demikernel::async_close 32.50 634.44 258.17 0.00
demikernel::accept 21.86 1110.26 498.81 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 17190.93 7997.87 18.08
demikernel::connect 20.93 2735.34 1240.52 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 20.93 598.73 267.41 11.83
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 10.33 384.44 218.65 0.01
demikernel::socket 10.30 2569.50 1110.52 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 9.00 5170.22 2320.20 37.82
bgc::inetstack::arp::background 6.43 2282.97 1007.90 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 20908.82 9303.92 95.74
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 2.00 18716.03 8327.21 89.45
bgc::inetstack::icmp::background 1.05 2971.77 1325.03 0.00
demikernel::new 1.00 1746289239.18 776626217.71 48.62
bgc::inetstack::poll_recv;inetstack::poll 1.00 43676.07 19437.48 0.15
demikernel::bind 1.00 11321.00 4971.82 0.00
demikernel::listen 1.00 2741.07 1203.66 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 5147098

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::layer4_endpoint::poll_once 19101600.80 693.74 298.08 85.88
bgc::inetstack::poll_recv 9550800.40 1621.54 696.68 53.02
bgc::inetstack::tcp::established::background 11053.12 1699.68 722.89 0.20
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11053.12 501.63 209.31 22.93
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11044.41 392.25 169.34 29.25
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11002.46 964.26 409.30 24.76
ioc::network::libos::pop 9053.53 487.64 210.43 0.04
demikernel::sgafree 8847.25 122.85 52.06 0.02
ioc::network::libos::push;inetstack::push 8762.80 6164.73 2714.44 2.27
ioc::network::libos::push 8073.74 33428781.50 16101784.48 40.50
demikernel::push 8073.74 594.33 261.92 0.06
demikernel::sgaalloc 6669.71 146.07 64.61 0.03
demikernel::pop 6058.71 615.20 263.18 0.04
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5299.78 2469.09 1044.25 1.26
ioc::network::libos::pushto 2422.67 4329.27 1855.16 7.30
ioc::network::libos::pushto;inetstack::push 2422.67 3824.29 1637.72 88.49
demikernel::pushto 2422.67 462.29 197.86 0.81
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 622.00 255.86 108.80 64.66
ioc::network::libos::close 47.80 6265.83 2697.97 0.10
ioc::network::libos::connect 41.86 35989.73 15456.71 0.54
bgc::inetstack::tcp::passiveopen::background 41.86 32463.98 14196.81 0.01
ioc::network::libos::accept 38.07 2196.45 967.37 0.00
demikernel::async_close 32.50 744.53 315.35 0.01
demikernel::accept 21.86 1312.37 568.15 0.00
demikernel::connect 20.93 3763.61 1644.30 0.03
demikernel::socket 10.30 1906.75 822.39 0.00
bgc::inetstack::arp::background 6.35 2028.66 874.99 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::layer4_endpoint::poll_once 2.00 6475.23 2779.63 83.87
bgc::inetstack::icmp::background 1.03 3023.52 1303.71 0.00
demikernel::new 1.00 98866716.05 42474291.96 20.22
demikernel::bind 1.00 28727.31 12255.27 0.00
bgc::inetstack::poll_recv;inetstack::poll 1.00 15338.17 6588.06 0.03
demikernel::listen 1.00 3240.43 1404.64 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 5147098

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 13336574.60 2097.11 901.65 33.04
demikernel::sgafree 11536.07 74.13 31.60 0.05
demikernel::sgaalloc 11283.60 114.00 49.00 0.11
ioc::network::libos::push;catnap::linux::transport::push 9066.10 600.88 262.99 3.85
ioc::network::libos::push 8800.48 16415.31 7152.25 7.06
demikernel::push 8800.48 539.23 235.12 0.16
ioc::network::libos::pop;catnap::linux::transport::pop 8022.69 393.75 169.13 3.41
ioc::network::libos::pop 7814.24 17625753.17 7975811.55 24.34
demikernel::pop 7814.24 559.16 239.32 0.12
ioc::network::libos::pushto 607.33 8320.58 3522.18 23.50
demikernel::pushto 607.33 482.68 203.05 1.64
ioc::network::libos::pushto;catnap::linux::transport::push 607.33 472.94 199.01 5.92
demikernel::async_close 32.50 943.30 373.03 0.01
ioc::network::libos::connect 24.95 6250432.89 2683560.07 27.86
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 76958.96 32949.65 2.54
demikernel::connect 24.95 2091.15 904.40 0.01
ioc::network::libos::close 18.35 24163.03 10432.28 0.07
ioc::network::libos::close;catnap::linux::transport::close 18.35 22863.81 9869.62 94.65
demikernel::accept 15.42 1700.94 738.07 0.00
ioc::network::libos::accept 15.41 867381995.07 372468902.47 44.39
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 6743.83 2978.33 0.00
demikernel::socket 9.50 154492.84 66967.58 0.33
demikernel::socket;catnap::linux::transport::socket 9.50 152246.25 65999.90 96.64
demikernel::new 1.00 260305.06 111751.09 0.14
demikernel::bind 1.00 29005.40 12510.31 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 23696.62 10226.80 82.79
demikernel::listen 1.00 15840.16 6840.78 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 14787.42 6388.77 93.28
demikernel::close 0.00 nan nan 0.00

@iyzhang iyzhang force-pushed the enhancement-inetstack-reorg-receiver branch from 5147098 to ba668d6 Compare November 26, 2024 14:15
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = ba668d6

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll;inetstack::layer4_endpoint::poll_once 19075784.57 701.49 305.99 86.04
bgc::inetstack::poll 9537892.28 1635.72 713.46 54.17
bgc::inetstack::tcp::established::background 11052.50 1698.17 727.46 0.20
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11052.50 487.22 208.12 23.27
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11044.29 400.31 172.44 29.63
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11002.46 984.89 419.17 24.32
ioc::network::libos::pop 9032.02 436.36 189.86 0.04
ioc::network::libos::push;inetstack::push 8762.80 6186.54 2676.76 2.36
demikernel::sgafree 8761.51 113.03 48.25 0.02
ioc::network::libos::push 8073.74 33406583.60 14017683.70 40.06
demikernel::push 8073.74 583.09 251.45 0.05
demikernel::sgaalloc 6529.33 152.18 66.41 0.04
demikernel::pop 6036.82 677.13 291.92 0.04
bgc::inetstack::poll;inetstack::poll_bg_work::for::for 5279.08 2324.99 996.24 1.25
ioc::network::libos::pushto 908.00 5499.54 2674.79 4.77
ioc::network::libos::pushto;inetstack::push 908.00 4823.27 2356.82 88.22
demikernel::pushto 908.00 716.36 340.60 0.63
bgc::inetstack::poll;inetstack::poll_bg_work::for::for;udp::receive 218.33 212.85 105.35 60.78
ioc::network::libos::close 47.32 6193.94 2686.16 0.10
ioc::network::libos::connect 41.86 37196.58 16188.63 0.46
bgc::inetstack::tcp::passiveopen::background 41.86 31438.20 13507.55 0.01
ioc::network::libos::accept 38.07 2070.49 891.19 0.00
demikernel::async_close 32.50 750.67 313.77 0.01
demikernel::accept 21.86 1131.62 488.82 0.00
demikernel::connect 20.93 4240.02 1864.34 0.03
demikernel::socket 10.30 2217.89 961.29 0.00
bgc::inetstack::arp::background 6.38 1839.03 796.51 0.00
bgc::inetstack::icmp::background 1.03 3190.77 1386.77 0.00
demikernel::new 1.00 98370892.48 42724586.45 19.54
demikernel::bind 1.00 25885.50 11089.58 0.00
demikernel::listen 1.00 3454.71 1481.99 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = ba668d6

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll;inetstack::layer4_endpoint::poll_once 28610474.73 340.27 148.89 75.97
bgc::inetstack::poll;inetstack::layer4_endpoint::poll_once;catnip::runtime::receive 28610474.73 197.03 86.04 58.06
bgc::inetstack::poll 14305237.37 902.29 396.30 34.70
bgc::inetstack::tcp::established::background 11174.64 1065.40 462.67 0.11
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11174.64 310.83 135.20 26.61
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11164.29 337.91 149.27 32.54
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11122.27 286.96 116.61 14.80
ioc::network::libos::pop 9109.37 354.37 155.31 0.02
demikernel::sgafree 8778.04 83.32 36.84 0.01
ioc::network::libos::push;inetstack::push 8762.80 2000.12 915.86 0.69
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8762.80 320.95 146.97 15.58
ioc::network::libos::push 8073.74 33406088.78 15188565.54 25.73
demikernel::push 8073.74 651.58 294.10 0.04
demikernel::sgaalloc 6533.08 128.60 58.26 0.01
demikernel::pop 6052.08 502.42 219.03 0.02
bgc::inetstack::poll;inetstack::poll_bg_work::for::for 4630.58 2141.83 907.55 2.22
ioc::network::libos::pushto 1200.00 1609.51 698.24 0.05
ioc::network::libos::pushto;inetstack::push 1200.00 1026.44 446.79 61.09
demikernel::pushto 1200.00 628.75 272.68 0.02
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 1200.00 307.67 133.38 32.30
bgc::inetstack::poll;inetstack::poll_bg_work::for::for;udp::receive 509.00 275.82 118.98 70.76
bgc::inetstack::poll;inetstack::poll_bg_work::for::for;catnip::runtime::transmit 138.75 718.11 316.56 3.65
ioc::network::libos::close 49.40 5838.28 2591.92 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 34729.93 15583.56 0.00
ioc::network::libos::connect 41.86 31187.67 14134.09 0.04
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6584.21 2966.96 22.67
ioc::network::libos::accept 38.32 3017.92 1335.77 0.00
demikernel::async_close 32.50 596.61 236.11 0.00
demikernel::accept 21.86 1136.60 497.09 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 19040.98 8582.17 19.87
demikernel::connect 20.93 2824.94 1272.98 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 20.93 603.67 264.52 12.04
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 10.67 240.64 140.22 0.01
demikernel::socket 10.30 2443.16 1050.16 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 9.00 2708.00 1202.92 34.78
bgc::inetstack::arp::background 6.43 2350.31 1013.12 0.00
bgc::inetstack::icmp::background 1.05 2835.88 1237.65 0.00
demikernel::new 1.00 1760454431.28 766628125.15 48.79
demikernel::bind 1.00 9681.75 4127.29 0.00
demikernel::listen 1.00 2898.71 1237.80 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = ba668d6

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 13509877.47 1873.65 810.19 33.19
demikernel::sgafree 11535.95 72.53 30.97 0.05
demikernel::sgaalloc 11283.55 124.40 52.98 0.11
ioc::network::libos::push;catnap::linux::transport::push 9066.08 663.38 291.53 4.11
ioc::network::libos::push 8800.47 16703.34 7334.50 6.86
demikernel::push 8800.47 552.02 240.66 0.16
ioc::network::libos::pop;catnap::linux::transport::pop 8022.82 395.45 170.85 4.03
ioc::network::libos::pop 7814.37 18148039.57 7991162.33 24.43
demikernel::pop 7814.37 536.48 229.62 0.13
ioc::network::libos::pushto 603.00 7507.92 3313.85 23.64
demikernel::pushto 603.00 470.87 208.09 1.55
ioc::network::libos::pushto;catnap::linux::transport::push 603.00 459.51 203.06 6.12
demikernel::async_close 32.50 890.28 353.38 0.01
ioc::network::libos::connect 24.95 4143332.66 1766889.31 27.20
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 77852.46 33057.35 2.92
demikernel::connect 24.95 1969.32 841.63 0.01
ioc::network::libos::close 18.35 24105.77 10419.18 0.06
ioc::network::libos::close;catnap::linux::transport::close 18.35 22917.56 9900.95 95.13
demikernel::accept 15.42 1453.93 637.76 0.00
ioc::network::libos::accept 15.39 894321219.66 392031463.66 44.68
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 5723.37 2532.69 0.00
demikernel::socket 9.50 154950.49 67394.97 0.32
demikernel::socket;catnap::linux::transport::socket 9.50 152571.16 66360.95 96.27
demikernel::new 1.00 262447.85 113105.95 0.13
demikernel::bind 1.00 29725.52 13004.04 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 24746.68 10818.77 83.34
demikernel::listen 1.00 15734.05 6847.35 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 14704.13 6399.39 93.60
demikernel::close 0.00 nan nan 0.00

anandbonde
anandbonde approved these changes Nov 26, 2024
View reviewed changes
Copy link
Contributor

@anandbonde anandbonde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@anandbonde anandbonde merged commit bb1c0ae into dev Nov 26, 2024
14 checks passed
@anandbonde anandbonde deleted the enhancement-inetstack-reorg-receiver branch November 26, 2024 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anandbonde anandbonde anandbonde approved these changes

Assignees

@iyzhang iyzhang

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iyzhang @anandbonde