hummingbird: hummbwtester as a PoC application - #67
Merged
Merged
Conversation
juagargi
force-pushed
the
hummingbird-bwtester
branch
2 times, most recently
from
July 24, 2026 06:06
a472d57 to
47df401
Compare
juagargi
marked this pull request as ready for review
August 3, 2026 11:24
Add two docker containers, one for Prometheus, one for Grafana. Add a preconfigured dashboard to Grafana.
- Observe only the client, nothing from the server. - The server does not export any Prometheus metric anymore. - Pong responses now contain the number of bytes received at the server side. - Use only the client's clock to derive rates, RTT, etc. - Adapt Grafana board.
Add configurable topology setup, tc bandwidth shaping, and orchestration for Hummingbird and best-effort clients in tester containers. Expose client-only Prometheus metrics and update Grafana monitoring. Use random Hummingbird reservation IDs and add tests and documentation.
Reservation parameters, payload size, pong rate, and renewal fraction are now configurable at the hummbwtester.json file.
Run tc inside the border router namespace, so that it shares buffers with the egress socket. When tc shares buffers, the enqueued packets in tc actually live in the egress socket buffer, creating back pressure (via EAGAIN) on the sending logic. With BatchSize=1, this completely blocks the border router from attempting to enqueue more packets into the socket, which in turn slows down the sending rate.
We want to define small batch sizes for egress, but keep the ingress batch and buffer sizes big enough not to affect performance.
Make explicit the size of the processor queue size. This allows to soften the compute peaks needed by the BR when new packets arrive that cannot be processed currently, without modifying the ingress batch size config parameter.
juagargi
force-pushed
the
hummingbird-bwtester
branch
from
September 1, 2026 07:31
03e5917 to
d843655
Compare
Increase the read buffer of the underlying UDP socket, allowing to store more packets before the kernel drops them due to border router ingress being slow. Using SO_RXQ_OVFL report the number of dropped packets at the Linux socket level (before reaching the border router).
…t deadline. Server sets the native Linux receive buffer to a configurable amount. Client doesn't send all remaining packets trying to catch up with the nominal rate after a lost deadline, to avoid big bursts. Add more metrics to Grafana, in particular the dropped packet count at native Linux receive sockets.
But discard those that are older than the last valid pong response received by the client.
The setup script now finds the JWT from the marketplace client registration website. Experiment configuration supports modes "keys" and "marketplace". Bandwidth units are necessary for marketplace mode. Add tests.
Make sure that the clients in our local topology do not run out of funds when acquiring reservations by bumping the initial balance to 1 billion.
juagargi
force-pushed
the
hummingbird-bwtester
branch
from
September 8, 2026 07:25
2d21272 to
0a804a6
Compare
This encapsulates finding one marketplace fully covering the path, obtaining the forward reservation, optionally the reverse one, and preparing both returning a snetpath.Reservation.
- hummbwtester_client_reservation_renewals_total - hummbwtester_client_market_roundtrip_seconds - hummbwtester_client_pacing_overrun_total - hummbwtester_client_pacing_delay_seconds
Remove dots not coming where the actual measurement happened.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add
hummbwtesteras a PoC application to showcase Hummingbird.Adapt border router with findings from running hummbwtester:
Fixes #69
This change is