Skip to content

load_balancing: add load-aware locality LB policy proto, docs, and config stub#44341

Open
jukie wants to merge 5 commits intoenvoyproxy:mainfrom
jukie:load-aware-lb-policy-api
Open

load_balancing: add load-aware locality LB policy proto, docs, and config stub#44341
jukie wants to merge 5 commits intoenvoyproxy:mainfrom
jukie:load-aware-lb-policy-api

Conversation

@jukie
Copy link
Copy Markdown
Contributor

@jukie jukie commented Apr 9, 2026

Commit Message: load_balancing: add load-aware locality LB policy proto, docs, and config stub
Additional Description: Splitting #43784 as requested and this adds the proto and docs for the new LB policy.

Risk Level: Low
Testing: Config validation unit test
Docs Changes: Added arch overview page for load-aware locality LB policy
Release Notes: added new extension envoy.load_balancing_policies.load_aware_locality
Platform Specific Features: n/a
xRef #43665
API Considerations:

  • New proto LoadAwareLocality with fields for EWMA tuning, variance threshold, probe percentage, weight expiration, and configurable ORCA metric names.
  • endpoint_picking_policy accepts any endpoint-picking child LB policy.

AI was used during implementation but I fully understand the changes.

Signed-off-by: jukie <10012479+jukie@users.noreply.github.com>
@repokitteh-read-only
Copy link
Copy Markdown

As a reminder, PRs marked as draft will not be automatically assigned reviewers,
or be handled by maintainer-oncall triage.

Please mark your PR as ready when you want it to be reviewed!

🐱

Caused by: #44341 was opened by jukie.

see: more, trace.

jukie and others added 4 commits April 8, 2026 21:03
Signed-off-by: jukie <10012479+jukie@users.noreply.github.com>
Signed-off-by: jukie <10012479+jukie@users.noreply.github.com>
Signed-off-by: jukie <10012479+jukie@users.noreply.github.com>
Signed-off-by: jukie <10012479+Jukie@users.noreply.github.com>
@jukie jukie changed the title proto and docs load_balancing: add load-aware locality LB policy proto, docs, and config stub Apr 9, 2026
@jukie jukie marked this pull request as ready for review April 9, 2026 05:45
@repokitteh-read-only
Copy link
Copy Markdown

CC @envoyproxy/api-shepherds: Your approval is needed for changes made to (api/envoy/|docs/root/api-docs/).
envoyproxy/api-shepherds assignee is @markdroth
CC @envoyproxy/api-watchers: FYI only for changes made to (api/envoy/|docs/root/api-docs/).

🐱

Caused by: #44341 was ready_for_review by jukie.

see: more, trace.

@jukie
Copy link
Copy Markdown
Contributor Author

jukie commented Apr 9, 2026

CC @tonya11en

Comment on lines +232 to +238
1. For each locality, compute the average utilization of its endpoints from their
most recent ORCA reports. The metric precedence order is:

a. The max of any metrics listed in ``metric_names_for_computing_utilization``
that are present in the report (e.g. ``named_metrics.foo``), if configured.
b. ``application_utilization`` if reported and > 0.
c. ``cpu_utilization``.
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will update this to align with #44196 once that PR is merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants