Expose Busy / Queue length Worker Pool Metrics
I would like to be able to systematically monitor our worker pool to get quantitative data on our internal developer experience as our engineers all share the worker pool to run their IaC.
I would like to use those metrics to improve decision making on the number of workers we need for our organizations needs.
- Problem
This request was merged into another request
Comments2
Plum Pen
Apr 7
We would love to see this as well - especially if it was integrated into the datadog integration ya’ll provide.
pending runs and queueed runs - each tagged per workerpool? or something along those lines.
Black Breeze
Mar 4
Hey Loic, thanks for raising this. We have a roadmap item for later this year to look into a more comprehensive overhaul of our observability story. I will flag this accordingly and open up for community voting to gauge overall interest in these metrics once we dive deeper into this particular topic.
In the meantime, I think a good approximation would be tracking the time that runs spend in the READY state, which is something a notification policy can help you with. Not sure what vendor you’re using but our Datadog integration is a good start, even if to understand the logic behind the metric calculations.