mirror of
https://github.com/coreos/prometheus-operator.git
synced 2026-02-05 06:45:27 +01:00
docs: Document the operators ability to publish kubernetes events for rejected resources (#7471)
* docs: Document the operators ability to publish kubernetes events for rejected resources Fixes #6219
This commit is contained in:
committed by
GitHub
parent
130fa01637
commit
fdd1797bb7
@@ -90,6 +90,27 @@ kubectl -n monitoring port-forward svc/prometheus-operated 9090:9090
|
||||
|
||||
If the command runs successfully, you should be able to access the [Prometheus server UI](http://localhost:9090/) via localhost. From there you can check the live configuration and the discovered targets.
|
||||
|
||||
#### Debugging why monitoring resource spec changes are not reconciled
|
||||
|
||||
The Prometheus Operator will reject invalid resources and not reconcile them in the Prometheus configuration. When it happens the Operator emits a Kubernetes Event detailing the issue.
|
||||
|
||||
Events are supported for the following resources:
|
||||
* `AlertmanagerConfig`
|
||||
* `PrometheusRule`
|
||||
* `ServiceMonitor`
|
||||
* `PodMonitor`
|
||||
* `Probe`
|
||||
* `ScrapeConfig`
|
||||
|
||||
To check for events related to rejected resources, you can use the following command:
|
||||
|
||||
```sh
|
||||
kubectl get events --field-selector=involvedObject.name="<name of PodMonitor resource>" -n "<namespace where resource is deployed>"
|
||||
```
|
||||
|
||||
If you've deployed the Prometheus Operator using kube-prometheus manifests, the `PrometheusOperatorRejectedResources` alert should fire when invalid objects are detected.
|
||||
The alert can be found in the [kube-prometheus-stack repository](https://github.com/prometheus-community/helm-charts/blob/db5b859d111c2c81534c5b716aff417f13b51d2b/charts/kube-prometheus-stack/templates/prometheus/rules-1.14/prometheus-operator.yaml#L226)
|
||||
|
||||
#### It is in the configuration but not on the Service Discovery page
|
||||
|
||||
ServiceMonitors pointing to Services that do not exist (e.g. nothing matching `.spec.selector`) will lead to this ServiceMonitor not being added to the Service Discovery page. Check if you can find any Service with the selector you configured.
|
||||
|
||||
Reference in New Issue
Block a user