diff --git a/blog/posts/2025-12-16-introducing-info-function.md b/blog/posts/2025-12-16-introducing-info-function.md new file mode 100644 index 00000000..3002ae8d --- /dev/null +++ b/blog/posts/2025-12-16-introducing-info-function.md @@ -0,0 +1,310 @@ +--- +title: Introducing the Experimental info() Function +created_at: 2025-12-16 +kind: article +author_name: Arve Knudsen +--- + +Enriching metrics with metadata labels can be surprisingly tricky in Prometheus, even if you're a PromQL wiz! +The PromQL join query traditionally used for this is inherently quite complex because it has to specify the labels to join on, the info metric to join with, and the labels to enrich with. +The new, still experimental `info()` function, promises a simpler way, making label enrichment as simple as wrapping your query in a single function call. + +In Prometheus 3.0, we introduced the [`info()`](https://prometheus.io/docs/prometheus/latest/querying/functions/#info) function, a powerful new way to enrich your time series with labels from info metrics. +What's special about `info()` versus the traditional join query technique is that it relieves you from having to specify _identifying labels_, which info metric(s) to join with, and the ("data" or "non-identifying") labels to enrich with. +Note that "identifying labels" in this particular context refers to the set of labels that identify the info metrics in question, and are shared with associated non-info metrics. +They are the labels you would join on in a Prometheus [join query](https://grafana.com/blog/2021/08/04/how-to-use-promql-joins-for-more-effective-queries-of-prometheus-metrics-at-scale). +Conceptually, they can be compared to [foreign keys](https://en.wikipedia.org/wiki/Foreign_key) in relational databases. + +Beyond the main functionality, `info()` also solves a subtle yet critical problem that has plagued join queries for years: The "churn problem" that causes queries to fail when non-identifying info metric labels change, combined with missing staleness marking (as is the case with OTLP ingestion). + +Whether you're working with OpenTelemetry resource attributes, Kubernetes labels, or any other metadata, the `info()` function makes your PromQL queries cleaner, more reliable, and easier to understand. + + + +## The Problem: Complex Joins and The Churn Problem + +Let us start by looking at what we have had to do until now. +Imagine you're monitoring HTTP request durations via OpenTelemetry and want to break them down by Kubernetes cluster. +You push your metrics to Prometheus' OTLP endpoint. +Your metrics have `job` and `instance` labels, but the cluster name lives in a separate `target_info` metric, as the `k8s_cluster_name` label. +Here's what the traditional approach looks like: + +```promql +sum by (http_status_code, k8s_cluster_name) ( + rate(http_server_request_duration_seconds_count[2m]) + * on (job, instance) group_left (k8s_cluster_name) + target_info +) +``` + +While this works, there are several issues: + +**1. Complexity:** You need to know: +- Which info metric contains your labels (`target_info`) +- Which labels are the "identifying" labels to join on (`job`, `instance`) +- Which data labels you want to add (`k8s_cluster_name`) +- The proper PromQL join syntax (`on`, `group_left`) + +This requires expert-level PromQL knowledge and makes queries harder to read and maintain. + +**2. The Churn Problem (The Critical Issue):** + +Here's the subtle but serious problem: What happens when an OTel resource attribute changes in a Kubernetes container, while the identifying resource attributes stay the same? +An example could be the resource attribute `k8s.pod.labels.app.kubernetes.io/version`. +Then the corresponding `target_info` label `k8s_pod_labels_app_kubernetes_io_version` changes, and Prometheus sees a completely new `target_info` time series. + +As the OTLP endpoint doesn't mark the old `target_info` series as stale, both the old and new series can exist simultaneously for up to 5 minutes (the default lookback delta). +During this overlap period, your join query finds **two distinct matching `target_info` time series** and fails with a "many-to-many matching" error. + +This could in practice mean your dashboards break and your alerts stop firing when infrastructure changes are happening, perhaps precisely when you would need visibility the most. + +### The Info Function Presents a Solution + +The previous join query can be converted to use the `info` function as follows: + +```promql +sum by (http_status_code, k8s_cluster_name) ( + info(rate(http_server_request_duration_seconds_count[2m])) +) +``` + +Much more comprehensible, isn't it? +As regards solving the churn problem, the real magic happens under the hood: **`info()` automatically selects the time series with the latest sample**, eliminating churn-related join failures entirely. +Note that this call to `info()` returns all data labels from `target_info`, but it doesn't matter because we aggregate them away with `sum`. + +## Basic Syntax + +```promql +info(v instant-vector, [data-label-selector instant-vector]) +``` + +- **`v`**: The instant vector to enrich with metadata labels +- **`data-label-selector`** (optional): Label matchers in curly braces to filter which labels to include + +In its most basic form, omitting the second parameter, `info()` adds **all** data labels from `target_info`: + +```promql +info(rate(http_server_request_duration_seconds_count[2m])) +``` + +Through the second parameter on the other hand, you can control which data labels to include from `target_info`: + +```promql +info( + rate(http_server_request_duration_seconds_count[2m]), + {k8s_cluster_name=~".+"} +) +``` + +In the example above, `info()` includes the `k8s_cluster_name` data label from `target_info`. +Because the selector matches any non-empty string, it will include any `k8s_cluster_name` label value. + +It's also possible to filter which `k8s_cluster_name` label values to include: + +```promql +info( + rate(http_server_request_duration_seconds_count[2m]), + {k8s_cluster_name="us-east-0"} +) +``` + +## Selecting Different Info Metrics + +By default, `info()` uses the `target_info` metric. +However, you can select different info metrics (like `build_info` or `node_uname_info`) by including a `__name__` matcher in the data-label-selector: + +```promql +# Use build_info instead of target_info +info(up, {__name__="build_info"}) + +# Use multiple info metrics (combines labels from both) +info(up, {__name__=~"(target|build)_info"}) + +# Select build_info and only include the version label +info(up, {__name__="build_info", version=~".+"}) +``` + +**Note:** The current implementation always uses `job` and `instance` as the identifying labels for joining, regardless of which info metric you select. +This works well for most standard info metrics but may have limitations with custom info metrics that use different identifying labels. +An example of an info metric that has different identifying labels than `job` and `instance` is `kube_pod_labels`, its identifying labels are instead: `namespace` and `pod`. +The intention is that `info()` in the future knows which metrics in the TSDB are info metrics and automatically uses all of them, unless the selection is explicitly restricted by a name matcher like the above, and which are the identifying labels for each info metric. + +## Real-World Use Cases + +### OpenTelemetry Integration + +The primary driver for the `info()` function is [OpenTelemetry](https://prometheus.io/blog/2024/03/14/commitment-to-opentelemetry/) (OTel) integration. +When using Prometheus as an OTel backend, resource attributes (metadata about the metrics producer) are automatically converted to the `target_info` metric: + +- `service.instance.id` → `instance` label +- `service.name` → `job` label +- `service.namespace` → prefixed to `job` (i.e., `/`) +- All other resource attributes → data labels on `target_info` + +This means that, so long as at least either the `service.instance.id` or the `service.name` resource attribute is included, every OTel metric you send to Prometheus over OTLP can be enriched with resource attributes using `info()`: + +```promql +# Add all OTel resource attributes +info(rate(http_server_request_duration_seconds_sum[5m])) + +# Add only specific attributes +info( + rate(http_server_request_duration_seconds_sum[5m]), + {k8s_cluster_name=~".+", k8s_namespace_name=~".+", k8s_pod_name=~".+"} +) +``` + +### Build Information + +Enrich your metrics with build-time information: + +```promql +# Add version and branch information to request rates +sum by (job, http_status_code, version, branch) ( + info( + rate(http_server_request_duration_seconds_count[2m]), + {__name__="build_info"} + ) +) +``` + +### Filter on Producer Version + +Pick only metrics from certain producer versions: + +```promql +sum by (job, http_status_code, version) ( + info( + rate(http_server_request_duration_seconds_count[2m]), + {__name__="build_info", version=~"2\\..+"} + ) +) +``` + +## Before and After: Side-by-Side Comparison + +Let's see how the `info()` function simplifies real queries: + +### Example 1: OpenTelemetry Resource Attribute Enrichment + +**Traditional approach:** +```promql +sum by (http_status_code, k8s_cluster_name, k8s_namespace_name, k8s_container_name) ( + rate(http_server_request_duration_seconds_count[2m]) + * on (job, instance) group_left (k8s_cluster_name, k8s_namespace_name, k8s_container_name) + target_info +) +``` + +**With info():** +```promql +sum by (http_status_code, k8s_cluster_name, k8s_namespace_name, k8s_container_name) ( + info(rate(http_server_request_duration_seconds_count[2m])) +) +``` + +The intent is much clearer with `info`: We're enriching `http_server_request_duration_seconds_count` with Kubernetes related OpenTelemetry resource attributes. + +### Example 2: Filtering by Label Value + +**Traditional approach:** +```promql +sum by (http_status_code, k8s_cluster_name) ( + rate(http_server_request_duration_seconds_count[2m]) + * on (job, instance) group_left (k8s_cluster_name) + target_info{k8s_cluster_name=~"us-.*"} +) +``` + +**With info():** +```promql +sum by (http_status_code, k8s_cluster_name) ( + info( + rate(http_server_request_duration_seconds_count[2m]), + {k8s_cluster_name=~"us-.*"} + ) +) +``` + +Here we filter to only include metrics from clusters in the US (which names start with `us-`). The `info()` version integrates the filter naturally into the data-label-selector. + +## Technical Benefits + +Beyond the fundamental UX benefits, the `info()` function provides several technical advantages: + +### 1. Automatic Churn Handling + +As previously mentioned, `info()` automatically picks the matching info time series with the latest sample when multiple versions exist. +This eliminates the "many-to-many matching" errors that plague traditional join queries during churn. + +**How it works:** When non-identifying info metric labels change (e.g., a pod is re-created), there's a brief period where both old and new series might exist. +The `info()` function simply selects whichever has the most recent sample, ensuring your queries keep working. + +### 2. Better Performance + +The `info()` function is more efficient than traditional joins: +- Only selects matching info series +- Avoids unnecessary label matching operations +- Optimized query execution path + +## Getting Started + +The `info()` function is experimental and must be enabled via a feature flag: + +```bash +prometheus --enable-feature=promql-experimental-functions +``` + +Once enabled, you can start using it immediately. + +## Current Limitations and Future Plans + +The current implementation is an **MVP (Minimum Viable Product)** designed to validate the approach and gather user feedback. +The implementation has some intentional limitations: + +### Current Constraints + +1. **Default info metric:** Only considers `target_info` by default + - Workaround: You can use `__name__` matchers like `{__name__=~"(target|build)_info"}` in the data-label-selector, though this still assumes `job` and `instance` as identifying labels + +2. **Fixed identifying labels:** Always assumes `job` and `instance` are the identifying labels for joining + - This unfortunately makes `info()` unsuitable for certain scenarios, e.g. including data labels from `kube_pod_labels`, but it's a problem we want to solve in the future + +### Future Development + +These limitations are meant to be temporary. +The experimental status allows us to: +- Gather real-world usage feedback +- Understand which use cases matter the most +- Iterate on the design before committing to a final API + +A future version of the `info()` function should: +- Consider all info metrics by default (not just `target_info`) +- Automatically understand identifying labels based on info metric metadata + +**Important:** Because this is an experimental feature, the behavior may change in future Prometheus versions, or the function could potentially be removed from PromQL entirely based on user feedback. + +## Giving Feedback + +Your feedback will directly shape the future of this feature and help us determine whether it should become a permanent part of PromQL. +Feedback may be provided e.g. through our [community connections](https://prometheus.io/community/#community-connections) or by opening a [Prometheus issue](https://github.com/prometheus/prometheus/issues). + +We encourage you to try the `info()` function and share your feedback: +- What use cases does it solve for you? +- What additional functionality would you like to see? +- How could the API be improved? +- Do you see improved performance? + +## Conclusion + +The experimental `info()` function represents a significant step forward in making PromQL more accessible and reliable. +By simplifying metadata label enrichment and automatically handling the churn problem, it removes two major pain points for Prometheus users, especially those adopting OpenTelemetry. + +To learn more: +- [PromQL functions documentation](https://prometheus.io/docs/prometheus/latest/querying/functions/#info) +- [OpenTelemetry guide (includes detailed info() usage)](https://prometheus.io/docs/guides/opentelemetry/) +- [Feature proposal](https://github.com/prometheus/proposals/blob/main/proposals/0037-native-support-for-info-metrics-metadata.md) + +Please feel welcome to share your thoughts with the Prometheus community on [GitHub Discussions](https://github.com/prometheus/prometheus/discussions) or get in touch with us on the [CNCF Slack #prometheus channel](https://cloud-native.slack.com/). + +Happy querying! diff --git a/docs/guides/cadvisor.md b/docs/guides/cadvisor.md index a4845fb2..f786d5d2 100644 --- a/docs/guides/cadvisor.md +++ b/docs/guides/cadvisor.md @@ -26,6 +26,7 @@ Now we'll need to create a Docker Compose [configuration](https://docs.docker.co In the same folder where you created the [`prometheus.yml`](#prometheus-configuration) file, create a `docker-compose.yml` file and populate it with this Docker Compose configuration: +### Using Bind Mounts ```yaml version: '3.2' services: @@ -92,6 +93,71 @@ cadvisor /usr/bin/cadvisor -logtostderr Up 8080/tcp prometheus /bin/prometheus --config.f ... Up 0.0.0.0:9090->9090/tcp redis docker-entrypoint.sh redis ... Up 0.0.0.0:6379->6379/tcp ``` +### Alternative: Using Inline Docker Configs (Remote Deployments) + +If you're managing a remote Docker host and prefer to keep all configuration within the docker-compose.yml file (avoiding the need to manage separate config files on the host), you can use Docker's configs feature: + +```yaml +version: '3.8' + +configs: + prometheus_config: + content: | + scrape_configs: + - job_name: 'cadvisor' + scrape_interval: 5s + static_configs: + - targets: ['cadvisor:8080'] + +services: + prometheus: + image: prom/prometheus:latest + container_name: prometheus + ports: + - 9090:9090 + command: + - --config.file=/etc/prometheus/prometheus.yml + configs: + - source: prometheus_config + target: /etc/prometheus/prometheus.yml + uid: "65534" # Required: numeric UID for 'nobody' user + gid: "65534" # Required: numeric GID for 'nobody' group + mode: 0400 # Required: read-only permissions + depends_on: + - cadvisor + + cadvisor: + image: gcr.io/cadvisor/cadvisor:latest + container_name: cadvisor + ports: + - 8080:8080 + volumes: + - /:/rootfs:ro + - /var/run:/var/run:rw + - /sys:/sys:ro + - /var/lib/docker/:/var/lib/docker:ro + depends_on: + - redis + + redis: + image: redis:latest + container_name: redis + ports: + - 6379:6379 +``` + +#### Important Notes + +⚠️ **Required Fields**: When using Docker `configs`, you **must** explicitly specify `uid`, `gid`, and `mode` as numeric values: + +- `uid: "65534"` - The numeric user ID (65534 = `nobody` user in the Prometheus image) +- `gid: "65534"` - The numeric group ID (65534 = `nobody` group) +- `mode: 0400` - File permissions (read-only for owner) + +Omitting these fields or using string values like `"nobody"` will cause the following error: +``` +strconv.Atoi: parsing "nobody": invalid syntax +``` ## Exploring the cAdvisor web UI diff --git a/docs/guides/node-exporter.md b/docs/guides/node-exporter.md index 8813e494..7eded30c 100644 --- a/docs/guides/node-exporter.md +++ b/docs/guides/node-exporter.md @@ -17,10 +17,20 @@ The Prometheus Node Exporter is a single static binary that you can install [via ```bash # NOTE: Replace the URL with one from the above mentioned "downloads" page. -# , , and are placeholders. -wget https://github.com/prometheus/node_exporter/releases/download/v/node_exporter-.-.tar.gz -tar xvfz node_exporter-*.*-amd64.tar.gz -cd node_exporter-*.*-amd64 +# Node Exporter is available for multiple OS targets and architectures. +# Downloads are available at: +# https://github.com/prometheus/node_exporter/releases/download/v/node_exporter-.-.tar.gz +# +# , , and are placeholders: +# - : Release version (e.g., 1.10.2) +# - : Operating system (e.g., linux, darwin, freebsd) +# - : Architecture (e.g., amd64, arm64, 386) +# +# For this example, we will use Node Exporter version 1.10.2 for a Linux system with amd64 architecture. + +wget https://github.com/prometheus/node_exporter/releases/download/v1.10.2/node_exporter-1.10.2.linux-amd64.tar.gz +tar xvfz node_exporter-1.10.2.linux-amd64.tar.gz +cd node_exporter-1.10.2.linux-amd64 ./node_exporter ``` diff --git a/docs/instrumenting/clientlibs.md b/docs/instrumenting/clientlibs.md index 984aa284..f9c1c268 100644 --- a/docs/instrumenting/clientlibs.md +++ b/docs/instrumenting/clientlibs.md @@ -37,6 +37,7 @@ Unofficial third-party client libraries: * [Perl](https://metacpan.org/pod/Net::Prometheus) * [PHP](https://github.com/promphp/prometheus_client_php) * [R](https://github.com/cfmack/pRometheus) +* [Swift](https://github.com/swift-server/swift-prometheus) When Prometheus scrapes your instance's HTTP endpoint, the client library sends the current state of all tracked metrics to the server. diff --git a/docs/instrumenting/exporters.md b/docs/instrumenting/exporters.md index 4371e946..b73cbb2e 100644 --- a/docs/instrumenting/exporters.md +++ b/docs/instrumenting/exporters.md @@ -80,6 +80,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Node/system metrics exporter](https://github.com/prometheus/node_exporter) (**official**) * [NVIDIA DCGM (GPU) exporter](https://github.com/NVIDIA/dcgm-exporter) * [ProSAFE exporter](https://github.com/dalance/prosafe_exporter) + * [Redfish exporter](https://github.com/comcast/fishymetrics) * [SmartRAID exporter](https://gitlab.com/calestyo/prometheus-smartraid-exporter) * [Waveplus Radon Sensor Exporter](https://github.com/jeremybz/waveplus_exporter) * [Weathergoose Climate Monitor Exporter](https://github.com/branttaylor/watchdog-prometheus-exporter) @@ -123,6 +124,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Pure Storage exporter](https://github.com/PureStorage-OpenConnect/pure-exporter) * [ScaleIO exporter](https://github.com/syepes/sio2prom) * [Tivoli Storage Manager/IBM Spectrum Protect exporter](https://github.com/treydock/tsm_exporter) + * [IBM Storage Scale metrics exporter](https://github.com/IBM/ibm-spectrum-scale-bridge-for-grafana) ### HTTP * [Apache exporter](https://github.com/Lusitaniae/apache_exporter) @@ -152,6 +154,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Gmail exporter](https://github.com/jamesread/prometheus-gmail-exporter/) * [GraphQL exporter](https://github.com/ricardbejarano/graphql_exporter) * [InstaClustr exporter](https://github.com/fcgravalos/instaclustr_exporter) + * [IO River exporter](https://github.com/ioriver/ioriver-exporter) * [Mozilla Observatory exporter](https://github.com/Jimdo/observatory-exporter) * [OpenWeatherMap exporter](https://github.com/RichiH/openweathermap_exporter) * [Pagespeed exporter](https://github.com/foomo/pagespeed_exporter) @@ -174,6 +177,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Alibaba Cloudmonitor exporter](https://github.com/aylei/aliyun-exporter) * [AWS CloudWatch exporter](https://github.com/prometheus/cloudwatch_exporter) (**official**) * [Azure Monitor exporter](https://github.com/RobustPerception/azure_metrics_exporter) + * [CCF HuaTuo exporter](https://github.com/ccfos/huatuo) * [Cloud Foundry Firehose exporter](https://github.com/cloudfoundry-community/firehose_exporter) * [Collectd exporter](https://github.com/prometheus/collectd_exporter) (**official**) * [Google Stackdriver exporter](https://github.com/frodenas/stackdriver_exporter) @@ -251,7 +255,6 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [oVirt exporter](https://github.com/czerwonk/ovirt_exporter) * [Pact Broker exporter](https://github.com/ContainerSolutions/pactbroker_exporter) * [PHP-FPM exporter](https://github.com/bakins/php-fpm-exporter) - * [PowerDNS exporter](https://github.com/ledgr/powerdns_exporter) * [Podman exporter](https://github.com/containers/prometheus-podman-exporter) * [Prefect2 exporter](https://github.com/pathfinder177/prefect2-prometheus-exporter) * [Process exporter](https://github.com/ncabatoff/process-exporter) @@ -259,6 +262,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Rundeck exporter](https://github.com/phsmith/rundeck_exporter) * [SABnzbd exporter](https://github.com/msroest/sabnzbd_exporter) * [SAML exporter](https://github.com/DoodleScheduling/saml-exporter) + * [Scraparr](https://github.com/thecfu/scraparr) * [Script exporter](https://github.com/adhocteam/script_exporter) * [Shield exporter](https://github.com/cloudfoundry-community/shield_exporter) * [Smokeping prober](https://github.com/SuperQ/smokeping_prober) @@ -270,6 +274,7 @@ wide variety of JVM-based applications, for example [Kafka](http://kafka.apache. * [Unbound exporter](https://github.com/kumina/unbound_exporter) * [WireGuard exporter](https://github.com/MindFlavor/prometheus_wireguard_exporter) * [Xen exporter](https://github.com/lovoo/xenstats_exporter) + * [ZLMediaKit exporter](https://github.com/guohuachan/ZLMediaKit_exporter) When implementing a new Prometheus exporter, please follow the diff --git a/docs/instrumenting/exposition_formats.md b/docs/instrumenting/exposition_formats.md index 4084e574..39e7f09c 100644 --- a/docs/instrumenting/exposition_formats.md +++ b/docs/instrumenting/exposition_formats.md @@ -54,24 +54,41 @@ line may exist for any given metric name. If the token is `TYPE`, exactly two more tokens are expected. The first is the metric name, and the second is either `counter`, `gauge`, `histogram`, -`summary`, or `untyped`, defining the type for the metric of that name. Only -one `TYPE` line may exist for a given metric name. The `TYPE` line for a -metric name must appear before the first sample is reported for that metric -name. If there is no `TYPE` line for a metric name, the type is set to -`untyped`. +`summary`, or `untyped`, defining the type for the metric of that name. Only one +`TYPE` line may exist for a given metric name. The `TYPE` line for a metric name +must appear before the first sample is reported for that metric name. If there +is no `TYPE` line for a metric name, the type is set to `untyped`. Metric names +not corresponding to the legacy Prometheus metric name character set must be +quoted and escaped. The remaining lines describe samples (one per line) using the following syntax ([EBNF](https://en.wikipedia.org/wiki/Extended_Backus%E2%80%93Naur_form)): ``` -metric_name [ - "{" label_name "=" `"` label_value `"` { "," label_name "=" `"` label_value `"` } [ "," ] "}" -] value [ timestamp ] +metric_name_or_labels value [ timestamp ] + +metric_name_or_labels = metric_name [ "{" labels "}" ] | "{" quoted_metric_name [ "," labels ] "}" + +metric_name = identifier + +quoted_metric_name = `"` escaped_string `"` + +labels = [ label_pairs ] + +label_pairs = label_pair { "," label_pair } [ "," ] + +label_pair = label_name "=" `"` escaped_string `"` + +label_name = identifier | `"` escaped_string `"` ``` In the sample syntax: -* `metric_name` and `label_name` carry the usual Prometheus expression language restrictions. +* `identifier` carries the usual Prometheus expression language restrictions. +* `escaped_string` consists of any UTF-8 characters, but backslash, double-quote, and line feed must be escaped. +* When `metric_name` is quoted with double quotes, it appears inside the braces instead of outside. +* `label_name` may be optionally enclosed in double quotes. +* Metric and label names not corresponding to the usual Prometheus expression language restrictions must use the quoted syntaxes. * `label_value` can be any sequence of UTF-8 characters, but the backslash (`\`), double-quote (`"`), and line feed (`\n`) characters have to be escaped as `\\`, `\"`, and `\n`, respectively. * `value` is a float represented as required by Go's [`ParseFloat()`](https://golang.org/pkg/strconv/#ParseFloat) function. In addition to standard numerical values, `NaN`, `+Inf`, and `-Inf` are valid values representing not a number, positive infinity, and negative infinity, respectively. * The `timestamp` is an `int64` (milliseconds since epoch, i.e. 1970-01-01 00:00:00 UTC, excluding leap seconds), represented as required by Go's [`ParseInt()`](https://golang.org/pkg/strconv/#ParseInt) function. @@ -113,6 +130,9 @@ http_requests_total{method="post",code="400"} 3 1395066363000 # Escaping in label values: msdos_file_access_time_seconds{path="C:\\DIR\\FILE.TXT",error="Cannot find file:\n\"FILE.TXT\""} 1.458255915e9 +# UTF-8 metric and label names: +{"my.dotted.metric", "error.message"="Not Found"} + # Minimalistic line: metric_without_timestamp_and_labels 12.47 diff --git a/docs/introduction/glossary.md b/docs/introduction/glossary.md index 279ff509..10976afc 100644 --- a/docs/introduction/glossary.md +++ b/docs/introduction/glossary.md @@ -51,6 +51,10 @@ An instance is a label that uniquely identifies a target in a job. A collection of targets with the same purpose, for example monitoring a group of like processes replicated for scalability or reliability, is called a job. +### Mixin + +A mixin is a reusable and extensible set of Prometheus alerts, recording rules, and Grafana dashboards for a specific component or system. Mixins are typically packaged using [Jsonnet](https://jsonnet.org/) and can be combined to create comprehensive monitoring configurations. They enable standardized monitoring across similar infrastructure components. + ### Notification A notification represents a group of one or more alerts, and is sent by the Alertmanager to email, Pagerduty, Slack etc. diff --git a/docs/operating/integrations.md b/docs/operating/integrations.md index aa2e0275..762633e0 100644 --- a/docs/operating/integrations.md +++ b/docs/operating/integrations.md @@ -89,7 +89,8 @@ For notification mechanisms not natively supported by the Alertmanager, the * [iLert](https://docs.ilert.com/integrations/prometheus) * [IRC Bot](https://github.com/multimfi/bot) * [JIRAlert](https://github.com/free/jiralert) - * [Matrix](https://github.com/matrix-org/go-neb) + * [Matrix](https://github.com/jaywink/matrix-alertmanager): sends Alertmanager notifications to Matrix rooms + * [Matrix](https://github.com/hectorjsmith/matrix-hookshot): bridges webhooks to Matrix with rich formatting support * [Notion](https://github.com/cthtuf/alertmanager-to-notion): creates/updates record in a Notion database * [Phabricator / Maniphest](https://github.com/knyar/phalerts) * [prom2teams](https://github.com/idealista/prom2teams): forwards notifications to Microsoft Teams diff --git a/docs/practices/consoles.md b/docs/practices/consoles.md index bb5d47a6..5b4f6dbf 100644 --- a/docs/practices/consoles.md +++ b/docs/practices/consoles.md @@ -3,6 +3,8 @@ title: Consoles and dashboards sort_rank: 3 --- +CAUTION: Starting with Prometheus 3.0, console templates and libraries are no longer bundled with Prometheus. If you wish to use console templates, you must provide your own templates and libraries by specifying the `--web.console.templates` and `--web.console.libraries` command-line flags. This documentation page is maintained for historical reference and to demonstrate the capabilities of console templates. Please be aware that any referenced console libraries from the Prometheus 2.x branch are no longer maintained and may contain known security vulnerabilities (CVEs). + It can be tempting to display as much data as possible on a dashboard, especially when a system like Prometheus offers the ability to have such rich instrumentation of your applications. This can lead to consoles that are diff --git a/docs/visualization/consoles.md b/docs/visualization/consoles.md index 5b8e14f6..2e0c2e0e 100644 --- a/docs/visualization/consoles.md +++ b/docs/visualization/consoles.md @@ -3,6 +3,8 @@ title: Console templates sort_rank: 4 --- +CAUTION: Starting with Prometheus 3.0, console templates and libraries are no longer bundled with Prometheus. If you wish to use console templates, you must provide your own templates and libraries by specifying the `--web.console.templates` and `--web.console.libraries` command-line flags. This documentation page is maintained for historical reference and to demonstrate the capabilities of console templates. Please be aware that any referenced console libraries from the Prometheus 2.x branch are no longer maintained and may contain known security vulnerabilities (CVEs). + Console templates allow for creation of arbitrary consoles using the [Go templating language](http://golang.org/pkg/text/template/). These are served from the Prometheus server. @@ -121,7 +123,7 @@ Valid output formats for the third argument to `prom_query_drilldown`: * `printf.3g`: Display 3 significant digits. Custom formats can be defined. See -[prom.lib](https://github.com/prometheus/prometheus/blob/main/console_libraries/prom.lib) for examples. +[prom.lib](https://github.com/prometheus/prometheus/blob/release-2.55/console_libraries/prom.lib) for examples. ## Graph Library diff --git a/package-lock.json b/package-lock.json index 3a298959..fc1cd1c2 100644 --- a/package-lock.json +++ b/package-lock.json @@ -1266,25 +1266,86 @@ } }, "node_modules/@modelcontextprotocol/sdk": { - "version": "1.11.0", - "resolved": "https://registry.npmjs.org/@modelcontextprotocol/sdk/-/sdk-1.11.0.tgz", - "integrity": "sha512-k/1pb70eD638anoi0e8wUGAlbMJXyvdV4p62Ko+EZ7eBe1xMx8Uhak1R5DgfoofsK5IBBnRwsYGTaLZl+6/+RQ==", + "version": "1.24.0", + "resolved": "https://registry.npmjs.org/@modelcontextprotocol/sdk/-/sdk-1.24.0.tgz", + "integrity": "sha512-D8h5KXY2vHFW8zTuxn2vuZGN0HGrQ5No6LkHwlEA9trVgNdPL3TF1dSqKA7Dny6BbBYKSW/rOBDXdC8KJAjUCg==", "dev": true, "license": "MIT", "dependencies": { + "ajv": "^8.17.1", + "ajv-formats": "^3.0.1", "content-type": "^1.0.5", "cors": "^2.8.5", - "cross-spawn": "^7.0.3", + "cross-spawn": "^7.0.5", "eventsource": "^3.0.2", + "eventsource-parser": "^3.0.0", "express": "^5.0.1", "express-rate-limit": "^7.5.0", + "jose": "^6.1.1", "pkce-challenge": "^5.0.0", "raw-body": "^3.0.0", - "zod": "^3.23.8", - "zod-to-json-schema": "^3.24.1" + "zod": "^3.25 || ^4.0", + "zod-to-json-schema": "^3.25.0" }, "engines": { "node": ">=18" + }, + "peerDependencies": { + "@cfworker/json-schema": "^4.1.1", + "zod": "^3.25 || ^4.0" + }, + "peerDependenciesMeta": { + "@cfworker/json-schema": { + "optional": true + }, + "zod": { + "optional": false + } + } + }, + "node_modules/@modelcontextprotocol/sdk/node_modules/ajv": { + "version": "8.17.1", + "resolved": "https://registry.npmjs.org/ajv/-/ajv-8.17.1.tgz", + "integrity": "sha512-B/gBuNg5SiMTrPkC+A2+cW0RszwxYmn6VYxB/inlBStS5nx6xHIt/ehKRhIMhqusl7a8LjQoZnjCs5vhwxOQ1g==", + "dev": true, + "license": "MIT", + "dependencies": { + "fast-deep-equal": "^3.1.3", + "fast-uri": "^3.0.1", + "json-schema-traverse": "^1.0.0", + "require-from-string": "^2.0.2" + }, + "funding": { + "type": "github", + "url": "https://github.com/sponsors/epoberezkin" + } + }, + "node_modules/@modelcontextprotocol/sdk/node_modules/json-schema-traverse": { + "version": "1.0.0", + "resolved": "https://registry.npmjs.org/json-schema-traverse/-/json-schema-traverse-1.0.0.tgz", + "integrity": "sha512-NM8/P9n3XjXhIZn1lLhkFaACTOURQXjWhV4BA/RnOv8xvgqtqpAX9IO4mRQxSx1Rlo4tqzeqb0sOlruaOy3dug==", + "dev": true, + "license": "MIT" + }, + "node_modules/@modelcontextprotocol/sdk/node_modules/zod": { + "version": "4.1.13", + "resolved": "https://registry.npmjs.org/zod/-/zod-4.1.13.tgz", + "integrity": "sha512-AvvthqfqrAhNH9dnfmrfKzX5upOdjUVJYFqNSlkmGf64gRaTzlPwz99IHYnVs28qYAybvAlBV+H7pn0saFY4Ig==", + "dev": true, + "license": "MIT", + "peer": true, + "funding": { + "url": "https://github.com/sponsors/colinhacks" + } + }, + "node_modules/@modelcontextprotocol/sdk/node_modules/zod-to-json-schema": { + "version": "3.25.0", + "resolved": "https://registry.npmjs.org/zod-to-json-schema/-/zod-to-json-schema-3.25.0.tgz", + "integrity": "sha512-HvWtU2UG41LALjajJrML6uQejQhNJx+JBO9IflpSja4R03iNWfKXrj6W2h7ljuLyc1nKS+9yDyL/9tD1U/yBnQ==", + "dev": true, + "license": "ISC", + "peerDependencies": { + "zod": "^3.25 || ^4" } }, "node_modules/@napi-rs/wasm-runtime": { @@ -2708,6 +2769,48 @@ "url": "https://github.com/sponsors/epoberezkin" } }, + "node_modules/ajv-formats": { + "version": "3.0.1", + "resolved": "https://registry.npmjs.org/ajv-formats/-/ajv-formats-3.0.1.tgz", + "integrity": "sha512-8iUql50EUR+uUcdRQ3HDqa6EVyo3docL8g5WJ3FNcWmu62IbkGUue/pEyLBW8VGKKucTPgqeks4fIU1DA4yowQ==", + "dev": true, + "license": "MIT", + "dependencies": { + "ajv": "^8.0.0" + }, + "peerDependencies": { + "ajv": "^8.0.0" + }, + "peerDependenciesMeta": { + "ajv": { + "optional": true + } + } + }, + "node_modules/ajv-formats/node_modules/ajv": { + "version": "8.17.1", + "resolved": "https://registry.npmjs.org/ajv/-/ajv-8.17.1.tgz", + "integrity": "sha512-B/gBuNg5SiMTrPkC+A2+cW0RszwxYmn6VYxB/inlBStS5nx6xHIt/ehKRhIMhqusl7a8LjQoZnjCs5vhwxOQ1g==", + "dev": true, + "license": "MIT", + "dependencies": { + "fast-deep-equal": "^3.1.3", + "fast-uri": "^3.0.1", + "json-schema-traverse": "^1.0.0", + "require-from-string": "^2.0.2" + }, + "funding": { + "type": "github", + "url": "https://github.com/sponsors/epoberezkin" + } + }, + "node_modules/ajv-formats/node_modules/json-schema-traverse": { + "version": "1.0.0", + "resolved": "https://registry.npmjs.org/json-schema-traverse/-/json-schema-traverse-1.0.0.tgz", + "integrity": "sha512-NM8/P9n3XjXhIZn1lLhkFaACTOURQXjWhV4BA/RnOv8xvgqtqpAX9IO4mRQxSx1Rlo4tqzeqb0sOlruaOy3dug==", + "dev": true, + "license": "MIT" + }, "node_modules/ansi-styles": { "version": "4.3.0", "resolved": "https://registry.npmjs.org/ansi-styles/-/ansi-styles-4.3.0.tgz", @@ -2986,24 +3089,28 @@ "license": "Apache-2.0" }, "node_modules/body-parser": { - "version": "2.2.0", - "resolved": "https://registry.npmjs.org/body-parser/-/body-parser-2.2.0.tgz", - "integrity": "sha512-02qvAaxv8tp7fBa/mw1ga98OGm+eCbqzJOKoRt70sLmfEEi+jyBYVTDGfCL/k06/4EMk/z01gCe7HoCH/f2LTg==", + "version": "2.2.1", + "resolved": "https://registry.npmjs.org/body-parser/-/body-parser-2.2.1.tgz", + "integrity": "sha512-nfDwkulwiZYQIGwxdy0RUmowMhKcFVcYXUU7m4QlKYim1rUtg83xm2yjZ40QjDuc291AJjjeSc9b++AWHSgSHw==", "dev": true, "license": "MIT", "dependencies": { "bytes": "^3.1.2", "content-type": "^1.0.5", - "debug": "^4.4.0", + "debug": "^4.4.3", "http-errors": "^2.0.0", - "iconv-lite": "^0.6.3", + "iconv-lite": "^0.7.0", "on-finished": "^2.4.1", "qs": "^6.14.0", - "raw-body": "^3.0.0", - "type-is": "^2.0.0" + "raw-body": "^3.0.1", + "type-is": "^2.0.1" }, "engines": { "node": ">=18" + }, + "funding": { + "type": "opencollective", + "url": "https://opencollective.com/express" } }, "node_modules/boolbase": { @@ -3461,9 +3568,9 @@ "license": "MIT" }, "node_modules/debug": { - "version": "4.4.0", - "resolved": "https://registry.npmjs.org/debug/-/debug-4.4.0.tgz", - "integrity": "sha512-6WTZ/IxCY/T6BALoZHaE4ctp9xm+Z5kY/pzYaCHRFeyVhojxlrm+46y68HA6hr0TcwEssoxNiDEUJQjfPZ/RYA==", + "version": "4.4.3", + "resolved": "https://registry.npmjs.org/debug/-/debug-4.4.3.tgz", + "integrity": "sha512-RGwwWnwQvkVfavKVt22FGLw+xYSdzARwm0ru6DhTVA3umU5hZc28V3kO4stgYryrTlLpuvgI9GiijltAjNbcqA==", "license": "MIT", "dependencies": { "ms": "^2.1.3" @@ -4393,20 +4500,21 @@ } }, "node_modules/express": { - "version": "5.1.0", - "resolved": "https://registry.npmjs.org/express/-/express-5.1.0.tgz", - "integrity": "sha512-DT9ck5YIRU+8GYzzU5kT3eHGA5iL+1Zd0EutOmTE9Dtk+Tvuzd23VBU+ec7HPNSTxXYO55gPV/hq4pSBJDjFpA==", + "version": "5.2.1", + "resolved": "https://registry.npmjs.org/express/-/express-5.2.1.tgz", + "integrity": "sha512-hIS4idWWai69NezIdRt2xFVofaF4j+6INOpJlVOLDO8zXGpUVEVzIYk12UUi2JzjEzWL3IOAxcTubgz9Po0yXw==", "dev": true, "license": "MIT", "peer": true, "dependencies": { "accepts": "^2.0.0", - "body-parser": "^2.2.0", + "body-parser": "^2.2.1", "content-disposition": "^1.0.0", "content-type": "^1.0.5", "cookie": "^0.7.1", "cookie-signature": "^1.2.1", "debug": "^4.4.0", + "depd": "^2.0.0", "encodeurl": "^2.0.0", "escape-html": "^1.0.3", "etag": "^1.8.1", @@ -4537,6 +4645,23 @@ "dev": true, "license": "MIT" }, + "node_modules/fast-uri": { + "version": "3.1.0", + "resolved": "https://registry.npmjs.org/fast-uri/-/fast-uri-3.1.0.tgz", + "integrity": "sha512-iPeeDKJSWf4IEOasVVrknXpaBV0IApz/gp7S2bb7Z4Lljbl2MGJRqInZiUrQwV16cpzw/D3S5j5Julj/gT52AA==", + "dev": true, + "funding": [ + { + "type": "github", + "url": "https://github.com/sponsors/fastify" + }, + { + "type": "opencollective", + "url": "https://opencollective.com/fastify" + } + ], + "license": "BSD-3-Clause" + }, "node_modules/fastq": { "version": "1.19.1", "resolved": "https://registry.npmjs.org/fastq/-/fastq-1.19.1.tgz", @@ -5344,26 +5469,30 @@ } }, "node_modules/http-errors": { - "version": "2.0.0", - "resolved": "https://registry.npmjs.org/http-errors/-/http-errors-2.0.0.tgz", - "integrity": "sha512-FtwrG/euBzaEjYeRqOgly7G0qviiXoJWnvEH2Z1plBdXgbyjv34pHTSb9zoeHMyDy33+DWy5Wt9Wo+TURtOYSQ==", + "version": "2.0.1", + "resolved": "https://registry.npmjs.org/http-errors/-/http-errors-2.0.1.tgz", + "integrity": "sha512-4FbRdAX+bSdmo4AUFuS0WNiPz8NgFt+r8ThgNWmlrjQjt1Q7ZR9+zTlce2859x4KSXrwIsaeTqDoKQmtP8pLmQ==", "dev": true, "license": "MIT", "dependencies": { - "depd": "2.0.0", - "inherits": "2.0.4", - "setprototypeof": "1.2.0", - "statuses": "2.0.1", - "toidentifier": "1.0.1" + "depd": "~2.0.0", + "inherits": "~2.0.4", + "setprototypeof": "~1.2.0", + "statuses": "~2.0.2", + "toidentifier": "~1.0.1" }, "engines": { "node": ">= 0.8" + }, + "funding": { + "type": "opencollective", + "url": "https://opencollective.com/express" } }, "node_modules/iconv-lite": { - "version": "0.6.3", - "resolved": "https://registry.npmjs.org/iconv-lite/-/iconv-lite-0.6.3.tgz", - "integrity": "sha512-4fCk79wshMdzMp2rH06qWrJE4iolqLhCUH+OiuIgU++RB0+94NlDL81atO7GX55uUKueo0txHNtvEyI6D7WdMw==", + "version": "0.7.0", + "resolved": "https://registry.npmjs.org/iconv-lite/-/iconv-lite-0.7.0.tgz", + "integrity": "sha512-cf6L2Ds3h57VVmkZe+Pn+5APsT7FpqJtEhhieDCvrE2MK5Qk9MyffgQyuxQTm6BChfeZNtcOLHp9IcWRVcIcBQ==", "dev": true, "license": "MIT", "dependencies": { @@ -5371,6 +5500,10 @@ }, "engines": { "node": ">=0.10.0" + }, + "funding": { + "type": "opencollective", + "url": "https://opencollective.com/express" } }, "node_modules/ignore": { @@ -5947,6 +6080,16 @@ "node": ">= 0.4" } }, + "node_modules/jose": { + "version": "6.1.3", + "resolved": "https://registry.npmjs.org/jose/-/jose-6.1.3.tgz", + "integrity": "sha512-0TpaTfihd4QMNwrz/ob2Bp7X04yuxJkjRGi4aKmOqwhov54i6u79oCv7T+C7lo70MKH6BesI3vscD1yb/yzKXQ==", + "dev": true, + "license": "MIT", + "funding": { + "url": "https://github.com/sponsors/panva" + } + }, "node_modules/js-tokens": { "version": "4.0.0", "resolved": "https://registry.npmjs.org/js-tokens/-/js-tokens-4.0.0.tgz", @@ -6394,9 +6537,9 @@ } }, "node_modules/mdast-util-to-hast": { - "version": "13.2.0", - "resolved": "https://registry.npmjs.org/mdast-util-to-hast/-/mdast-util-to-hast-13.2.0.tgz", - "integrity": "sha512-QGYKEuUsYT9ykKBCMOEDLsU5JRObWQusAolFMeko/tYPufNkRffBAQjIE+99jbA87xv6FgmjLtwjh9wBWajwAA==", + "version": "13.2.1", + "resolved": "https://registry.npmjs.org/mdast-util-to-hast/-/mdast-util-to-hast-13.2.1.tgz", + "integrity": "sha512-cctsq2wp5vTsLIcaymblUriiTcZd0CwWtCbLvrOzYCDZoWyMNV8sZ7krj09FSnsiJi3WVsHLM4k6Dq/yaPyCXA==", "license": "MIT", "dependencies": { "@types/hast": "^3.0.0", @@ -7876,9 +8019,9 @@ } }, "node_modules/qs": { - "version": "6.14.0", - "resolved": "https://registry.npmjs.org/qs/-/qs-6.14.0.tgz", - "integrity": "sha512-YWWTjgABSKcvs/nWBi9PycY/JiPJqOD4JA6o9Sej2AtvSGarXxKC3OQSk4pAarbdQlKAh5D4FCQkJNkW+GAn3w==", + "version": "6.14.1", + "resolved": "https://registry.npmjs.org/qs/-/qs-6.14.1.tgz", + "integrity": "sha512-4EK3+xJl8Ts67nLYNwqw/dsFVnCf+qR7RgXSK9jEEm9unao3njwMDdmsdvoKBKHzxd7tCYz5e5M+SnMjdtXGQQ==", "dev": true, "license": "BSD-3-Clause", "dependencies": { @@ -7923,19 +8066,19 @@ } }, "node_modules/raw-body": { - "version": "3.0.0", - "resolved": "https://registry.npmjs.org/raw-body/-/raw-body-3.0.0.tgz", - "integrity": "sha512-RmkhL8CAyCRPXCE28MMH0z2PNWQBNk2Q09ZdxM9IOOXwxwZbN+qbWaatPkdkWIKL2ZVDImrN/pK5HTRz2PcS4g==", + "version": "3.0.2", + "resolved": "https://registry.npmjs.org/raw-body/-/raw-body-3.0.2.tgz", + "integrity": "sha512-K5zQjDllxWkf7Z5xJdV0/B0WTNqx6vxG70zJE4N0kBs4LovmEYWJzQGxC9bS9RAKu3bgM40lrd5zoLJ12MQ5BA==", "dev": true, "license": "MIT", "dependencies": { - "bytes": "3.1.2", - "http-errors": "2.0.0", - "iconv-lite": "0.6.3", - "unpipe": "1.0.0" + "bytes": "~3.1.2", + "http-errors": "~2.0.1", + "iconv-lite": "~0.7.0", + "unpipe": "~1.0.0" }, "engines": { - "node": ">= 0.8" + "node": ">= 0.10" } }, "node_modules/react": { @@ -8306,6 +8449,16 @@ "url": "https://opencollective.com/unified" } }, + "node_modules/require-from-string": { + "version": "2.0.2", + "resolved": "https://registry.npmjs.org/require-from-string/-/require-from-string-2.0.2.tgz", + "integrity": "sha512-Xf0nWe6RseziFMu+Ap9biiUbmplq6S9/p+7w7YXP/JBHhrUDDUhwa+vANyubuqfZWTveU//DYVGsDG7RKL/vEw==", + "dev": true, + "license": "MIT", + "engines": { + "node": ">=0.10.0" + } + }, "node_modules/resolve": { "version": "1.22.10", "resolved": "https://registry.npmjs.org/resolve/-/resolve-1.22.10.tgz", @@ -8815,9 +8968,9 @@ "license": "MIT" }, "node_modules/statuses": { - "version": "2.0.1", - "resolved": "https://registry.npmjs.org/statuses/-/statuses-2.0.1.tgz", - "integrity": "sha512-RwNA9Z/7PrK06rYLIzFMlaF+l73iwpzsqRIFgbMLbTcLD6cOao82TaWefPXQvB2fOC4AjuYSEndS7N/mTCbkdQ==", + "version": "2.0.2", + "resolved": "https://registry.npmjs.org/statuses/-/statuses-2.0.2.tgz", + "integrity": "sha512-DvEy55V3DB7uknRo+4iOGT5fP1slR8wQohVdknigZPMpMstaKJQWhwiYBACJE3Ul2pTnATihhBYnRhZQHGBiRw==", "dev": true, "license": "MIT", "engines": { @@ -9855,16 +10008,6 @@ "url": "https://github.com/sponsors/colinhacks" } }, - "node_modules/zod-to-json-schema": { - "version": "3.24.5", - "resolved": "https://registry.npmjs.org/zod-to-json-schema/-/zod-to-json-schema-3.24.5.tgz", - "integrity": "sha512-/AuWwMP+YqiPbsJx5D6TfgRTc4kTLjsh5SOcd4bLsfUg2RcEXrFMJl1DGgdHy2aCfsIA/cr/1JM0xcB2GZji8g==", - "dev": true, - "license": "ISC", - "peerDependencies": { - "zod": "^3.24.1" - } - }, "node_modules/zwitch": { "version": "2.0.4", "resolved": "https://registry.npmjs.org/zwitch/-/zwitch-2.0.4.tgz", diff --git a/public/assets/commercial-support-logos/ksolvesLogo.svg b/public/assets/commercial-support-logos/ksolvesLogo.svg new file mode 100644 index 00000000..cd276e53 --- /dev/null +++ b/public/assets/commercial-support-logos/ksolvesLogo.svg @@ -0,0 +1,21 @@ + + + + + + + + \ No newline at end of file diff --git a/src/app/support-training/page.tsx b/src/app/support-training/page.tsx index c3efe6a7..5498ae9e 100644 --- a/src/app/support-training/page.tsx +++ b/src/app/support-training/page.tsx @@ -152,6 +152,11 @@ const commercialSupportProviders: ProviderCardProps[] = [ logo: "/assets/commercial-support-logos/xamira_networks.png", url: "https://www.xamira.de/en/technologies/monitoring/", }, + { + name: "Ksolves", + logo: "/assets/commercial-support-logos/ksolvesLogo.svg", + url: "https://www.ksolves.com/support-services/prometheus-enterprise-support/", + }, ]; function ProviderCard({