How to redirect application metrics
When setting up application monitoring, metrics for storage are sent to a local instance of VictoriaMetrics (VMSingle), which is deployed in the namespace user-monitoring of the client cluster. If necessary, application metrics can be redirected to external storage.
To do this, in the VMAgent resource, replace or add the external storage URL in the spec.remoteWrite section.
Note: Please note! External storage must support the Prometheus/VictoriaMetrics Remote Write protocol.
Note: Please note! The app: vmagent-user-monitoring label and VMAgent name cannot be changed - see application monitoring setup.
VMAgent example
apiVersion: operator.victoriametrics.com/v1beta1
kind: VMAgent
metadata:
labels:
app: vmagent-user-monitoring # Name cannot be changed
app.kubernetes.io/component: monitoring
app.kubernetes.io/name: user-monitoring
name: user-monitoring
namespace: user-monitoring
spec:
externalLabels:
cluster: client-cluster
extraArgs:
<your parameter value>
logFormat: <your parameter value>
logLevel: <your parameter value>
nodeScrapeNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
podScrapeNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
port: "8429"
probeNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
remoteWrite:
- url: <your parameter value> # VictoriaMetrics external storage URL
replicaCount: <your parameter value>
resources:
limits:
cpu: <your parameter value>
memory: <your parameter value>
requests:
cpu: <your parameter value>
memory: <your parameter value>
scrapeConfigNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
scrapeInterval: <your parameter value>
securityContext:
fsGroup: 2000
runAsGroup: 2000
runAsNonRoot: true
runAsUser: 1000
serviceAccountName: vmagent-user-monitoring
serviceScrapeNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
staticScrapeNamespaceSelector:
matchExpressions:
- key: shturval.tech/system-namespace
operator: DoesNotExist
tolerations:
- effect: NoSchedule
key: node-role.kubernetes.io/infra
operator: Exists
vmAgentExternalLabelName: ""
| Parameter | Description | Data type | Example |
|---|---|---|---|
extraArgs | List of additional launch arguments | []object | envflag.enable: "true", envflag.prefix: VM_, promscrape.dropOriginalLabels: "true", promscrape.maxScrapeSize: "67108864", promscrape.streamParse: "true", remoteWrite.tmpDataPath: /tmp |
logFormat | Log Format | string | default |
logLevel | Log level | string | INFO |
replicaCount | Number of replicas | integer | 1 |
remoteWrite | Links to remote metrics stores for recording | []object | url: vmcluster.local:8480/insert/123/prometheus |
resources | Resources requests and limits | []object | limits: cpu: 10, memory: 10Gi; requests: cpu: 50m, memory: 50Mi |
scrapeInterval | Metric collection frequency | integer | 15s |