telemetry_storage_config.yml

This file configures resource requests, resource limits, replica counts, and persistent volume sizes for telemetry storage and processing components.

Parameter Reference

Telemetry Storage Configuration Parameters

Parameter	Details
victoria_cluster_storage dict / required	VictoriaMetrics cluster resource configurations.
vmstorage dict / required	VMStorage resource configuration.
replicas integer / required	Number of vmstorage pod replicas Default value: 3 Note: For cluster mode, minimum 3 replicas are recommended for high availability
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vmstorage pods Default value: 1Gi
cpu string / required	CPU request for vmstorage pods Default value: 250m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vmstorage pods Default value: 2Gi
cpu string / required	CPU limit for vmstorage pods Default value: 1000m
vminsert dict / required	VMInsert resource configuration.
replicas integer / required	Number of vminsert pod replicas Default value: 2
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vminsert pods Default value: 256Mi
cpu string / required	CPU request for vminsert pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vminsert pods Default value: 512Mi
cpu string / required	CPU limit for vminsert pods Default value: 500m
vmselect dict / required	VMSelect resource configuration.
replicas integer / required	Number of vmselect pod replicas Default value: 2
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vmselect pods Default value: 256Mi
cpu string / required	CPU request for vmselect pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vmselect pods Default value: 512Mi
cpu string / required	CPU limit for vmselect pods Default value: 500m
vmagent dict / required	VMAgent resource configuration.
replicas integer / required	Number of vmagent pod replicas Default value: 1
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vmagent pods Default value: 256Mi
cpu string / required	CPU request for vmagent pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vmagent pods Default value: 512Mi
cpu string / required	CPU limit for vmagent pods Default value: 500m
victoria_logs_cluster_storage dict / required	VictoriaLogs cluster resource configurations.
vlstorage dict / required	VLStorage resource configuration.
replicas integer / required	Number of vlstorage pod replicas Default value: 3
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vlstorage pods Default value: 512Mi
cpu string / required	CPU request for vlstorage pods Default value: 250m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vlstorage pods Default value: 1Gi
cpu string / required	CPU limit for vlstorage pods Default value: 1000m
vlinsert dict / required	VLInsert resource configuration.
replicas integer / required	Number of vlinsert pod replicas Default value: 2
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vlinsert pods Default value: 256Mi
cpu string / required	CPU request for vlinsert pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vlinsert pods Default value: 512Mi
cpu string / required	CPU limit for vlinsert pods Default value: 500m
vlselect dict / required	VLSelect resource configuration.
replicas integer / required	Number of vlselect pod replicas Default value: 2
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vlselect pods Default value: 256Mi
cpu string / required	CPU request for vlselect pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vlselect pods Default value: 512Mi
cpu string / required	CPU limit for vlselect pods Default value: 500m
vlagent dict / required	VLAgent resource configuration.
replicas integer / required	Number of vlagent pod replicas Default value: 1
pvc_size string / required	PVC size for vlagent pods Default value: 5Gi
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vlagent pods Default value: 256Mi
cpu string / required	CPU request for vlagent pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vlagent pods Default value: 512Mi
cpu string / required	CPU limit for vlagent pods Default value: 500m
vector_storage dict / required	Vector component resource configurations.
ldms dict / required	Vector-LDMS resource configuration.
replicas integer / required	Number of Vector-LDMS pod replicas Default value: 1
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for Vector-LDMS pods Default value: 256Mi
cpu string / required	CPU request for Vector-LDMS pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for Vector-LDMS pods Default value: 512Mi
cpu string / required	CPU limit for Vector-LDMS pods Default value: 500m
ome dict / required	Vector-OME resource configuration.
replicas integer / required	Number of Vector-OME pod replicas Default value: 1
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for Vector-OME pods Default value: 256Mi
cpu string / required	CPU request for Vector-OME pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for Vector-OME pods Default value: 512Mi
cpu string / required	CPU limit for Vector-OME pods Default value: 500m
vlagent_vector dict / required	VLAgent-Vector resource configuration.
replicas integer / required	Number of vlagent-vector pod replicas Default value: 1
pvc_size string / required	PVC size for vlagent-vector pods Default value: 5Gi
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vlagent-vector pods Default value: 256Mi
cpu string / required	CPU request for vlagent-vector pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vlagent-vector pods Default value: 512Mi
cpu string / required	CPU limit for vlagent-vector pods Default value: 500m
vmagent_vector dict / required	VMAgent-Vector resource configuration.
replicas integer / required	Number of vmagent-vector pod replicas Default value: 1
pvc_size string / required	PVC size for vmagent-vector pods Default value: 5Gi
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for vmagent-vector pods Default value: 256Mi
cpu string / required	CPU request for vmagent-vector pods Default value: 100m
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for vmagent-vector pods Default value: 512Mi
cpu string / required	CPU limit for vmagent-vector pods Default value: 500m
csi_volume_exporter_storage dict / required	CSI Volume Exporter resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for CSI Volume Exporter pods.
memory string / required	Memory request for CSI Volume Exporter pods.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for CSI Volume Exporter pods.
memory string / required	Memory limit for CSI Volume Exporter pods.
csm_metrics_powerscale_storage dict / required	CSM Metrics PowerScale resource configuration.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for CSM Metrics PowerScale pods.
memory string / required	Memory request for CSM Metrics PowerScale pods.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for CSM Metrics PowerScale pods.
memory string / required	Memory limit for CSM Metrics PowerScale pods.
kafka_storage dict / required	Kafka storage resource configuration. Required when kafka is in collection_targets for any source.
kafka dict / required	Kafka broker resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for Kafka broker pods.
cpu string / required	CPU request for Kafka broker pods.
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for Kafka broker pods.
cpu string / required	CPU limit for Kafka broker pods.
entity_operator dict / required	Kafka Entity Operator resource configuration.
user_operator dict / required	Kafka User Operator resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
memory string / required	Memory request for Kafka User Operator pods.
cpu string / required	CPU request for Kafka User Operator pods.
limits dict / required	Kubernetes resource specifications.
memory string / required	Memory limit for Kafka User Operator pods.
cpu string / required	CPU limit for Kafka User Operator pods.
idrac_telemetry_storage dict / required	iDRAC Telemetry container resource configuration. Required when iDRAC metrics are enabled.
mysqldb dict / required	MySQL database container resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for mysqldb container.
memory string / required	Memory request for mysqldb container.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for mysqldb container.
memory string / required	Memory limit for mysqldb container.
activemq dict / required	ActiveMQ container resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for activemq container.
memory string / required	Memory request for activemq container.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for activemq container.
memory string / required	Memory limit for activemq container.
receiver dict / required	iDRAC telemetry receiver container resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for receiver container.
memory string / required	Memory request for receiver container.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for receiver container.
memory string / required	Memory limit for receiver container.
kafka_pump dict / required	Kafka pump container resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for kafka_pump container.
memory string / required	Memory request for kafka_pump container.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for kafka_pump container.
memory string / required	Memory limit for kafka_pump container.
victoria_pump dict / required	Victoria pump container resource configuration.
resources dict / required	Resource requests and limits.
requests dict / required	Kubernetes resource specifications.
cpu string / required	CPU request for victoria_pump container.
memory string / required	Memory request for victoria_pump container.
limits dict / required	Kubernetes resource specifications.
cpu string / required	CPU limit for victoria_pump container.
memory string / required	Memory limit for victoria_pump container.

Usage example

File: /opt/omnia/telemetry/input/project_default/telemetry_storage_config.yml

---
victoria_cluster_storage:
  vmstorage:
    replicas: 3
    resources:
      requests:
        memory: "1Gi"
        cpu: "250m"
      limits:
        memory: "2Gi"
        cpu: "1000m"
  vminsert:
    replicas: 2
    resources:
      requests:
        memory: "256Mi"
        cpu: "100m"
      limits:
        memory: "512Mi"
        cpu: "500m"
  vmselect:
    replicas: 2
    resources:
      requests:
        memory: "256Mi"
        cpu: "100m"
      limits:
        memory: "512Mi"
        cpu: "500m"
  vmagent:
    replicas: 2
    resources:
      requests:
        memory: "128Mi"
        cpu: "50m"
      limits:
        memory: "512Mi"
        cpu: "250m"

victoria_logs_cluster_storage:
  vlstorage:
    replicas: 3
    resources:
      requests:
        memory: "512Mi"
        cpu: "100m"
      limits:
        memory: "1Gi"
        cpu: "500m"
  vlinsert:
    replicas: 2
    resources:
      requests:
        memory: "256Mi"
        cpu: "100m"
      limits:
        memory: "512Mi"
        cpu: "500m"
  vlselect:
    replicas: 2
    resources:
      requests:
        memory: "256Mi"
        cpu: "100m"
      limits:
        memory: "512Mi"
        cpu: "500m"
  vlagent:
    replicas: 2
    pvc_size: "5Gi"
    resources:
      requests:
        memory: "64Mi"
        cpu: "25m"
      limits:
        memory: "256Mi"
        cpu: "100m"

vector_storage:
  ldms:
    replicas: 2
    resources:
      requests:
        memory: "128Mi"
        cpu: "50m"
      limits:
        memory: "256Mi"
        cpu: "250m"
  ome:
    replicas: 2
    resources:
      requests:
        memory: "256Mi"
        cpu: "100m"
      limits:
        memory: "512Mi"
        cpu: "500m"
  vlagent_vector:
    replicas: 2
    pvc_size: "5Gi"
    resources:
      requests:
        memory: "128Mi"
        cpu: "50m"
      limits:
        memory: "256Mi"
        cpu: "250m"
  vmagent_vector:
    replicas: 2
    pvc_size: "5Gi"
    resources:
      requests:
        memory: "128Mi"
        cpu: "50m"
      limits:
        memory: "256Mi"
        cpu: "250m"

csi_volume_exporter_storage:
  resources:
    requests:
      cpu: "50m"
      memory: "64Mi"
    limits:
      cpu: "200m"
      memory: "256Mi"

csm_metrics_powerscale_storage:
  requests:
    cpu: "100m"
    memory: "128Mi"
  limits:
    cpu: "500m"
    memory: "512Mi"

idrac_telemetry_storage:
  mysqldb:
    resources:
      requests:
        cpu: "100m"
        memory: "256Mi"
      limits:
        cpu: "500m"
        memory: "512Mi"
  activemq:
    resources:
      requests:
        cpu: "100m"
        memory: "512Mi"
      limits:
        cpu: "500m"
        memory: "1536Mi"
  receiver:
    resources:
      requests:
        cpu: "100m"
        memory: "128Mi"
      limits:
        cpu: "500m"
        memory: "256Mi"
  kafka_pump:
    resources:
      requests:
        cpu: "50m"
        memory: "128Mi"
      limits:
        cpu: "200m"
        memory: "512Mi"
  victoria_pump:
    resources:
      requests:
        cpu: "50m"
        memory: "128Mi"
      limits:
        cpu: "200m"
        memory: "512Mi"

kafka_storage:
  kafka:
    resources:
      requests:
        memory: "512Mi"
        cpu: "200m"
      limits:
        memory: "1Gi"
        cpu: "1000m"
  entity_operator:
    user_operator:
      resources:
        requests:
          memory: "512Mi"
          cpu: "200m"
        limits:
          memory: "512Mi"
          cpu: "1000m"

Info

• Telemetry Configuration -- Telemetry sources, bridges, sinks, and component-specific settings.
• Telemetry Packages -- Package sources, images, charts, repositories, and Python modules.