Milvus Vector Database

Collect Metrics related to Milvus Vector Database

Configuration¶

Prerequisites¶

• DataKit installed
• Install Milvus

Enable Milvus Monitoring¶

Navigate to the Milvus /home/$USER/milvus/conf directory and modify the server_config.yaml file to enable Milvus monitoring

metric:
  enable: true
  address: 127.0.0.1 
  port: 9091

Note: If Milvus is deployed in a Docker container, the above address should be modified to the host IP

• After modification, restart Milvus and check the monitoring data via http://localhost:9091/metrics

Configure DataKit¶

• Navigate to the conf.d/prom directory in the DataKit installation directory, copy prom.conf.sample and rename it to milvus.conf

cp prom.conf.sample milvus.conf

• Adjust the content of milvus.conf as follows:

## Exporter URLs.
  urls = ["http://127.0.0.1:9091/metrics"]

  ## Stream Size. 
  ## The source stream segmentation size, (defaults to 1).
  ## 0 source stream undivided. 
  stream_size = 1

  ## Unix Domain Socket URL. Using socket to request data when not empty.
  uds_path = ""

  ## Ignore URL request errors.
  ignore_req_err = false

  ## Collector alias.
  source = "milvus"

  ## Measurement prefix.
  ## Add prefix to measurement set name.
  measurement_prefix = ""
  measurement_name = "milvus"

  ## (Optional) Collect interval: (defaults to "30s").
  interval = "30s"

  # [inputs.prom.tags]
    # some_tag = "some_value"
    # more_tag = "some_other_value"

Other configurations can be adjusted as needed, adjustment parameter descriptions:

• urls: Metrics address, fill in the metrics url exposed by the corresponding component
• source: Collector alias, it is recommended to distinguish
• keep_exist_metric_name: Keep the metric name
• interval: Collection interval
• inputs.prom.tags: Add additional tags

Restart DataKit by executing the following command

datakit service -R

Metrics¶

Milvus Measurement¶

Milvus metrics are located under the milvus measurement, here is an introduction to Milvus metrics