PrometheusRemoteWriteDesiredShards #
Meaning #
Prometheus remote write desired shards calculation wants to run more than configured max shards.
Impact #
Metrics and alerts may be missing or inaccurate.
Diagnosis #
Check metrics cardinality.
Check prometheus logs and remote storage logs. Investigate network issues. Check configs and credentials.
Mitigation #
Probbaly amout of data sent to remote system is too high for given network connectivity speed. You may need to limit which metrics to send to minimize transfers.