We are having problems with the kubernetes store. We experience random store timeouts and therefore db disconnects in our cluster. It happens under load but also on random times during the night without any load.
Do you have an idea what could cause the disconnects without any load?
E0420 09:39:49.035064 1 leaderelection.go:331] error retrieving resource lock bms-databases/stolon-cluster-bms-postgres-stolon: Get https://10.43.0.1:443/api/v1/namespaces/bms-databases/configmaps/stolon-cluster-bms-postgres-stolon?timeout=5s: context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I saw the new
--store-timeout parameter in v0.16. I’ll try it out as soon as the parameter is available in the helm chart.