Welcome to Volt Active Data
Section 4 — Durability
Returning to the window where we were running our test workload we see these messages at the time of the outage:
- 2020-12-16 14:50:25:ReportUsageCreditCallback user=1772061:Connection to database host (vdb3/172.31.23.36:21212) was lost before a response was received
- 2020-12-16 14:50:26:ReportUsageCreditCallback user=1946934:Transaction dropped due to change in mastership. It is possible the transaction was committed
In either case the appropriate course of action would be to re-try the transaction, something which is outside the scope of this sandbox.
Within a couple of minutes the volt.log will show the server restarting:
Returning to Grafana we can see the outage and recovery on node vdb3: