Introduction
Problem
If Terraform Enterprise's Docker volumes grow out of control, TFE may become unusable in unexpected ways. This may manifest in poor application/UI performance, or failing runs due to configuration version failures.
Cause
- Terraform Enterprise's Docker containers use Docker volume objects to operate normally. There are some situations that cause Docker's containers to run out of disk space.
- To validate that this is the problem, run the following command:
-
journalctl | grep 'no space left on device'
-
- If you see multiple items returned see the solution below.
Solution:
-
Run the command
docker system prune --volumes
and then confirm the prompts.
- If you are using a custom build worker image, you may need to restart TFE as the prune may delete the image. A restart will reload a fresh copy of the image.