Issue
After upgrading to Terraform Enterprise to v202309-1 or later, Terraform Enterprise startup hangs at the following log line.
Running as builtin tfe user, ensuring ownership of scratch directories...
Prerequisites
- Terraform Enterprise >=v202309-1 (Replicated deployment)
- Mounted Disk operational mode
Cause
In Terraform Enterprise v202309-1 and later, Terraform Enterprise services are consolidated into a single container architecture. In this release and later releases, when Terraform Enterprise starts, it attempts to change group ownership of all files and subdirectories in the disk path to the root group and recursively copy user permissions to the group. When first upgrading to this release or later, startup can hang for several minutes in installations with a large data directory while the ownership and permissions of these files are altered.
Solution
Wait until the Terraform Enterprise completes this step and proceeds through startup. If Replicated errors with "Ready state command canceled: context deadline exceeded", indicating Terraform Enterprise did not report as healthy within the acceptable timeout period, wait until the terraform-enterprise container completes startup and then restart Terraform Enterprise to clear the Replicated error status.
Additional Information