Introduction
Problem
During the installation of Terraform Enterprise with replicated it doesn't start or becomes available. The replicated admin console show the following
Executing the command replicatedctl app status
shows the following error despite having the correct license in-place
replicatedctl app status
Error: App not found.
It is possible that you have not yet uploaded a license.
Please first install a license using the license-load command.
docker logs would show an image pull error :
dockerd-current: time="2025-03-09T07:04:04.878396776-04:00" level=error msg="Not continuing with pull after error: error: image replicated/replicated-operator:stable-2.56.6 not found"
dockerd-current: time="2025-03-09T07:04:05.562286145-04:00" level=error msg="Attempting next endpoint for pull aftererror: unauthorized: access to the requested resource is not authorized"
dockerd-current: time="2025-03-09T07:04:05.810538041-04:00" level=error msg="Not continuing with pull after error: Error: image replicated/replicated-operator:stable-2.56.6 not found"
ERROR 2025-03-09T11:05:21+00:00 daemon/daemon.go:1443 Support bundle pull failed with error: received unexpected HTTP status: 503 Service
Error gathered from /var/log/messages
2025-03-09206:59:05-943091481-04:00- error msg-“Download failed retrying:received unexpected HTTP status: 503 service Unavailable
Upon verifying the docker images using the command docker images
, we can see missing images in comparison with a working environment.
Non-working environment:
Working environment :
Prerequisites
- Terraform Enterprise on replicated
Cause
The issue is likely network-related while TFE is unable to pull all the images needed during the installation
Solutions
Option 1:
If there is a backup of the instance, kindly revert the changes to get back into a stable environment.
Option 2:
If an identical Terraform Enterprise environment exists, these Docker images can be backed up and restored on the environment where they are missing.
-
- Login to your other environment which should be on the same version and save the images using the following command
docker save -o all-images.tar $(docker images --format "{{.Repository}}:{{.Tag}}")
-
- Copy the generated file from your other environment
- restore it by executing this command
docker load -i all-images.tar
Option 3:
If none of the above is available, you will need to investigate along with the internal network team to check what could be blocking the traffic, below are extra troubleshooting steps:
- You will need your replicated license file and unarchive it
$ tar zxf replicated_license.rli
$ ls
replicated_license.rli key.signature license.json license.signature signing_key.pub
- Retrieve the id within the license.json file, and make sure to have jq installed on your machine beforehand:
$ cat license.json | jq .
{
"id": "xxxxbbbb5e17469e509e01aeaaaaxxxx",
: :
- Please log in to confirm the credentials are correct. The user and password are the same:
$ docker login -u xxxxbbbb5e17469e509e01aeaaaaxxxx registry.replicated.com -p xxxxbbbb5e17469e509e01aeaaaaxxxx
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Login Succeeded
- Test pulling the images by pulling this for example using
docker pull registry.replicated.com/terraformenterprise/2rzxli7kinrk.hashicorp-ptfe-postgres
Outcome
Terraform Enterprise will be up and running after all images are installed