Chapter 5. Preparing and Uploading cloud images with Image Builder
Image Builder can create custom system images ready for use in clouds of various providers. To use your customized RHEL system image in a cloud, create the system image with Image Builder using the respective output type, configure your system for uploading the image, and upload the image to your cloud account. From Red Hat Enterprise Linux 8.3, the ability to push customized images clouds through the Image Builder
application in the RHEL web console is available for a subset of the service providers that we support, such as AWS and Azure clouds. See Pushing images to AWS Cloud AMI and Pushing VHD imaged to Azure cloud.
5.1. Preparing for uploading AWS AMI images
This describes steps to configure a system for uploading AWS AMI images.
Prerequisites
- You must have an Access Key ID configured in the AWS IAM account manager.
- You must have a writable S3 bucket prepared.
Procedure
Install Python 3 and the
pip
tool:# yum install python3 # yum install python3-pip
Install the AWS command-line tools with
pip
:# pip3 install awscli
Run the following command to set your profile. The terminal prompts you to provide your credentials, region and output format:
$ aws configure AWS Access Key ID [None]: AWS Secret Access Key [None]: Default region name [None]: Default output format [None]:
Define a name for your bucket and use the following command to create a bucket:
$ BUCKET=bucketname $ aws s3 mb s3://$BUCKET
Replace bucketname with the actual bucket name. It must be a globally unique name. As a result, your bucket is created.
Then, to grant permission to access the S3 bucket, create a
vmimport
S3 Role in IAM, if you have not already done so in the past:$ printf '{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "Service": "vmie.amazonaws.com" }, "Action": "sts:AssumeRole", "Condition": { "StringEquals":{ "sts:Externalid": "vmimport" } } } ] }' > trust-policy.json $ printf '{ "Version":"2012-10-17", "Statement":[ { "Effect":"Allow", "Action":[ "s3:GetBucketLocation", "s3:GetObject", "s3:ListBucket" ], "Resource":[ "arn:aws:s3:::%s", "arn:aws:s3:::%s/*" ] }, { "Effect":"Allow", "Action":[ "ec2:ModifySnapshotAttribute", "ec2:CopySnapshot", "ec2:RegisterImage", "ec2:Describe*" ], "Resource":"*" } ] }' $BUCKET $BUCKET > role-policy.json $ aws iam create-role --role-name vmimport --assume-role-policy-document file://trust-policy.json $ aws iam put-role-policy --role-name vmimport --policy-name vmimport --policy-document file://role-policy.json
Additional resources
5.2. Uploading an AMI image to AWS
This section describes how to upload an AMI image to AWS.
Prerequisites
- Your system must be set up for uploading AWS images.
-
You must have an AWS image created by Image Builder. Use the
ami
output type in CLI or Amazon Machine Image Disk (.ami) in GUI when creating the image.
Procedure
Push the image to S3:
$ AMI=8db1b463-91ee-4fd9-8065-938924398428-disk.ami $ aws s3 cp $AMI s3://$BUCKET Completed 24.2 MiB/4.4 GiB (2.5 MiB/s) with 1 file(s) remaining ...
After the upload to S3 ends, import the image as a snapshot into EC2:
$ printf '{ "Description": "my-image", "Format": "raw", "UserBucket": { "S3Bucket": "%s", "S3Key": "%s" } }' $BUCKET $AMI > containers.json $ aws ec2 import-snapshot --disk-container file://containers.json
Replace my-image with the name of the image.
To track progress of the import, run:
$ aws ec2 describe-import-snapshot-tasks --filters Name=task-state,Values=active
Create an image from the uploaded snapshot by selecting the snapshot in the EC2 console, right clicking on it and selecting
Create Image
:Select the
Virtualization
type ofHardware-assisted virtualization
in the image you create:-
Now you can run an instance using whatever mechanism you like (CLI or AWS Console) from the snapshot. Use your private key via SSH to access the resulting EC2 instance. Log in as
ec2-user
.
5.3. Pushing images to AWS Cloud AMI
The ability to push the output image that you create to AWS Cloud AMI is available this time. This describes steps to push .ami
images you create using Image Builder to Amazon AWS Cloud service provider.
Prerequisites
Procedure
- Click Creating an Image Builder blueprint in the web console interface. to create a blueprint. See
- Select the components and packages that you want as part of the image you are creating.
Click
to commit the changes you made to the blueprint.A small pop-up on the superior right side informs you of the saving progress and then the result of the changes you commited.
- Click blueprint name link on the left banner.
- Select the tab .
Click
to create your customized image.A pop-up window opens.
- From the "Type" drop-down menu list, select the `"Amazon Machine Image Disk (.ami)"' image.
- Check the "Upload to AWS" check box to upload your image to the AWS Cloud and click .
To authenticate your access to AWS, type your "AWS access key ID" and "AWS secret access key" in the corresponding fields. Click
.NoteYou can view your AWS secret access key only when you create a new Access Key ID. If you do not know your Secret Key, generate a new Access Key ID.
- Type the name of the image in the "Image name" field, type the Amazon bucket name in the "Amazon S3 bucket name" field and type the "AWS region" field for the bucket you are going to add your customized image to. Click .
Review the information you provided and once you are satisfied, click
.Optionally, you can click
to modify any incorrect detail.NoteYou must have the correct IAM settings for the bucket you are going to send your customized image. We are using the IAM Import and Export, so you have to setup a policy to your bucket before you are able to upload images to it. For more information, see Required Permissions for IAM Users.
A small pop-up on the superior right side informs you of the saving progress. It also informs that the image creation has been initiated, the progress of this image creation and the subsequent upload to the AWS Cloud.
Once the process is complete, you can see the "Image build complete" status.
- Click Service→EC2 on the menu and choose the correct region in the AWS console. The image must have the "Available" status, to indicate that it is uploaded.
- On the dashboard, select your image and click .
- A new window opens. Choose an instance type according to the resources you need to launch your image. Click .
- Review your instance launch details. You can edit each section if you need to make any change. Click
Before you launch the instance, you must select a public key to access it.
You can either use the key pair you already have or you can create a new key pair. Alternatively, you can use
Image Builder
to add a user to the image with a preset public key. See Creating a user account with SSH key for more details.Follow the next steps to create a new key pair in EC2 and attach it to the new instance.
- From the drop-down menu list, select "Create a new key pair".
- Enter the name to the new key pair. It generates a new key pair.
- Click "Download Key Pair" to save the new key pair on your local system.
Then, you can click
to launch your instance.You can check the status of the instance, it shows as "Initializing".
- Once the instance status is "running", the button turns available.
Click
. A popup window appears with instructions on how to connect using SSH.- Select the preferred connection method to "A standalone SSH client" and open a terminal.
In the location you store your private key, make sure that your key is publicly viewable for SSH to work. To do so, run the command:
$ chmod 400 <your-instance-name.pem>_
Connect to your instance using its Public DNS:
$ ssh -i "<_your-instance-name.pem_"> ec2-user@<_your-instance-IP-address_>
Type "yes" to confirm that you want to continue connecting.
As a result, you are connected to your instance using SSH.
Verification steps
- Check if you are able to perform any action while connected to your instance using SSH.
5.4. Preparing for uploading Azure VHD images
This describes steps to upload an VHD image to Azure.
Prerequisites
- You must have a usable Azure resource group and storage account.
Procedure
Install python2:
# yum install python2
Notepython2 package must be installed because since the AZ CLI depends specifically on python 2.7
Import the Microsoft repository key:
# rpm --import https://packages.microsoft.com/keys/microsoft.asc
Create a local azure-cli repository information:
# sh -c 'echo -e "[azure-cli]\nname=Azure CLI\nbaseurl=https://packages.microsoft.com/yumrepos/azure-cli\nenabled=1\ngpgcheck=1\ngpgkey=https://packages.microsoft.com/keys/microsoft.asc" > /etc/yum.repos.d/azure-cli.repo'
Install the Azure CLI:
# yumdownloader azure-cli # rpm -ivh --nodeps azure-cli-2.0.64-1.el7.x86_64.rpm
NoteThe downloaded version of the Azure CLI package may vary depending on the current downloaded version.
Run the Azure CLI:
$ az login
The terminal shows the message 'Note, we have launched a browser for you to login. For old experience with device code, use "az login --use-device-code"' and opens a browser where you can login.
NoteIf you are running a remote (SSH) session, the link will not open in the browser. In this case, you can use the link provided and thus be able to login and autenticate your remote session. To sign in, use a web browser to open the page https://microsoft.com/devicelogin and enter the code XXXXXXXXX to authenticate.
List the keys for the storage account in Azure:
$ GROUP=resource-group-name $ ACCOUNT=storage-account-name $ az storage account keys list --resource-group $GROUP --account-name $ACCOUNT
Replace resource-group-name with name of the Azure resource group and storage-account-name with name of the Azure storage account.
NoteYou can list the available resources using the command:
$ az resource list
Make note of value
key1
in the output of the previous command, and assign it to an environment variable:$ KEY1=value
Create a storage container:
$ CONTAINER=storage-account-name $ az storage container create --account-name $ACCOUNT \ --account-key $KEY1 --name $CONTAINER
Replace storage-account-name with name of the storage account.
Additional resources
5.5. Uploading VHD images to Azure
This describes steps to upload an VHD image to Azure.
Prerequisites
- Your system must be set up for uploading Azure VHD images.
-
You must have an Azure VHD image created by Image Builder. Use the
vhd
output type in CLI or Azure Disk Image (.vhd) in GUI when creating the image.
Procedure
Push the image to Azure and create an instance from it:
$ VHD=25ccb8dd-3872-477f-9e3d-c2970cd4bbaf-disk.vhd $ az storage blob upload --account-name $ACCOUNT --container-name $CONTAINER --file $VHD --name $VHD --type page ...
Once the upload to the Azure BLOB completes, create an Azure image from it:
$ az image create --resource-group $GROUP --name $VHD --os-type linux --location eastus --source https://$ACCOUNT.blob.core.windows.net/$CONTAINER/$VHD - Running ...
Create an instance either with the Azure portal, or a command similar to the following:
$ az vm create --resource-group $GROUP --location eastus --name $VHD --image $VHD --admin-username azure-user --generate-ssh-keys - Running ...
-
Use your private key via SSH to access the resulting instance. Log in as
azure-user
.
5.6. Uploading VMDK images to vSphere
Image Builder can generate images suitable for uploading to a VMware ESXi or vSphere system. This describes steps to upload an VMDK image to VMware vSphere.
Because VMWare deployments typically does not have cloud-init configured to inject user credentials to virtual machines, we must perform that task ourselves on the blueprint.
Prerequisites
-
You must have an VMDK image created by Image Builder. Use the
vmdk
output type in CLI or VMware Virtual Machine Disk (.vmdk) in GUI when creating the image.
Procedure
Upload the image into vSphere via HTTP. Click on
Upload Files
in the vCenter:When you create a VM, on the
Device Configuration
, delete the defaultNew Hard Disk
and use the drop-down to select anExisting Hard Disk
disk image:Make sure you use an
IDE
device as theVirtual Device Node
for the disk you create. The default valueSCSI
results in an unbootable virtual machine.
5.7. Pushing VHD images to Azure cloud
The ability to push the output image you create to the Azure Blob Storage is available. This section describes steps to push .vhd
images you create using Image Builder to Azure Cloud service provider.
Prerequisites
- You must have root access to the system.
- You have opened the Image Builder interface of the RHEL 8 web console in a browser.
- You must have a Storage Account created.
- You must have a writable Blob Storage prepared.
Procedure
- Click Creating an Image Builder blueprint in the web console interface. to create a blueprint. See more at
- Select the components and packages that you want as part of the image you are creating.
Click
to commit the changes you made to the blueprint.A small pop-up on the upper right side informs you of the saving progress and then the result of the changes you commited.
- Click blueprint name link on the left banner.
- Select the tab .
Click
to create your customized image.A pop-up window opens.
-
From the "Type" drop-down menu list, select the
Azure Disk Image (.vhd)
image. - Check the "Upload to Azure" check box to upload your image to the Azure Cloud and click .
To authenticate your access to Azure, type your "Storage account" and "Storage access key" in the corresponding fields. Click
.You can find your Storage account details in the Settings→Access Key menu list.
- Type a "Image name" to be used for the image file that will be uploaded and the Blob "Storage container" in which the image file you want to push the image into. Click .
Review the information you provided and once you are satisfied, click
.Optionally, you can click
to modify any incorrect detail.
-
From the "Type" drop-down menu list, select the
A small pop-up on the upper right side displays when the image creation process starts with the message: "Image creation has been added to the queue".
Once the image process creation is complete, click the blueprint you created an image from. You can see the "Image build complete" status for the image you created within the
Images
tab.- To access the image you pushed into Azure Cloud, access Azure Portal.
- On the search bar, type Images and select the first entry under Services. You are redirected to the Image dashboard.
Click Create an Image dashboard.
. You are redirected to theInsert the below details:
- Name: Choose a name for your new image.
- Resource Group: Select a resource group.
- Location: Select the location that matches the regions assigned to your storage account. Otherwise you will not be able to select a blob.
- OS Type: Set the OS type to Linux.
- VM Generation: Keep the VM generation set on Gen 1.
Storage Blob: Click Browse on the right of Storage blob input. Use the dialog to find the image you uploaded earlier.
Keep the remaining fields as in the defaults choice.
- Click "Successfully created image" in the upper right corner. to create the image. Once the image is created, you can see the message
- Click to see your new image and open your newly created image.
- Click Create a virtual machine dashboard. . You are redirected to the
In the Basic tab, under Project Details, your *Subscription and the Resource Group are already pre-set.
If you want to create a new resource Group
Click
.A pop-up prompts you to create the Resource Group Name container.
Insert a name and click
.If you want to keep the Resource Group that are already pre-set.
Under Instance Details, insert:
- Virtual machine name
- Region
- Image: The image you created is pre-selected by default.
Size: Choose a VM size that better suits your needs.
Keep the remaining fields as in the defaults choice.
Under Administrator account, enter the below details:
- Username: the name of the account administrator.
SSH public key source: from the drop-down menu, select Generate new key pair.
You can either use the key pair you already have or you can create a new key pair. Alternatively, you can use
Image Builder
to add a user to the image with a preset public key. See Creating a user account with SSH key for more details.- Key pair name: insert a name for the key pair.
Under Inbound port rules, select:
- Public inbound ports: Allow selected ports.
- Select inbound ports: Use the default set SSH (22).
- Click Review + create tab and receive a confirmation that the validation passed. . You are redirected to the
Review the details and click
.Optionally, you can click
to fix previous options selected.A pop-up generates new key pair window opens. Click .
Save the key file as "yourKey.pem".
- Once the deployment is complete, click .
- You are redirected to a new window with your VM details. Select the public IP address on the top right side of the page and copy it to your clipboard.
Now, to create an SSH connection with the VM to connect to the Virtual Machine.
- Open a terminal.
At your prompt, open an SSH connection to your virtual machine. Replace the IP address with the one from your VM, and replace the path to the .pem with the path to where the key file was downloaded.
# ssh -i ./Downloads/yourKey.pem azureuser@10.111.12.123
- You are required to confirm if you want to continue to connect. Type yes to continue.
As a result, the output image you pushed to the Azure Storage Blob is ready to be provisioned.
5.8. Uploading QCOW2 image to OpenStack
Image Builder can generate images suitable for uploading to OpenStack cloud deployments, and starting instances there. This describes steps to upload an QCOW2 image to OpenStack.
Prerequisites
You must have an OpenStack-specific image created by Image Builder. Use the
openstack
output type in CLI or OpenStack Image (.qcow2) in GUI when creating the image.WarningImage Builder also offers a generic QCOW2 image type output format as
qcow2
or QEMU QCOW2 Image (.qcow2). Do not mistake it with the OpenStack image type which is also in the QCOW2 format, but contains further changes specific to OpenStack.
Procedure
Upload the image to OpenStack and start an instance from it. Use the
Images
interface to do this:Start an instance with that image:
-
You can run the instance using any mechanism (CLI or OpenStack web UI) from the snapshot. Use your private key via SSH to access the resulting instance. Log in as
cloud-user
.
5.9. Preparing for uploading images to Alibaba
This section describes steps to verify custom images that you can deploy on Alibaba Cloud. The images will need a specific configuration to boot successfully, because Alibaba Cloud requests the custom images to meet certain requirements before you use it. For this, it is recommended that you use the Alibaba image_check tool.
The custom image verification is an optional task. Image Builder generates images that conform to Alibaba’s requirements.
Prerequisites
- You must have an Alibaba image created by Image Builder.
Procedure
- Connect to the system containing the image you want to check it by the Alibaba image_check tool.
Download the image_check tool:
$ curl -O http://docs-aliyun.cn-hangzhou.oss.aliyun-inc.com/assets/attach/73848/cn_zh/1557459863884/image_check
Change the file permission of the image compliance tool:
# chmod +x image_check
Run the command to start the image compliance tool checkup:
# ./image_check
The tool verifies the system configuration and generate a report that is displayed on your screen. The image_check tool saves this report in the same folder where the image compliance tool is running.
- If any of the Detection Items fail, follow the instructions to correct it. For more information, see link: Detection items section.
Additional resources
5.10. Uploading images to Alibaba
This section describes how to upload an Alibaba image to Object Storage Service (OSS).
Prerequisites
- Your system is set up for uploading Alibaba images.
-
You must have an Alibaba image created by Image Builder. Use the
ami
output type on RHEL 7 or Alibaba on RHEL 8 when creating the image. - You have a bucket. See Creating a bucket.
- You have an active Alibaba Account.
- You activated OSS.
Procedure
- Log in to the OSS console.
- On the left side Bucket menu, select the bucket to which you want to upload an image.
- On the right upper menu, click Files tab.
Click
. A window dialog opens on the right side. Choose the following information:- Upload To: Choose to upload the file to the Current directory or to a Specified directory.
- File ACL: Choose the type of permission of the uploaded file.
- Click .
- Choose the image you want to upload.
- Click .
As a result, the custom image is uploaded to OSS Console.
Additional resources
5.11. Importing images to Alibaba
This section describes how to import an Alibaba image to Elastic Cloud Console (ECS).
Prerequisites
- You have uploaded the image to Object Storage Service (OSS).
Procedure
Log in to the ECS console.
- On the left side menu, click .
- On the right upper side, click . A window dialog opens.
Confirm that you have set up the correct region where the image is located. Enter the following information:
- OSS Object Address: See how to obtain OSS Object Address.
- Image Name:
- Operating System:
- System Disk Size:
- System Architecture:
- Platform: Red Hat
Optionally, provide the following details:
- Image Format: qcow2 or ami, depending on the uploaded image format.
- Image Description:
Add Images of Data Disks:
The address can be determined in the OSS management console after selecting the required bucket in the left menu, select Files section and then click on Details link on the right for the appropriate image. A window will appear on the right side of the screen, showing image details. The OSS object address is in the URL box.
Click
.NoteThe importing process time can vary depending on the image size.
As a result, the custom image is imported to ECS Console. You can create an instance from the custom image.
Additional resources
5.12. Creating an instance of a custom image using Alibaba
You can create instances of the custom image using Alibaba ECS Console.
Prerequisites
- You have activated OSS and uploaded your custom image.
- You have successfully imported your image to ECS Console.
Procedure
- Log in to the ECS console.
- On the left side menu, choose Instances.
- In the top corner, click Create Instance. You are redirected to a new window.
- Fill in all the required information. See Creating an instance by using the wizard for more details.
Click Create Instance and confirm the order.
NoteYou can see the option Create Order instead of Create Instace, depending on your subscription.
As a result, you have an active instance ready for deployment.
Additional resources