Lenovo Servers ThinkEdge SE450 & ThinkSystem SR630 V2 Minimum Requirements for Virtual Media Redfish Readiness
Table of Contents
Abstract
Deploying Red Hat Openshift Cluster Platform using Zero Touch Provisioning (ZTP) methodology on baremetal requires virtual media insertion using Redfish protocol.
Lenovo servers ThinkEdge SE450 & ThinkSystem SR630 V2 are new generation servers and they do not come with the required virtual media insertion support in order to be used for ZTP.
This article will provide the minimum requirements needed to deploy spoke clusters using these servers.
Terminology
Acronym | Meaning |
---|---|
OCP | OpenShift Container Platform |
RHACM | Red Hat Advanced Cluster Management for Kubernetes |
ZTP | Zero Touch Provisioning |
RDOC | Remote Disc On Card |
BOM | Build of Materials |
UEFI | Unified Extensible Firmware Interface |
SNO | Single Node Openshift |
BMC | Baseboard Management Controller |
Background
In general Lenovo servers ThinkEdge SE450 & ThinkSystem SR630 V2 have three types of media:
- RDOC media type, where the BMC storage space is restricted to 50 MB in total.
- Remote media type, where you can mount an ISO or image file from the client browser to the host as a DVD or USB drive.
- EXT media type, where you can mount an ISO or image file from a file server to the host as a DVD or USB drive (NFS or HTTP)
RDOC media has a limitation of 50 MB and the REMOTE media type do not support media insertion via protocols like Redfish, HTTP, or NFS.
ZTP uses Redfish in combination with HTTP or HTTPS protocol. With these requirements, only EXT media type can be used to deploy SNO using ZTP on these Lenovo servers.
We have tested the deployment on ThinkEdge SE450 & ThinkSystem SR630 V2 Lenovo servers and based on our results, we have established the minimum requirements for these servers to install SNO or compact node clusters using ZTP.
Minimum Server Requirements
ThinkEdge SE450
Machine Type/Model 7D8TCTO1WW
To install SNO or compact nodes cluster on Lenovo SE450 you need to ensure the following:
- Lenovo XClarity Controller Enterprise Upgrade license is active on the server
- BMC Version 1.00 Build ID: USX302R as a minimum BMC firmware version.
- UEFI Version 1.00 (Build ID: CME102Q)
- Boot order priority needs to be set to hard drive UEFI
See below the system firmware version
Type | Status | Version | Build | Release Date |
---|---|---|---|---|
BMC | Active | 1.00 | USX302R | 2021-12-02 |
UEFI | Active | 1.00 | CME102Q | 2021-12-06 |
Once these requirements are met, you need to validate that the EXT media type is the first media listed on that server, since ZTP will try to insert the ISO generated for the installation on the first available virtual media.
Below are two queries, the first output is before license and firmware upgrade and the second is after we applied license and firmware upgrade.
Before license upgrade to enterprise and firmware upgrade:
$ curl https://192.168.53.147/redfish/v1/Managers/1/VirtualMedia --user USER:PASSWD --insecure | jq
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 403 0 403 0 0 1970 0 --:--:-- --:--:-- --:--:-- 1975
{
"Members": [
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC2"
}
],
"@odata.type": "#VirtualMediaCollection.VirtualMediaCollection",
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia",
"Name": "VirtualMediaCollection",
"@odata.etag": "\"2b55c385af832722e92\"",
"Members@odata.count": 2,
"Description": "A collection of VirtualMedia resource instances"
}
After license upgrade to enterprise:
$ curl https://192.168.53.147/redfish/v1/Managers/1/VirtualMedia --user USER:PASSWD --insecure | jq
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 872 0 872 0 0 3760 0 --:--:-- --:--:-- --:--:-- 3758
{
"Members": [
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT4"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote4"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC2"
}
],
"@odata.type": "#VirtualMediaCollection.VirtualMediaCollection",
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia",
"Name": "VirtualMediaCollection",
"@odata.etag": "\"57af07952d392a2c93c\"",
"Members@odata.count": 10,
"Description": "A collection of VirtualMedia resource instances"
As you can see from the above outputs, before applying license and firmware upgrade the virtual media type EXT was not listed. Only once we upgraded the license and the firmware that the virtual media type, EXT, is listed and is also the first one available. The agent will then be able to insert the media into one of the EXT available, using the PATCH method with Redfish + HTTPS protocol.
ThinkSystem SR630 V2
Machine Type/Model 7Z71CTO1WW
To install SNO or compact nodes cluster on Lenovo ThinkSystem SR630 V2 you need to ensure the following:
- Lenovo XClarity Controller Enterprise Upgrade license is active on the server
- BMC Version 1.65 (Build ID: AFBT18J) as a minimum BMC firmware version.
- UEFI Version 1.11 (Build ID: AFE114G)
- Boot order priority needs to be set to hard drive UEFI
See below the server firmware versions used for validation
Type | Status | Version | Build | Release Date |
---|---|---|---|---|
BMC | Active | 1.65 | AFBT18J | 2022-01-13 |
UEFI | Active | 1.11 | AFE114G | 2021-12-06 |
LXPM | Active | 3.09 | AXWL110F | 2021-07-16 |
UEFI | Active | 1.00 | CME102Q | 2021-12-06 |
Once these requirements are met, you need to validate that the EXT media type is the first media listed on that server, since ZTP will try to insert the ISO generated for the installation on the first available virtual media.
Before license upgrade to enterprise:
curl https://192.168.53.146/redfish/v1/Managers/1/VirtualMedia --user USERID:PASSWD --insecure | jq % Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 872 0 872 0 0 2319 0 --:--:-- --:--:-- --:--:-- 2325
{
"Members": [
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT4"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote4"
After license Upgrade to enterprise:
$ curl https://192.168.53.147/redfish/v1/Managers/1/VirtualMedia --user USER:PASSWD --insecure | jq
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 872 0 872 0 0 3760 0 --:--:-- --:--:-- --:--:-- 3758
{
"Name": "VirtualMediaCollection",
"@odata.type": "#VirtualMediaCollection.VirtualMediaCollection",
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia",
"Members@odata.count": 10,
"Members": [
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/EXT4"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote2"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote3"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/Remote4"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC1"
},
{
"@odata.id": "/redfish/v1/Managers/1/VirtualMedia/RDOC2"
}
As you can see from the above outputs, the virtual media type EXT is now changed to the first one listed. The agent will be able to insert the media into one of the EXT media type available using the PATCH method with Redfish + HTTPS protocol.
ACM+ZTP implementation
Once the server requirements above are met, you are ready to deploy SNO or compact clusters using ZTP.
You can follow the below links for this implementation:
- ztp-deployment-disconnected .
Version of software used
OCP version | ACM version |
---|---|
4.9.18 | 2.4.3 |
Appendix
Below is the BOM for the servers tested.
- ThinkEdge SE450
Type | Description | Part Number | Quantity | Comments |
---|---|---|---|---|
CPU | Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz | 3230 3332 3237 3430 (20322740) | 32 | |
Storage | 480GB M.2 SATA SSD | SSS7A23277 | 2 | |
Storage | 1.92TB NVMe SSD | 3SSS7A43122 | 2 | |
PCI card | Intel(R) E810-DA2 10/25GbE SFP28 2-Port PCIe Ethernet Adapter | 02JK219 | 2 | |
PCI card | Broadcom 57454 10GBASE-T 4-port PCIe Ethernet Adapter | 01PE628 | 2 | |
Memory | DDR4 - 32GB | HMAA4GR7AJR8N-XN | 12 | 8 out of 12 Installed |
- ThinkSystem SR630 V2
Type | Description | Part Number | Quantity | Comments |
---|---|---|---|---|
CPU | Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz | 3230 3332 3237 3430 (20322740) | 32 | 1 out of 2 Installed |
Storage | 480GB M.2 SATA SSD | SSS7A23277 | 2 | |
Storage | 1.92TB NVMe SSD | 3SSS7A43122 | 2 | |
PCI card | Intel(R) E810-DA2 10/25GbE SFP28 2-Port PCIe Ethernet Adapter | 02JK219 | 2 | |
PCI card | Broadcom 57454 10GBASE-T 4-port PCIe Ethernet Adapter | 01PE628 | 2 | |
Memory | DDR4 - 32GB | HMAA4GR7AJR8N-XN | 12 | 8 out of 12 Installed |
Comments