VM Creation Issue

Problem: I cannot create create a virtual machine in xcp-ng due to a vdi creation error.

I have XO trial and community edition on another xcp-ng host and get the same error in both. I’ve installed xcp-ng center on a windows computer and tried with the same error.

I removed the storage repository and created it again as an LVM and ext4, same error.

Server: Dell PowerEdge R730
Dual Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
512GB of Multi-bit ECC Ram
Dell Perc 730 Mini (Embedded)
5 HGST HUS726060AL4210, 6TB, 4kn drives, SAS, 12gb/s
Raid 6, 16765.50GB, Read Ahead, Write Back, Stripe Size: 128K
1 Virtual Disk, Fully Initialized

All 5 of these drives have been ran through full badblocks testing, short SMART, Long SMART and have no errors.

I put the Perc the in HBA mode and passed all drive through to no avail. Installed an H330 and passed all drives through to no avial.

I pulled them and installed a single 4TB Dell Constellation ES.3 drive model ST4000NM0023 and everything is fine.

Below is some information that may help with my issue. After googling the the error a lot, Im at a total loss for what could be the issue. Any help is appreciated.

[07:22 Server2 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.9G 0 3.9G 0% /dev
tmpfs 3.9G 88K 3.9G 1% /dev/shm
tmpfs 3.9G 11M 3.9G 1% /run
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/sda1 18G 2.0G 15G 12% /
xenstore 3.9G 0 3.9G 0% /var/lib/xenstored
/dev/sda5 3.9G 16M 3.6G 1% /var/log
/dev/sda4 512M 3.1M 509M 1% /boot/efi
tmpfs 792M 0 792M 0% /run/user/0
//10.115.10.11/isostorage 26T 30G 26T 1% /run/sr-mount/4fcf4604-ee62-c837-8ec9-eacfba83f9ee

[07:25 Server2 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 16.4T 0 disk
├─sda4 8:4 0 512M 0 part /boot/efi
├─sda2 8:2 0 18G 0 part
├─sda5 8:5 0 4G 0 part /var/log
├─sda3 8:3 0 16.3T 0 part
│ └─VG_XenStorage–2259657c–ea81–8fa3–02ec–8398bf373581-MGT 253:0 0 4M 0 lvm
├─sda1 8:1 0 18G 0 part /
└─sda6 8:6 0 1G 0 part [SWAP]

[09:12 Server2 ~]# xe sr-list
uuid ( RO) : 94e4ef20-4070-2e2d-0788-06d4ac3bbe76
name-label ( RW): Removable storage
name-description ( RW):
host ( RO): Server2
type ( RO): udev
content-type ( RO): disk

uuid ( RO) : 4fcf4604-ee62-c837-8ec9-eacfba83f9ee
name-label ( RW): ISOstorage
name-description ( RW): ISO Storage
host ( RO): Server2
type ( RO): iso
content-type ( RO): iso

uuid ( RO) : 5e5235f1-f8cc-6846-f417-9dafb2cd5dec
name-label ( RW): DVD drives
name-description ( RW): Physical DVD drives
host ( RO): Server2
type ( RO): udev
content-type ( RO): iso

uuid ( RO) : 3c4ef9e0-5200-c769-2e05-458b3c4b9e85
name-label ( RW): XCP-ng Tools
name-description ( RW): XCP-ng Tools ISOs
host ( RO): Server2
type ( RO): iso
content-type ( RO): iso

uuid ( RO) : 2259657c-ea81-8fa3-02ec-8398bf373581
name-label ( RW): Local Storage
name-description ( RW): Local Storage
host ( RO): Server2
type ( RO): lvm
content-type ( RO): user

#######Error copy from XO#########################################

vm.create
{
“clone”: true,
“existingDisks”: {},
“installation”: {
“method”: “cdrom”,
“repository”: “a0382b05-9367-4e0d-b4b6-08eb8509bf6e”
},
“name_label”: “debtest”,
“template”: “328edd5e-a273-83f5-4138-e637a6ae07b5-07d91aaa-43f7-430a-bf84-0edb6714df0f”,
“VDIs”: [
{
“bootable”: true,
“device”: “0”,
“size”: 53687091200,
“type”: “system”,
“SR”: “2259657c-ea81-8fa3-02ec-8398bf373581”,
“name_description”: “debtest”,
“name_label”: “debtest”
}
],
“VIFs”: [
{
“network”: “63dfdf13-b3eb-47b1-0d37-cdf4ffb14615”,
“allowedIpv4Addresses”: ,
“allowedIpv6Addresses”:
}
],
“coresPerSocket”: 3,
“CPUs”: “6”,
“cpusMax”: 6,
“cpuWeight”: null,
“cpuCap”: null,
“name_description”: “debtest”,
“memory”: 68719476736,
“bootAfterCreate”: true,
“copyHostBiosStrings”: false,
“createVtpm”: false,
“destroyCloudConfigVdiAfterBoot”: false,
“secureBoot”: false,
“share”: false,
“coreOs”: false,
“tags”: ,
“hvmBootFirmware”: “bios”
}
{
“code”: “SR_BACKEND_FAILURE_78”,
“params”: [
“”,
“VDI Creation failed [opterr=error 22]”,
“”
],
“call”: {
“method”: “VDI.create”,
“params”: [
{
“name_description”: “debtest”,
“name_label”: “debtest”,
“other_config”: {},
“read_only”: false,
“sharable”: false,
“SR”: “OpaqueRef:53308420-6892-462a-b274-db659174dd47”,
“type”: “user”,
“virtual_size”: 53687091200
}
]
},
“message”: “SR_BACKEND_FAILURE_78(, VDI Creation failed [opterr=error 22], )”,
“name”: “XapiError”,
“stack”: “XapiError: SR_BACKEND_FAILURE_78(, VDI Creation failed [opterr=error 22], )
at Function.wrap (file:///opt/xo/xo-builds/xen-orchestra-202401122008/packages/xen-api/_XapiError.mjs:16:12)
at file:///opt/xo/xo-builds/xen-orchestra-202401122008/packages/xen-api/transports/json-rpc.mjs:35:21”
}

[09:32 Server2 ~]# tail -n 75 /var/log/SMlog

[09:32 Server2 ~]# tail -n 75 /var/log/SMlog
Mar 1 09:32:18 Server2 SM: [12275] sr_scan {‘sr_uuid’: ‘2259657c-ea81-8fa3-02ec-8398bf373581’, ‘subtask_of’: ‘DummyRef:|3f0df967-5074-4cf9-b081-86b66da43d50|SR.scan’, ‘args’: , ‘host_ref’: ‘OpaqueRef:07948dd8-0995-46e7-85b1-1c3e384de893’, ‘session_ref’: ‘OpaqueRef:6a4041fb-c1b9-45f6-ab61-cf93b555a005’, ‘device_config’: {‘device’: ‘/dev/sda3’, ‘SRmaster’: ‘true’}, ‘command’: ‘sr_scan’, ‘sr_ref’: ‘OpaqueRef:53308420-6892-462a-b274-db659174dd47’}
Mar 1 09:32:18 Server2 SM: [12275] LVHDSR.scan for 2259657c-ea81-8fa3-02ec-8398bf373581
Mar 1 09:32:18 Server2 SM: [12275] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] [‘/sbin/vgs’, ‘–noheadings’, ‘–nosuffix’, ‘–units’, ‘b’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:18 Server2 SM: [12275] pread SUCCESS
Mar 1 09:32:18 Server2 SM: [12275] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] LVMCache: refreshing
Mar 1 09:32:18 Server2 SM: [12275] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] [‘/sbin/lvs’, ‘–noheadings’, ‘–units’, ‘b’, ‘-o’, ‘+lv_tags’, ‘/dev/VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:18 Server2 SM: [12275] pread SUCCESS
Mar 1 09:32:18 Server2 SM: [12275] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] [‘/sbin/vgs’, ‘–noheadings’, ‘–nosuffix’, ‘–units’, ‘b’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:18 Server2 SM: [12275] pread SUCCESS
Mar 1 09:32:18 Server2 SM: [12275] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12275] lock: opening lock file /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/running
Mar 1 09:32:18 Server2 SM: [12275] lock: tried lock /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/running, acquired: True (exists: True)
Mar 1 09:32:18 Server2 SM: [12275] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/running
Mar 1 09:32:18 Server2 SM: [12275] Kicking GC
Mar 1 09:32:18 Server2 SMGC: [12275] === SR 2259657c-ea81-8fa3-02ec-8398bf373581: gc ===
Mar 1 09:32:18 Server2 SMGC: [12323] Will finish as PID [12324]
Mar 1 09:32:18 Server2 SM: [12324] lock: closed /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SMGC: [12275] New PID [12323]
Mar 1 09:32:18 Server2 SM: [12324] lock: opening lock file /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/running
Mar 1 09:32:18 Server2 SM: [12324] lock: opening lock file /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/gc_active
Mar 1 09:32:18 Server2 SM: [12275] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:18 Server2 SM: [12306] sr_update {‘sr_uuid’: ‘4fcf4604-ee62-c837-8ec9-eacfba83f9ee’, ‘subtask_of’: ‘DummyRef:|c0a280c5-a5fa-4fe5-a205-36b31439ba4e|SR.stat’, ‘args’: , ‘host_ref’: ‘OpaqueRef:07948dd8-0995-46e7-85b1-1c3e384de893’, ‘session_ref’: ‘OpaqueRef:89598950-e84a-47c7-a25e-a7b0a83b921d’, ‘device_config’: {‘username’: ‘tns2099’, ‘vers’: ‘3.0’, ‘cifspassword_secret’: ‘481d84d4-ac6d-5e01-29f4-40833622b830’, ‘SRmaster’: ‘true’, ‘type’: ‘cifs’, ‘location’: ‘//10.115.10.11/isostorage’}, ‘command’: ‘sr_update’, ‘sr_ref’: ‘OpaqueRef:a3c8fc40-07b9-4dad-ad1b-071cef37a713’}
Mar 1 09:32:18 Server2 SM: [12324] lock: opening lock file /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:18 Server2 SM: [12324] LVMCache created for VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581
Mar 1 09:32:18 Server2 SM: [12324] lock: tried lock /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/gc_active, acquired: True (exists: True)
Mar 1 09:32:18 Server2 SM: [12324] lock: tried lock /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr, acquired: True (exists: True)
Mar 1 09:32:18 Server2 SM: [12324] LVMCache: refreshing
Mar 1 09:32:18 Server2 SM: [12324] lock: opening lock file /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12324] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:18 Server2 SM: [12324] [‘/sbin/lvs’, ‘–noheadings’, ‘–units’, ‘b’, ‘-o’, ‘+lv_tags’, ‘/dev/VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12324] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12324] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SMGC: [12324] SR 2259 (‘Local Storage’) (0 VDIs in 0 VHD trees): no changes
Mar 1 09:32:19 Server2 SM: [12324] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:19 Server2 SM: [12324] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12324] [‘/sbin/vgs’, ‘–noheadings’, ‘–nosuffix’, ‘–units’, ‘b’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12324] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12324] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12324] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12324] [‘/sbin/vgs’, ‘–noheadings’, ‘–nosuffix’, ‘–units’, ‘b’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12324] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12324] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SMGC: [12324] No work, exiting
Mar 1 09:32:19 Server2 SMGC: [12324] GC process exiting, no work left
Mar 1 09:32:19 Server2 SM: [12324] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/gc_active
Mar 1 09:32:19 Server2 SMGC: [12324] SR 2259 (‘Local Storage’) (0 VDIs in 0 VHD trees): no changes
Mar 1 09:32:19 Server2 SM: [12352] lock: opening lock file /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:19 Server2 SM: [12352] LVMCache created for VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581
Mar 1 09:32:19 Server2 SM: [12352] lock: opening lock file /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12352] [‘/sbin/vgs’, ‘–readonly’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12352] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12352] lock: acquired /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:19 Server2 SM: [12352] LVMCache: will initialize now
Mar 1 09:32:19 Server2 SM: [12352] LVMCache: refreshing
Mar 1 09:32:19 Server2 SM: [12352] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12352] [‘/sbin/lvs’, ‘–noheadings’, ‘–units’, ‘b’, ‘-o’, ‘+lv_tags’, ‘/dev/VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12352] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12352] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12352] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:19 Server2 SM: [12352] Entering _checkMetadataVolume
Mar 1 09:32:19 Server2 SM: [12352] lock: acquired /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr
Mar 1 09:32:19 Server2 SM: [12352] sr_update {‘sr_uuid’: ‘2259657c-ea81-8fa3-02ec-8398bf373581’, ‘subtask_of’: ‘DummyRef:|e8e3e651-9b72-45a4-8e3c-eaf352526108|SR.stat’, ‘args’: , ‘host_ref’: ‘OpaqueRef:07948dd8-0995-46e7-85b1-1c3e384de893’, ‘session_ref’: ‘OpaqueRef:5b840695-7dff-4bf2-8c07-8c22a983403d’, ‘device_config’: {‘device’: ‘/dev/sda3’, ‘SRmaster’: ‘true’}, ‘command’: ‘sr_update’, ‘sr_ref’: ‘OpaqueRef:53308420-6892-462a-b274-db659174dd47’}
Mar 1 09:32:19 Server2 SM: [12352] [‘/sbin/vgs’, ‘–readonly’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12352] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12352] Setting virtual_allocation of SR 2259657c-ea81-8fa3-02ec-8398bf373581 to 0
Mar 1 09:32:19 Server2 SM: [12352] lock: acquired /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12352] [‘/sbin/vgs’, ‘–noheadings’, ‘–nosuffix’, ‘–units’, ‘b’, ‘VG_XenStorage-2259657c-ea81-8fa3-02ec-8398bf373581’]
Mar 1 09:32:19 Server2 SM: [12352] pread SUCCESS
Mar 1 09:32:19 Server2 SM: [12352] lock: released /var/lock/sm/.nil/lvm
Mar 1 09:32:19 Server2 SM: [12352] Updating metadata : {‘objtype’: ‘sr’, ‘name_description’: ‘Local Storage’, ‘name_label’: ‘Local Storage’}
Mar 1 09:32:19 Server2 SM: [12352] entering updateSR
Mar 1 09:32:19 Server2 SM: [12352] lock: released /var/lock/sm/2259657c-ea81-8fa3-02ec-8398bf373581/sr

SR_BACKEND_FAILURE_78 Sounds more like you don’t have the storage properly setup and it’s in a read only mode.

Tom,

Thanks for the reply.

I’ve run across you mentioning this to someone and looked for something pointing to this but I cant figure out where the read only mode would be coming from if it is the case. Something set in xcp-ng or misconfigured raid 6 virtual disk on dell server?

When I did a fresh install of xcp-ng, there were no errors and its installed on the same virtual disk that I’m selecting for VM installs.

This makes my 4th deployment of xcp-ng on Dell Poweredge devices with HW raid and passthrough since Gen 11 and its the only time I’ve ever had an issue.