How to add/remove a vdisk to/from a guest LDom dynamically


Introduction to Virtual Disks

 vdiskvirtual disk contains two components: the virtual disk itself as it appears in a domain guest, and the virtual disk backend, which is where data is stored and where virtual I/O ends up. The virtual disk backend is exported from a service domain by the virtual disk server (vds) driver. The vds driver communicates with the virtual disk client (vdc) driver in the guest domain through the hypervisor using a logical domain channel (LDC). Finally, a virtual disk appears as /dev/[r]dsk/cXdYsZ devices in the guest domain.

Prerequisite Service

Before you proceed to add or remove the Vdisks dynamically to the Guest domains, please make sure the SMF service svc:/platform/sun4v/drd must be online in Guest LDom

Guest LDom# svcs drd
STATE          STIME    FMRI
online         Aug_07   svc:/platform/sun4v/drd:default

If the service not online, you will receive the following errors when you try to add the disk devices to guest domains

pdom#  ldm add-vdisk zvol4  zvol4@primary-vds0 g003
Guest LDom returned the following reason for failing the operation:
Cannot communicate with reconfiguration daemon (drd) in target domain.
drd  SMF service may not be enabled.LDom g003 did not respond to request to configure VIO device


Verifying existing vdisks

Check/verify vdisks on Guest LDom

guest# format -e < /dev/null
Searching for disks…done AVAILABLE DISK SELECTIONS:
       0. c0d0 <SUN-DiskImage-20GB cyl 566 alt 2 hd 96 sec 768>
Specify disk (enter its number):


Check/verify vdisks on primary domain for a certain Guest LDom

primary# ldm list -o disk  ldg1
vdisk1           vol1@primary-vds0       0    disk@0  primary

Adding a vdisk to a Guest LDom

Adding ZVOL storage as vdisk

primary# zpool list
ldom   86.5G  14.6G  71.9G  16%  1.00x    ONLINE  –
rpool   136G  20.5G   115G  15%  1.00x ONLINE – primary# zfs create -V 5G ldom/disk2
primary# ldm add-vdsdev /dev/zvol/dsk/ldom/disk2 disk2@primary-vds0
primary# ldm add-vdisk disk2 disk2@primary-vds0 ldg1

Adding a file on UFS storage as Vdisk

primary# mkfile 5g /ldom/disk2
primary# ldm add-vdsdev /ldom/disk2 disk2@primary-vds0
primary# ldm add-vdisk disk2 disk2@primary-vds0 ldg1

Adding a whole disk as vdisk

primary# ldm add-vdsdev /dev/dsk/c1t0d0s2 disk2G@primary-vds0
primary# ldm add-vdisk disk2 disk2@primary-vds0 ldg1

Verification vdisk addition

Verifying the Disk addition from Primary Domain

primary# ldm list -o disk  ldg1
ldg1 DISK NAME        VOLUME     TOUT ID   DEVICE  SERVER    MPGROUP     vdisk1           vol1@primary-vds0                0    disk@0  primary
disk2            disk2@primary-vds0               1    disk@1  primary


Verify success of previous commands on Guest LDom

guest# devfsadm -v

guest# format
Searching for disks…done

       0. c0d0 <SUN-DiskImage-20GB cyl 566 alt 2 hd 96 sec 768>
       1. c0d1 <SUN-DiskImage-5GB cyl 17474 alt 2 hd 1 sec 600>
Specify disk (enter its number):


Removing vdisks dynamically from a Guest Domain

Vdisks can be removed dynamically from a Guest LDom as long as the device is not busy on Guest LDom
Successful  removal of a vdisk from Guest LDom:

primary# ldm rm-vdisk disk2 ldg1

Failing attempt to remove a vdisk from Guest LDom in case the vdisk is busy or mounted:

# ldm rm-vdisk disk2 ldg1
Guest LDom returned the following reason for failing the operation:     Resource             Information
—————-  ————————-
/dev/dsk/c0d1s0   mounted filesystem “/mnt”

VIO operation failed because device is being used in LDom ldg1
Failed to remove vdisk instance




I have started ( aka in 2009 as my own personal reference blog, and later sometime i have realized that my leanings might be helpful for other unixadmins if I manage my knowledge-base in more user friendly format. And the result is today's' You can connect me at -

Leave a Reply

Your email address will not be published. Required fields are marked *