Oracle Solaris Logical Domain – How to deploy a redundant LDOM Setup part 3

Oracle Solaris Logical Domain – How to deploy a redundant LDOM Setup part 3 (Storage Redundancy)

This will be the final update to this topic. To continue to what was left off in part 2, once the network portion is being configured, you need to start working on the storage portion.

Assumptions;

  1. SAN switch zoning and appropriate LUN masking has been configured.
  2. Each of the LDOMs will own 2 LUN, rdisk & ddisk

Ensure that you are able to detect all the LUNs from the Control Domain (CD). 

# luxadm probe
No Network Array enclosures found in /dev/es
Found Fibre Channel device(s):
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E71B0003d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E6280001d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E7050002d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E7390004d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E7530005d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E7720006d0s2
 Node WWN:20000024ff3e19db Device Type:Disk device
 Logical Path:/dev/rdsk/c0t600144F0BC6CD8E600004FE3E7890007d0s2

Create the Virtual Disk Server
A few things to note here;

  1. mpgroup must be unique for each LUN, different LUN cannot be using the same MP group.
  2. add-vdsdev is ran for both primary VDS and secondary VDS from the Control Domain
# ldm add-vds primary-vds1 primary
# ldm add-vds secondary-vds1 secondary
# ldm add-vds primary-vds2 primary
# ldm add-vds secondary-vds2 secondary

Add a Device to a Virtual Disk Server

 
# ldm add-vdsdev mpgroup=L1_rdsk /dev/dsk/cXtXS2 pri-L1-ddisk@primary-vds1
# ldm add-vdsdev mpgroup=L1_rdsk /dev/dsk/cXtXS2 sec-L1-ddisk@secondary-vds1
# ldm add-vdsdev mpgroup=L1_ddsk /dev/dsk/cXtYS2 pri-L1-ddisk@primary-vds2
# ldm add-vdsdev mpgroup=L1_ddsk /dev/dsk/cXtYS2 sec-L1-ddisk@secondary-vds2

Add the Virtual Disk to the Guest LDOM (Even though you exported the vdsdev twice, but you only need to add the vdisk from a SINGLE vds)

# ldm add-vdisk id=1 rootdisk pri-L1-rdisk@primary-vds1 asiapcsovn2-L1
# ldm add-vdisk id=2 datadisk pri-L1-ddisk@primary-vds2 asiapcsovn2-L1

The final configuration should look like this =)

# ldm list-services
VCC
 NAME LDOM PORT-RANGE
 primary-vcc0 primary 5000-5100
VSW
 NAME LDOM MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
 primary-vsw0 primary 00:14:4f:fb:d4:ea aggr0 0 switch@0 1 1500 on
VSW
 NAME LDOM MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
 secondary-vsw0 secondary 00:14:4f:f9:2c:b7 aggr1 0 switch@0 1 1500 on
VDS
 NAME LDOM VOLUME OPTIONS MPGROUP DEVICE
 primary-vds1 primary pri-L1-rdisk L1_rdsk /dev/dsk/c0t600144F0BC6CD8E600004FFBDF420001d0s2
 primary-vds2 primary pri-L1-ddisk L1_ddsk /dev/dsk/c0t600144F0BC6CD8E600004FFBE0500004d0s2
VDS
 NAME LDOM VOLUME OPTIONS MPGROUP DEVICE
 secondary-vds1 secondary sec-L1-rdisk L1_rdsk /dev/dsk/c0t600144F0BC6CD8E600004FFBDF420001d0s2
 secondary-vds2 secondary sec-L1-ddisk L1_ddsk /dev/dsk/c0t600144F0BC6CD8E600004FFBE0500004d0s2
Please remember to back up the LDOM configurations in the control domain.

Do take note that ALL the guest domains configuration are done at the CD. The IO domain are basically pass through for redundancy purpose. So if your CD is down, your guest domains are not impacted but you are unable to start/stop or configure any guest domains. 

I do hope you guys find these documents helpful!

Advertisements

7 thoughts on “Oracle Solaris Logical Domain – How to deploy a redundant LDOM Setup part 3”

  1. Hi thanks for the nice article it really helpful
    can you please explain how to add the shared LUN to 2 different Ldoms, in cluster enviorment?
    or what is the best practice.?
    Thanks and cheers

    1. Hello,

      It is not possible to add export the same LUN to 2 different LDOM in the same control domain. I believe an error will occur when you try to do that. I remember testing that out. However, it is possible to export the same LUN to 2 different LDOM in 2 different box.

      I don’t think there’s a best practice. It’s more of what are you trying to achieve. It’s silly to run a cluster environment in the same box. It’s a waste of resources when the Solaris OS is already isolated from each other. You need hardware redundancy rather than OS redundancy in this case.

      Regards.

  2. good explanation.How to find out which virtual disk server is being used for the guest domain if we have 2 vds services are configured for each disk..?

    1. Hari,

      #ldm list-services

      The command above will show you everything you need to know about the domain. It will show both the vds services.

  3. Hi Shan,

    Could you please share how to export the same LUN to 2 different LDOM in 2 different box.

    Thanks
    Kesava

    1. Hi Kesava,

      This is done at the storage level. Just zone the LUN to 2 different box. Create the vds accordingly.

  4. Hi Weishan,

    What if I use a raw device?
    ldm add-vdsdev /dev/rdisk/xxxxxxxxxxs2 xxxx@xxxxvol0

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s