Unable to get EMC storage Lun's visible under veritas control in Linux.

 

I was performing Storage migrations for Linux RHEL 5.x and 6.x having VXVM. Storage have provided the Lun’s and confirmed all is okay from their end. But I was unable to get them visible on Veritas level though the same were visible at OS level. The only solution at that time was to reboot the box and get the device tree rebuild by OS itself to get Lun’s visible to veritas, I did the same and Lun’s became visible at veritas level.

PS: Though the same can be done by restarting the veritas daemon but our FS were using veritas so downtime will be required at anycase. So I proceeded with clean reboot instead of daemon restart.

I again got the same issue with next set of server             s and I start digging out the process of getting Lun’s visible at veritas level without reboot. After little work I found the way which I would like to share with all, it may help you at some point of time:

1.) Storage details are below:

 

root@yogesh## rescan-scsi-bus.sh

OR SCAN each and every host under directory /sys/class/scsi_host/host#. eg:(/sys/class/scsi_host/host#/scan)

3.) Storage details after scan are below, VRAID is the new :

root@yogesh## /opt/sysadmin/local/storage_scan_host_bus.sh

INFO: lin: calling /opt/sysadmin/local/inq

/dev/sda               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdb               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160                                 V 
/dev/sdc               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdd               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160
/dev/sde               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdf               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdg               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdh               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdi               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdj               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdk               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdl               :DGC     :VRAID           :0532  :195190C9   :    20971520

4.) To get the disks under veritas:

root@yogesh## vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
cciss/c0d0   auto:none       –            –            online invalid
emc0_3f7a    auto:cdsdisk    emc0_3f7a    gurkuldg      online
emc0_3f79    auto:cdsdisk    emc0_3f79    gurkuldg      online

root@yogesh## vxdctl enable  or  vxdisk scandisks

root@yogesh## vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
cciss/c0d0   auto:none       –            –            online invalid
emc_clariion0_1561 auto            –            –            error    <<<— One disk is visible
emc0_3f7a    auto:cdsdisk    emc0_3f7a    gurkuldg      online
emc0_3f79    auto:cdsdisk    emc0_3f79    gurkuldg      online

PS: One of the assigned Lun at veritas level is visible but one is still missing.

5.) No. of paths for disk emc_clariion0_1561 are:

root@yogesh## vxdisk list emc_clariion0_1561 | tail -4
sdk     state=enabled   type=primary
sdl     state=enabled   type=secondary
sdi     state=enabled   type=primary
sdj     state=enabled   type=secondary

6.) We will flush the buffer and delete the Lun’s (devices) which are visible to OS level but are not visible to veritas level.

root@yogesh## for i in `cat`; do blockdev –flushbufs $i;done <—Luns for which veritas logical device is not visible
/dev/sde
/dev/sdf
/dev/sdg
/dev/sdh

root@yogesh## for i in `cat`; do echo 1 > /sys/block/$i/device/delete; done
sde
sdf
sdg
sdh

7.) INQ output and rescanning again to build device tree:

root@yogesh## /opt/sysadmin/local/inq
Inquiry utility, Version V7.3-1159 (Rev 1.0)      (SIL Version V7.2.1.0 (Edit Level 1159)
Copyright (C) by EMC Corporation, all rights reserved.
For help type inq -h.

………

———————————————————————————
DEVICE                 :VEND    :PROD            :REV   :SER NUM    :CAP(kb)
———————————————————————————
/dev/sda               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdb               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160
/dev/sdc               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdd               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160
/dev/sdi               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdj               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdk               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdl               :DGC     :VRAID           :0532  :195190C9   :    20971520

root@yogesh## rescan-scsi-bus.sh

OR SCAN each and every host under directory /sys/class/scsi_host/host#.

8.) Device tree build with sucess:

root@yogesh## /opt/sysadmin/local/inq
Inquiry utility, Version V7.3-1159 (Rev 1.0)      (SIL Version V7.2.1.0 (Edit Level 1159)
Copyright (C) by EMC Corporation, all rights reserved.
For help type inq -h.

/dev/sda               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdb               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160
/dev/sdc               :EMC     :SYMMETRIX       :5773  :0903f79000 :    20972160
/dev/sdd               :EMC     :SYMMETRIX       :5773  :0903f7a000 :    20972160
/dev/sde               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdf               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdg               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdh               :DGC     :VRAID           :0532  :185190C9   :    20971520
/dev/sdi               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdj               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdk               :DGC     :VRAID           :0532  :195190C9   :    20971520
/dev/sdl               :DGC     :VRAID           :0532  :195190C9   :    20971520

9.) Veritas level scanning to get Lun’s visible at OS level:

root@yogesh## vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
cciss/c0d0   auto:none       –            –            online invalid
emc_clariion0_1561 auto            –            –            error
emc0_3f7a    auto:cdsdisk    emc0_3f7a    gurkuldg      online
emc0_3f79    auto:cdsdisk    emc0_3f79    gurkuldg      online

root@yogesh##
root@yogesh## vxdctl enable

root@yogesh## vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
cciss/c0d0   auto:none       –            –            online invalid
emc_clariion0_1560 auto            –            –            error  <<<<—- New device visible at veritas level
emc_clariion0_1561 auto            –            –            error
emc0_3f7a    auto:cdsdisk    emc0_3f7a    gurkuldg      online
emc0_3f79    auto:cdsdisk    emc0_3f79    gurkuldg      online
root@yogesh##

PS: Now disks are visble to OS and Veritas level. Proceed with veritas disksetup and migration part.

Hope this will help to all champs to get disks visible at OS level in RHEL without reboot.

Yogesh Raheja

Yogesh working as a Consultant in Unix Engineering by profession. And he has multiple years experience in Solaris, Linux , AIX and Veritas Administration. He has been certified for SCSA9, SCSA10, SCNA10, VXVM, VCS, ITILv3. He is very much passionate about sharing his knowledge with others. Specialties: Expertize in Unix/Solaris Server, Linux (RHEL), AIX, Veritas Volume Manager, ZFS, Liveupgrades, Storage Migrations, Cluster deployment (VCS and HACMP) and administration and upgrade on Banking, Telecom, IT Infrastructure, and Hosting Services.

You may also like...

6 Responses

  1. Kiran M.S says:

    Very good info

  2. Rahul says:

    Hi Friends, I also faced the same issue where newly assigned disks are visible at OS level but now able to see at VXVM level, so I simply run the command #vxdctl enable and after this I was able to see the new LUN at VXVM level,
    hence above commands are good and quit usefull. Thanks for posting and updating to all.
    Regards,
    Rahul Rai

    • Ramdev Ramdev says:

      Hi Rahul, Yes, ideally the vxdctl enable command will bring the disks visible to Veritas. And this post is about how to troubleshoot when the vxdctl enable doesn’t work.

  3. Nitin says:

    Nice document.. Thanks for Posting

  1. September 17, 2015

    […] Read – Unable to get EMC storage Lun’s visible under veritas control in Linux […]

  2. September 18, 2015

    […] volume Read – Replacing a failed boot disk Read – Recover Root Mirror from Backup Read – Unable to get EMC storage Lun’s visible under veritas control in Linux. Read – […]

What is in your mind, about this post ? Leave a Reply

Close
  Our next learning article is ready, subscribe it in your email

What is your Learning Goal for Next Six Months ? Talk to us