Connect Solaris 10 to NetApp filer using Emulex single port HBAs.

Hi,

I'm connecting a Solaris 10 server to a Netapp filer with two single port Emulex (Sun StorageTek PCI-X Enterprise 4GB FC HBA) HBAs. After physically installing both these HBAs what do I ned to do within Solaris 10 to enable them and configure them with persistent bindings.

Do I need to install that 'lputil' application in order to configure persistent bindings? Also how do I configure multipathing? Please let me know.

Thanks for your help.

does your system see the devices? did you install and boot -r ?

next you'll need the emulex drivers. if you bought it outta the box, grab the software. otherwise go to emulex site. you should install those packages. lputil, emlxinfo, emulexadm and so on. check out Sun StorageTek Enterprise PCI-X 4 Gb FC Single and Dual Port Emulex Host Bus Adapters Insallation and Basic Interoperability Guide

as for mpxio... check out C H A P T E R 3 - Administering Multipathing Devices Through mpathadm Commands

that should get you going.

Hi Pupp,

Thanks for your reply. I have worked through the documentation which was really helpful. My problem now is that lptuil does not recognise the two HBAs I have installed. When I run the lputil utility it returns nothing. My system does see the devices. I have run the utility /opt/EMLXemlxu/bin/emlxdrv. Below is what it sees. Because both the HBA's are LP11000-S, I cannot bind the lpfc driver to that device. They can only use the emulex driver.

lpfc fd00 no no no LP11000 and LP11002
lpfc fe00 no no no LPe11000,LPe11002 and LPe11004
emlxs fc10 yes no yes LP11000-S and LP11002-S (emlxs only)

emlxdrv> set_lpfc fc10

ERROR: lpfc cannot bind to a Sun device (fc10).

I now need to know how to configure this HBA (LP11000-S) for persistent bindings to a NetApp filer? Any ideas?

Thanks.

Lets see what we got first so we can help you out a little more :smiley:

issue a `modinfo` and let see what drivers the kernel is trying to use.
issue a `prtconf` and this should give us if the hba is sd or ssd (not at work so i can't be 100% sure. if its not the right command, i can post a bit later with what i'm looking for).

my thoughts are that you are trying to bind a lpfc to an sfs (emlx) driver. so issue a:

set_emlxs fc10

i maybe wrong but i think you can also issue

set_emlx_sun

and this will bind emlx sfs drivers (not native leadville) to all sun branded devices. i believe the '-s' at the end of LP11000-S means its a sun-branded device.

see if this helps you. also, i think there will be a situation were when you view the physical device path, you will see lpfc even though you have loaded emlx drivers. however, there are two ways of changing this. one is at the OBP and the other can be done without restarting the box. but if/when you get there... lets figure that out. :b:

modinfo indicates that I am using the emlxs driver

111 7bac2000 245e28 281 1 emlxs (SunFC emlxs FCA v20060920-2.11l)

prtconf command returns:

SUNW,emlxs, instance #0
fp (driver not attached)
disk (driver not attached)
fp, instance #0 (driver not attached)
pci, instance #8
SUNW,emlxs, instance #1
fp (driver not attached)
disk (driver not attached)
fp, instance #1
ssd, instance #0
ssd, instance #1
ssd, instance #2
ssd, instance #3

I have run the set_emlxs fc10 command and got the following output.

emlxdrv> set_emlxs fc10

NOTICE: emlxs driver already bound to this device (fc10).

Also I can see the LUNs on the filer at the moment as well. So this is working.

# format
Searching for disks...done

  1. c3t500A09829647B92Dd1 <NETAPP-LUN-0.2-20.00GB>
    /pci@1f,700000/pci@0,2/SUNW,emlxs@1/fp@0,0/ssd@w500a09829647b92d,1

Because I can't use lputil I don't know how to persistently bind the LUNs.

In the emlxdrv utility, it states that LP11000-S and LP11002-S are emlxs only. Does this mean I cannot bind lpfc to this adapter at all?

Thanks

the emulex lputil (including hbanyware util) is only for lpfc devices. in order for you to work with the sfs drivers you will use all the emulex provided utils

so there are two drivers:

  1. emulex sfs fca (emlxs) <--- this is leadville driver (which i wrote wrongly in the other post. sorry about that!!!)
  2. emulex lpfc

sun-branded emulex hbas are only supported by SFS drivers only. lpfc won't load.

so, by your output, it looks as if all hbas are picking up the sfs driver which is good.

i believe you need to use cfgadm to configure this and then update your /etc/vfstab with the ssd pathname.

look at the 25th page of this doc.
http://www-dl.emulex.com/support/solaris/sfs/230g_release/manual.pdf

That's great Pupp. I will have a look through this document to see if it helps. Thanks for your help so far.