Saturday, November 15, 2008

MPXIO In Action

My Environment

Brocade switch:
Port 4, 5 connected to HBA and port 10, 11 connected to storage.

How i simulate?
1. Initiate a file copy process.
2. Simulate link breakdown by disable (portdisable) port 4 while file is still copying.
3. Simulate link recovery by enable back (portenable) port 4 while file is still copying.

From the video, you can see the drop of throughput on port 4 when i disable port 4 and the throughput on port 4 climbs up again when i enable back port 4.

Posted by at No comments:

Friday, November 14, 2008

Configuring MPXIO

My Environment:
Server: Sun Blade T6320
Storage: EMC CX3-20

Steps taken:

  • Use format to inspect the luns that had been assigned to your system. In my test system, disk 4,5 and disk 6,7 are actually same lun with 2 paths.
# format
Searching for disks...done


AVAILABLE DISK SELECTIONS:
0. c0t0d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@0,0
1. c0t1d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@1,0
2. c0t2d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@2,0
3. c0t3d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@3,0
4. c1t5006016841E034F6d0
/pci@0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0/ssd@w5006016841e034f6,0
5. c1t5006016841E034F6d1
/pci@0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0/ssd@w5006016841e034f6,1
6. c2t5006016941E034F6d0
/pci@0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0/ssd@w5006016941e034f6,0
7. c2t5006016941E034F6d1
/pci@0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0/ssd@w5006016941e034f6,1
Specify disk (enter its number):
  • You need the information of vendor ID and product ID and these information can be obtained through format > inquiry.
# format
Searching for disks...done


AVAILABLE DISK SELECTIONS:
0. c0t0d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@0,0
1. c0t1d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@1,0
2. c0t2d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@2,0
3. c0t3d0
/pci@0/pci@0/pci@2/LSILogic,sas@0/sd@3,0
4. c1t5006016841E034F6d0
/pci@0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0/ssd@w5006016841e034f6,0
5. c1t5006016841E034F6d1
/pci@0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0/ssd@w5006016841e034f6,1
6. c2t5006016941E034F6d0
/pci@0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0/ssd@w5006016941e034f6,0
7. c2t5006016941E034F6d1
/pci@0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0/ssd@w5006016941e034f6,1
Specify disk (enter its number):4

selecting c1t5006016841E034F6d0
[disk formatted]



FORMAT MENU:
disk - select a disk
type - select (define) a disk type
partition - select (define) a partition table
current - describe the current disk
format - format and analyze the disk
repair - repair a defective sector
label - write label to the disk
analyze - surface analysis
defect - defect list management
backup - search for backup labels
verify - read and display labels
save - save new disk/partition definitions
inquiry - show vendor, product and revision
volname - set 8-character volume name
! - execute , then return
quit
format> inquiry
Vendor: DGC
Product: DISK
Revision: 0324
format>
  • Modify /kernel/drv/scsi_vhci.conf and add the array type (product ID/vendor ID) to the device-type-scsi-options-list

#
# Copyright 2004 Sun Microsystems, Inc.  All rights reserved.
# Use is subject to license terms.
#
#pragma ident   "@(#)scsi_vhci.conf     1.9     04/08/26 SMI"
#
name="scsi_vhci" class="root";
#
# Load balancing global configuration: setting load-balance="none" will cause
# all I/O to a given device (which supports multipath I/O) to occur via one
# path.  Setting load-balance="round-robin" will cause each path to the device
# to be used in turn.
#
load-balance="round-robin";
#
# Automatic failback configuration
# possible values are auto-failback="enable" or auto-failback="disable"
auto-failback="disable";
#
# For enabling MPxIO support for 3rd party symmetric device need an
# entry similar to following in this file. Just replace the "SUN     SENA"
# part with the Vendor ID/Product ID for the device, exactly as reported by
# Inquiry cmd.
#
device-type-scsi-options-list =
"DGC     DISK", "symmetric-option";

symmetric-option = 0x1000000;
  • If there are other adapters other than FC (in my case i got SAS adapter), use the following command to reboot.

# stmsboot -D fp -e
Checking mpxio status for driver fp
WARNING: This operation will require a reboot.
Do you want to continue ? [y/n] (default: y)y
The changes will come into effect after rebooting the system.
Reboot the system now ? [y/n] (default: y)
  • After reboot, this is what i get
# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
     0. c0t0d0 
        /pci@0/pci@0/pci@2/LSILogic,sas@0/sd@0,0
     1. c0t1d0 
        /pci@0/pci@0/pci@2/LSILogic,sas@0/sd@1,0
     2. c0t2d0 
        /pci@0/pci@0/pci@2/LSILogic,sas@0/sd@2,0
     3. c0t3d0 
        /pci@0/pci@0/pci@2/LSILogic,sas@0/sd@3,0
     4. c3t600601607DA11A00E4E37EFA3C98DD11d0 
        /scsi_vhci/ssd@g600601607da11a00e4e37efa3c98dd11
     5. c3t600601607DA11A001E14AA5F3398DD11d0 
        /scsi_vhci/ssd@g600601607da11a001e14aa5f3398dd11
Specify disk (enter its number):
Posted by at No comments:

Monday, November 10, 2008

Sun Solaris 10 Network Install (LAN)

My environment:
Sun Blade T6320, Platform Group: sun4v
Install Server: x86 with Sun Solaris 10
Install Server and Client (Target system for installation) sit on the same subnet

Sun Official Documentation:

Solaris 10 6/06 Installation Guide: Network-Based Installations

http://docs.sun.com/app/docs/doc/819-5776

Steps taken applicable to my environment:

1. Create install server
# mkdir -p install_dir_path ;Create a directory to save the image
# cd /cdrom/sol_10_1008_sparc/Solaris_10/Tools  ;the keyword here is Tools folder
# ./setup_install_server install_dir_path  ;execute the script, it might take some time here

2. Modify ur hosts file (/etc/inet/hosts)at your install server.
Example, if your new client (target system for installation) is named
hostname: newsol10
IP Address: 10.0.0.123
Your hosts file (/etc/inet/hosts) should have the following entry
10.0.0.123 newsol10

3. Create a file with the following path and name -- /etc/ethers and this file should have the following entry
0:14:fc:xx:yy:zz newsol10

You can obtain your machine MAC address by looking at the information while it is booting as below:

Sun Blade T6320 Server Module, No Keyboard
Copyright 2007 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.27.10, 32640 MB memory available, Serial #xxxxyyyy.
Ethernet address 0:14:4f:xx:yy:zz, Host ID: xxxxyyyy.

or

from ILOM, type show /HOST

-> show /HOST

/HOST
Targets:
bootmode
diag

Properties:
autorestart = reset
autorunonerror = false
hypervisor_version = Hypervisor 1.5.6 2007/11/30 08:29
macaddress = 00:14:4f:xx:yy:zz
obp_version = OBP 4.27.10 2007/12/07 10:45
post_version = POST 4.27.10 2007/12/07 11:14

send_break_action = (none)
status = Running
sysfw_version = Sun System Firmware 7.0.9.c 2008/01/14 21:47


Commands:
cd
set
show

->

4. Add system to be installed using add_install_client
# cd /install_dir_path/Solaris_10/Tools
# ./add_install_client newsol10 sun4v

bash-3.00# ./add_install_client newsol10 sun4v
saving original /etc/dfs/dfstab in /etc/dfs/dfstab.orig
Adding "share -F nfs -o ro,anon=0 /solaris10sparc" to /etc/dfs/dfstab
making /tftpboot
enabling tftp in /etc/inetd.conf
Converting /etc/inetd.conf
enabling network/rarp service
enabling network/rpc/bootparams service
updating /etc/bootparams
copying boot file to /tftpboot/inetboot.SUN4V.Solaris_10-1

5. Boot your client into OBP session (OK prompt) and at the ok prompt, type
ok boot net - nowin    ;into console mode installation

* I encoutered "timed out waiting for tftp reply" after typing the command above,
i not sure why but after i restart the install server as well as my client, the error goes away.
Result from boot net - nowin

Boot device: /pci@0/pci@0/pci@c/network@0  File and args: - nowin
1000 Mbps full duplex  Link up
Requesting Internet Address for 0:14:4f:c7:55:3e
Requesting Internet Address for 0:14:4f:c7:55:3e
1000 Mbps full duplex  Link up
SunOS Release 5.10 Version Generic_137137-09 64-bit
Copyright 1983-2008 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
Configuring devices.
Using RPC Bootparams for network configuration information.
Attempting to configure interface e1000g1...
Skipped interface e1000g1
Attempting to configure interface e1000g0...
Configured interface e1000g0
Reading ZFS config: done.
Setting up Java. Please wait...
Serial console, reverting to text install
Beginning system identification...
Searching for configuration file(s)...
Search complete.
Discovering additional network configuration...

6. Once you reach the stage above, you have successfully completed the network boot and from here,
you can start doing the normal Solaris installation.
Posted by at No comments:

Monday, November 3, 2008

How to send break signal in ILOM

ILOM version = 2.0.4.19
System = SUN T6320

  • Shutdown your Sun system. Numerous way to do it, one of them is using the ILOM webGUI as shown.

Shuting down the machine (click to see enlarged picture)

  • Log in to 2 ILOM sessions using putty.
  • In your first ILOM session, first go to /HOST namespace.
-> cd /HOST

  • Type the following command and standby
-> set send_break_action="break"

  • In your second ILOM session, first start the system by typing the following command
-> start /SYS
  • After that, accessing the console through this command.
-> start /SP/console
  • Wait until it shows your Ethernet MAC address information and before it goes into boot device, use your first ILOM session to send the break signal. In order not to miss the timing, you can send numerous break signals in the anticipation of the Ethernet MAC address information to show up as shown below.

Send the break signal while booting (click to see enlarged picture)
  • And finally the {0} OK prompt.
Posted by at No comments:
Subscribe to: Posts (Atom)