Linux: Dual port 3G SAS drive get port swapped after power cycling

Submitted by jupiturliu123
on May 20, 2010 - 4:43pm

Hi All :

We do power cycling test over our dual port 3G/6G drive test over LSI 3G 1068E/ 6G 2008 Controller. We sometime found the port get swapped during the power cycling. It happened more often in 3G SAS controller than 6G controller.
For example:
In the beginning before power off,
phy 0, sas_addr 0x50014ee30005078e were associated with sda and sg2
but after power on.
phy 0, sas_addr 0x50014ee30005078e were associated with sdb and sg3

Do you guys happened to have idea of why the ports get swapped during the power cycling. It is so important to us since our test totally depend on sdb and sg3 to identify device.

Below are our testing machine spec:
1.Kernel : Linux kernel 2.6.24.4,
2 Driver : Mpt2sas 5.00.02.00 driver /mptsas 4.00.34.02

3.HBA: 1068E 3G with 1.28 firmware and 2008 6G controller with firmware 5.00.13.00.

Thanks for your help in advance.

Below were the logs output from Linux kernel

Before power off the dual port drive

target1:0:0: mptsas: ioc0: removing ssp device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

sd 1:0:0:0: [sda] Synchronizing SCSI cache

sd 1:0:0:0: [sda] Result: hostbyte=0x01 driverbyte=0x00

target1:0:1: mptsas: ioc0: removing ssp device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

sd 1:0:1:0: [sdb] Synchronizing SCSI cache

sd 1:0:1:0: [sdb] Result: hostbyte=0x01 driverbyte=0x00

mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

MPT SPI Host can't handle SMP requests

target1:0:2: mptsas: ioc0: add device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

scsi 1:0:2:0: Direct-Access WD WD2000FYYG-18A21 D1B0 PQ: 0 ANSI: 6

scsi 1:0:2:0: mptscsih: ioc0: qdepth=64, tagged=1, simple=1, ordered=0, scsi_level=7, cmd_que=1

sd 1:0:2:0: [sda] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:2:0: [sda] Write Protect is off

sd 1:0:2:0: [sda] Mode Sense: 9f 00 10 08

sd 1:0:2:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA

sd 1:0:2:0: [sda] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:2:0: [sda] Write Protect is off

sd 1:0:2:0: [sda] Mode Sense: 9f 00 10 08

sd 1:0:2:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA

sda: unknown partition table

sd 1:0:2:0: [sda] Attached SCSI disk

sd 1:0:2:0: Attached scsi generic sg2 type 0

mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

MPT SPI Host can't handle SMP requests

target1:0:3: mptsas: ioc0: add device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

scsi 1:0:3:0: Direct-Access WD WD2000FYYG-18A21 D1B0 PQ: 0 ANSI: 6

scsi 1:0:3:0: mptscsih: ioc0: qdepth=64, tagged=1, simple=1, ordered=0, scsi_level=7, cmd_que=1

sd 1:0:3:0: [sdb] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:3:0: [sdb] Write Protect is off

sd 1:0:3:0: [sdb] Mode Sense: 9f 00 10 08

sd 1:0:3:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA

sd 1:0:3:0: [sdb] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:3:0: [sdb] Write Protect is off

sd 1:0:3:0: [sdb] Mode Sense: 9f 00 10 08

sd 1:0:3:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA

sdb: unknown partition table

sd 1:0:3:0: [sdb] Attached SCSI disk

sd 1:0:3:0: Attached scsi generic sg3 type 0

After power on the drive

target1:0:2: mptsas: ioc0: removing ssp device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

sd 1:0:2:0: [sda] Synchronizing SCSI cache

sd 1:0:2:0: [sda] Result: hostbyte=0x01 driverbyte=0x00

target1:0:3: mptsas: ioc0: removing ssp device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

sd 1:0:3:0: [sdb] Synchronizing SCSI cache

sd 1:0:3:0: [sdb] Result: hostbyte=0x01 driverbyte=0x00

mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

MPT SPI Host can't handle SMP requests

target1:0:4: mptsas: ioc0: add device: fw_channel 0, fw_id 24, phy 1, sas_addr 0x50014ee30005078f

scsi 1:0:4:0: Direct-Access WD WD2000FYYG-18A21 D1B0 PQ: 0 ANSI: 6

scsi 1:0:4:0: mptscsih: ioc0: qdepth=64, tagged=1, simple=1, ordered=0, scsi_level=7, cmd_que=1

sd 1:0:4:0: [sda] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:4:0: [sda] Write Protect is off

sd 1:0:4:0: [sda] Mode Sense: 9f 00 10 08

sd 1:0:4:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA

sd 1:0:4:0: [sda] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:4:0: [sda] Write Protect is off

sd 1:0:4:0: [sda] Mode Sense: 9f 00 10 08

sd 1:0:4:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA

sda: unknown partition table

sd 1:0:4:0: [sda] Attached SCSI disk

sd 1:0:4:0: Attached scsi generic sg2 type 0

mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

MPT SPI Host can't handle SMP requests

target1:0:5: mptsas: ioc0: add device: fw_channel 0, fw_id 23, phy 0, sas_addr 0x50014ee30005078e

scsi 1:0:5:0: Direct-Access WD WD2000FYYG-18A21 D1B0 PQ: 0 ANSI: 6

scsi 1:0:5:0: mptscsih: ioc0: qdepth=64, tagged=1, simple=1, ordered=0, scsi_level=7, cmd_que=1

sd 1:0:5:0: [sdb] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:5:0: [sdb] Write Protect is off

sd 1:0:5:0: [sdb] Mode Sense: 9f 00 10 08

sd 1:0:5:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA

sd 1:0:5:0: [sdb] 3907029168 512-byte hardware sectors (2000399 MB)

sd 1:0:5:0: [sdb] Write Protect is off

sd 1:0:5:0: [sdb] Mode Sense: 9f 00 10 08

sd 1:0:5:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA

sdb: unknown partition table

sd 1:0:5:0: [sdb] Attached SCSI disk

sd 1:0:5:0: Attached scsi generic sg3 type 0