Discussion:
Strange errors with LSI 9207-8e (LSI SAS2308)
(too old to reply)
George Kontostanos
2013-02-18 17:44:58 UTC
Permalink
Hallo everybody,

We are using FreeBSD 9.1-RELEASE with 11 drives WDC WD30EFRX-68AX9N0
(RED 3 TB) in a RAIDz3 connected to an LSI 9207-8e controller with
bios 7.29.00.00 and firmware 15.00.00.00 on a X9DRD-7LN4F-JBOD
SuperMicro board. The board has an on board controller LSI SAS2308
which is running the same firmware and bios.

As soon as we start transferring data to the pool we get the following errors:

31072 SMID 281 terminated ioc 804b scsi 0 state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 5a 88 0 1 0 0 length 131072 SMID 407 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 59 88 0 1 0 0 length 131072 SMID 238 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 58 88 0 1 0 0 length 131072 SMID 331 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 57 88 0 1 0 0 length 131072 SMID 443 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 54 a0 0 1 0 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): CAM status: SCSI Status Error
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): SCSI status: Check Condition
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): SCSI sense: UNIT
ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)

The errors keep going and going for all drives not just da2. We
compiled the latest LSI driver (15) but the errors did not stop:

Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): WRITE(10). CDB:
2a 0 2 5f 1 70 0 1 0 0 length 131072 SMID 205 terminated ioc 804b scsi
0 state c xfer 0
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): WRITE(10). CDB:
2a 0 2 5f 0 70 0 1 0 0 length 131072 SMID 831 terminated ioc 804b scsi
0 state c xfer 0
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): WRITE(10). CDB:
2a 0 2 5e ff 70 0 1 0 0 length 131072 SMID 655 terminated ioc 804b
scsi 0 state c xfer 0
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): WRITE(10). CDB:
2a 0 2 5e fe 70 0 1 0 0 length 131072 SMID 285 terminated ioc 804b
scsi 0 state c xfer 0
Feb 18 17:44:47 DLCH010 kernel:
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): WRITE(10). CDB:
2a 0 2 5e fd 70 0 1 0 0
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): CAM status: SCSI
Status Error
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): SCSI status:
Check Condition
Feb 18 17:44:47 DLCH010 kernel: (da2:mpslsi0:0:16:0): SCSI sense: UNIT
ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)

In addition to that with the LSI driver we get the following errors
when the server boots:

Feb 18 17:13:53 DLCH010 kernel: :mpslsi1:0:707:0): Error 22, Unretryable error
Feb 18 17:13:53 DLCH010 kernel: (probe697:mpslsi1:0:708:0): INQUIRY.
CDB: 12 0 0 0 24 0
Feb 18 17:13:53 DLCH010 kernel: (probe697:mpslsi1:0:708:0): CAM
status: Invalid Target ID
Feb 18 17:13:53 DLCH010 kernel: (probe697:mpslsi1:0:708:0): Error 22,
Unretryable error
Feb 18 17:13:53 DLCH010 kernel: (probe698:mpslsi1:0:709:0): INQUIRY.
CDB: 12 0 0 0 24 0
Feb 18 17:13:53 DLCH010 kernel: (probe698:mpslsi1:0:709:0): CAM
status: Invalid Target ID
Feb 18 17:13:53 DLCH010 kernel: (probe698:mpslsi1:0:709:0): Error 22,
Unretryable error
Feb 18 17:13:53 DLCH010 kernel: (probe699:mpslsi1:0:710:0): INQUIRY.
CDB: 12 0 0 0 24 0
Feb 18 17:13:53 DLCH010 kernel: (probe699:mpslsi1:0:710:0): CAM
status: Invalid Target ID
Feb 18 17:13:53 DLCH010 kernel: (probe699:mpslsi1:0:710:0): Error 22,
Unretryable error
Feb 18 17:13:53 DLCH010 kernel: (probe700:mpslsi1:0:711:0): INQUIRY.
CDB: 12 0 0 0 24 0
Feb 18 17:13:53 DLCH010 kernel: (probe700:mpslsi1:0:711:0): CAM
status: Invalid Target ID
Feb 18 17:13:53 DLCH010 kernel: (probe700:mpslsi1:0:711:0): Error 22,
Unretryable error
Feb 18 17:13:53 DLCH010 kernel: (probe701:mpslsi1:0:712:0): INQUIRY.
CDB: 12 0 0 0 24 0
Feb 18 17:13:53 DLCH010 kernel: (probe701:mpslsi1:0:712:0): CAM
status: Invalid Target ID
Feb 18 17:13:53 DLCH010 kernel: (probe701:mpslsi1:0:712:0): Error 22,
Unretryable error
........

Note. During those errors the pool does not report and errors. Scrub
comes clean and smartmontools show no errors either.

At this point we are moving this to 9.1-STABLE

Any suggestions?

Thanks

Full dmesg with FreeBSD 9.1-RELEASE

Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.1-RELEASE #0 r243825: Tue Dec 4 09:23:10 UTC 2012
***@farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
CPU: Intel(R) Xeon(R) CPU E5-2630 0 @ 2.30GHz (2300.05-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0x206d7 Family = 6 Model = 2d Stepping = 7
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x1fbee3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x1<LAHF>
TSC: P-state invariant, performance statistics
real memory = 68736253952 (65552 MB)
avail memory = 66174443520 (63108 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: < >
FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 2
cpu3 (AP): APIC ID: 3
cpu4 (AP): APIC ID: 4
cpu5 (AP): APIC ID: 5
cpu6 (AP): APIC ID: 6
cpu7 (AP): APIC ID: 7
cpu8 (AP): APIC ID: 8
cpu9 (AP): APIC ID: 9
cpu10 (AP): APIC ID: 10
cpu11 (AP): APIC ID: 11
cpu12 (AP): APIC ID: 32
cpu13 (AP): APIC ID: 33
cpu14 (AP): APIC ID: 34
cpu15 (AP): APIC ID: 35
cpu16 (AP): APIC ID: 36
cpu17 (AP): APIC ID: 37
cpu18 (AP): APIC ID: 38
cpu19 (AP): APIC ID: 39
cpu20 (AP): APIC ID: 40
cpu21 (AP): APIC ID: 41
cpu22 (AP): APIC ID: 42
cpu23 (AP): APIC ID: 43
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
kbd1 at kbdmux0
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
cpu8: <ACPI CPU> on acpi0
cpu9: <ACPI CPU> on acpi0
cpu10: <ACPI CPU> on acpi0
cpu11: <ACPI CPU> on acpi0
cpu12: <ACPI CPU> on acpi0
cpu13: <ACPI CPU> on acpi0
cpu14: <ACPI CPU> on acpi0
cpu15: <ACPI CPU> on acpi0
cpu16: <ACPI CPU> on acpi0
cpu17: <ACPI CPU> on acpi0
cpu18: <ACPI CPU> on acpi0
cpu19: <ACPI CPU> on acpi0
cpu20: <ACPI CPU> on acpi0
cpu21: <ACPI CPU> on acpi0
cpu22: <ACPI CPU> on acpi0
cpu23: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Event timer "HPET4" frequency 14318180 Hz quality 440
Event timer "HPET5" frequency 14318180 Hz quality 440
Event timer "HPET6" frequency 14318180 Hz quality 440
Event timer "HPET7" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 26 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
mps0: <LSI SAS2308> port 0x8000-0x80ff mem
0xdfc40000-0xdfc4ffff,0xdfc00000-0xdfc3ffff irq 26 at device 0.0 on
pci1
mps0: Firmware: 15.00.00.00, Driver: 14.00.00.01-fbsd
mps0: IOCCapabilities:
1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib2: <ACPI PCI-PCI bridge> irq 32 at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 32 at device 2.2 on pci0
pci3: <ACPI PCI bus> on pcib3
mps1: <LSI SAS2308> port 0x7000-0x70ff mem
0xdfa40000-0xdfa4ffff,0xdfa00000-0xdfa3ffff irq 34 at device 0.0 on
pci3
mps1: Firmware: 15.00.00.00, Driver: 14.00.00.01-fbsd
mps1: IOCCapabilities:
1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib4: <ACPI PCI-PCI bridge> irq 40 at device 3.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.2 on pci0
pci5: <ACPI PCI bus> on pcib5
igb0: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0x6060-0x607f mem 0xdfd60000-0xdfd7ffff,0xdfd8c000-0xdfd8ffff irq 42
at device 0.0 on pci5
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:25:90:c0:93:60
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb1: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0x6040-0x605f mem 0xdfd40000-0xdfd5ffff,0xdfd88000-0xdfd8bfff irq 45
at device 0.1 on pci5
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:25:90:c0:93:61
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 4 to cpu 12
igb1: Bound queue 5 to cpu 13
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
igb2: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0x6020-0x603f mem 0xdfd20000-0xdfd3ffff,0xdfd84000-0xdfd87fff irq 44
at device 0.2 on pci5
igb2: Using MSIX interrupts with 9 vectors
igb2: Ethernet address: 00:25:90:c0:93:62
igb2: Bound queue 0 to cpu 16
igb2: Bound queue 1 to cpu 17
igb2: Bound queue 2 to cpu 18
igb2: Bound queue 3 to cpu 19
igb2: Bound queue 4 to cpu 20
igb2: Bound queue 5 to cpu 21
igb2: Bound queue 6 to cpu 22
igb2: Bound queue 7 to cpu 23
igb3: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0x6000-0x601f mem 0xdfd00000-0xdfd1ffff,0xdfd80000-0xdfd83fff irq 46
at device 0.3 on pci5
igb3: Using MSIX interrupts with 9 vectors
igb3: Ethernet address: 00:25:90:c0:93:63
igb3: Bound queue 0 to cpu 0
igb3: Bound queue 1 to cpu 1
igb3: Bound queue 2 to cpu 2
igb3: Bound queue 3 to cpu 3
igb3: Bound queue 4 to cpu 4
igb3: Bound queue 5 to cpu 5
igb3: Bound queue 6 to cpu 6
igb3: Bound queue 7 to cpu 7
pci0: <base peripheral> at device 4.0 (no driver attached)
pci0: <base peripheral> at device 4.1 (no driver attached)
pci0: <base peripheral> at device 4.2 (no driver attached)
pci0: <base peripheral> at device 4.3 (no driver attached)
pci0: <base peripheral> at device 4.4 (no driver attached)
pci0: <base peripheral> at device 4.5 (no driver attached)
pci0: <base peripheral> at device 4.6 (no driver attached)
pci0: <base peripheral> at device 4.7 (no driver attached)
pci0: <base peripheral> at device 5.0 (no driver attached)
pci0: <base peripheral> at device 5.2 (no driver attached)
pcib6: <ACPI PCI-PCI bridge> irq 16 at device 17.0 on pci0
pci7: <ACPI PCI bus> on pcib6
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xdfe23000-0xdfe233ff
irq 16 at device 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xdfe22000-0xdfe223ff
irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci1
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci8: <ACPI PCI bus> on pcib7
vgapci0: <VGA-compatible display> mem
0xdd000000-0xddffffff,0xdf800000-0xdf803fff,0xdf000000-0xdf7fffff irq
22 at device 1.0 on pci8
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Patsburg AHCI SATA controller> port
0x9050-0x9057,0x9040-0x9043,0x9030-0x9037,0x9020-0x9023,0x9000-0x901f
mem 0xdfe21000-0xdfe217ff irq 18 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
pci0: <dasp> at device 31.6 (no driver attached)
pcib8: <ACPI Host-PCI bridge> on acpi0
pci127: <ACPI PCI bus> on pcib8
pci127: <base peripheral> at device 8.0 (no driver attached)
pci127: <base peripheral> at device 8.3 (no driver attached)
pci127: <base peripheral> at device 8.4 (no driver attached)
pci127: <base peripheral> at device 9.0 (no driver attached)
pci127: <base peripheral> at device 9.3 (no driver attached)
pci127: <base peripheral> at device 9.4 (no driver attached)
pci127: <base peripheral> at device 10.0 (no driver attached)
pci127: <base peripheral> at device 10.1 (no driver attached)
pci127: <base peripheral> at device 10.2 (no driver attached)
pci127: <base peripheral> at device 10.3 (no driver attached)
pci127: <base peripheral> at device 11.0 (no driver attached)
pci127: <base peripheral> at device 11.3 (no driver attached)
pci127: <base peripheral> at device 12.0 (no driver attached)
pci127: <base peripheral> at device 12.1 (no driver attached)
pci127: <base peripheral> at device 12.2 (no driver attached)
pci127: <base peripheral> at device 12.6 (no driver attached)
pci127: <base peripheral> at device 12.7 (no driver attached)
pci127: <base peripheral> at device 13.0 (no driver attached)
pci127: <base peripheral> at device 13.1 (no driver attached)
pci127: <base peripheral> at device 13.2 (no driver attached)
pci127: <base peripheral> at device 13.6 (no driver attached)
pci127: <base peripheral> at device 14.0 (no driver attached)
pci127: <dasp> at device 14.1 (no driver attached)
pci127: <base peripheral> at device 15.0 (no driver attached)
pci127: <base peripheral> at device 15.1 (no driver attached)
pci127: <base peripheral> at device 15.2 (no driver attached)
pci127: <base peripheral> at device 15.3 (no driver attached)
pci127: <base peripheral> at device 15.4 (no driver attached)
pci127: <base peripheral> at device 15.5 (no driver attached)
pci127: <base peripheral> at device 15.6 (no driver attached)
pci127: <base peripheral> at device 16.0 (no driver attached)
pci127: <base peripheral> at device 16.1 (no driver attached)
pci127: <base peripheral> at device 16.2 (no driver attached)
pci127: <base peripheral> at device 16.3 (no driver attached)
pci127: <base peripheral> at device 16.4 (no driver attached)
pci127: <base peripheral> at device 16.5 (no driver attached)
pci127: <base peripheral> at device 16.6 (no driver attached)
pci127: <base peripheral> at device 16.7 (no driver attached)
pci127: <base peripheral> at device 17.0 (no driver attached)
pci127: <base peripheral> at device 19.0 (no driver attached)
pci127: <dasp> at device 19.1 (no driver attached)
pci127: <dasp> at device 19.4 (no driver attached)
pci127: <dasp> at device 19.5 (no driver attached)
pci127: <base peripheral> at device 19.6 (no driver attached)
pcib9: <ACPI Host-PCI bridge> on acpi0
pci128: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> irq 50 at device 1.0 on pci128
pci129: <ACPI PCI bus> on pcib10
pcib11: <ACPI PCI-PCI bridge> irq 56 at device 2.0 on pci128
pci130: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> irq 56 at device 2.2 on pci128
pci131: <ACPI PCI bus> on pcib12
pci128: <base peripheral> at device 4.0 (no driver attached)
pci128: <base peripheral> at device 4.1 (no driver attached)
pci128: <base peripheral> at device 4.2 (no driver attached)
pci128: <base peripheral> at device 4.3 (no driver attached)
pci128: <base peripheral> at device 4.4 (no driver attached)
pci128: <base peripheral> at device 4.5 (no driver attached)
pci128: <base peripheral> at device 4.6 (no driver attached)
pci128: <base peripheral> at device 4.7 (no driver attached)
pci128: <base peripheral> at device 5.0 (no driver attached)
pci128: <base peripheral> at device 5.2 (no driver attached)
pcib13: <ACPI Host-PCI bridge> on acpi0
pci255: <ACPI PCI bus> on pcib13
pci255: <base peripheral> at device 8.0 (no driver attached)
pci255: <base peripheral> at device 8.3 (no driver attached)
pci255: <base peripheral> at device 8.4 (no driver attached)
pci255: <base peripheral> at device 9.0 (no driver attached)
pci255: <base peripheral> at device 9.3 (no driver attached)
pci255: <base peripheral> at device 9.4 (no driver attached)
pci255: <base peripheral> at device 10.0 (no driver attached)
pci255: <base peripheral> at device 10.1 (no driver attached)
pci255: <base peripheral> at device 10.2 (no driver attached)
pci255: <base peripheral> at device 10.3 (no driver attached)
pci255: <base peripheral> at device 11.0 (no driver attached)
pci255: <base peripheral> at device 11.3 (no driver attached)
pci255: <base peripheral> at device 12.0 (no driver attached)
pci255: <base peripheral> at device 12.1 (no driver attached)
pci255: <base peripheral> at device 12.2 (no driver attached)
pci255: <base peripheral> at device 12.6 (no driver attached)
pci255: <base peripheral> at device 12.7 (no driver attached)
pci255: <base peripheral> at device 13.0 (no driver attached)
pci255: <base peripheral> at device 13.1 (no driver attached)
pci255: <base peripheral> at device 13.2 (no driver attached)
pci255: <base peripheral> at device 13.6 (no driver attached)
pci255: <base peripheral> at device 14.0 (no driver attached)
pci255: <dasp> at device 14.1 (no driver attached)
pci255: <base peripheral> at device 15.0 (no driver attached)
pci255: <base peripheral> at device 15.1 (no driver attached)
pci255: <base peripheral> at device 15.2 (no driver attached)
pci255: <base peripheral> at device 15.3 (no driver attached)
pci255: <base peripheral> at device 15.4 (no driver attached)
pci255: <base peripheral> at device 15.5 (no driver attached)
pci255: <base peripheral> at device 15.6 (no driver attached)
pci255: <base peripheral> at device 16.0 (no driver attached)
pci255: <base peripheral> at device 16.1 (no driver attached)
pci255: <base peripheral> at device 16.2 (no driver attached)
pci255: <base peripheral> at device 16.3 (no driver attached)
pci255: <base peripheral> at device 16.4 (no driver attached)
pci255: <base peripheral> at device 16.5 (no driver attached)
pci255: <base peripheral> at device 16.6 (no driver attached)
pci255: <base peripheral> at device 16.7 (no driver attached)
pci255: <base peripheral> at device 17.0 (no driver attached)
pci255: <base peripheral> at device 19.0 (no driver attached)
pci255: <dasp> at device 19.1 (no driver attached)
pci255: <dasp> at device 19.4 (no driver attached)
pci255: <dasp> at device 19.5 (no driver attached)
pci255: <base peripheral> at device 19.6 (no driver attached)
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
ctl: CAM Target Layer loaded
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
est8: <Enhanced SpeedStep Frequency Control> on cpu8
p4tcc8: <CPU Frequency Thermal Control> on cpu8
est9: <Enhanced SpeedStep Frequency Control> on cpu9
p4tcc9: <CPU Frequency Thermal Control> on cpu9
est10: <Enhanced SpeedStep Frequency Control> on cpu10
p4tcc10: <CPU Frequency Thermal Control> on cpu10
est11: <Enhanced SpeedStep Frequency Control> on cpu11
p4tcc11: <CPU Frequency Thermal Control> on cpu11
est12: <Enhanced SpeedStep Frequency Control> on cpu12
p4tcc12: <CPU Frequency Thermal Control> on cpu12
est13: <Enhanced SpeedStep Frequency Control> on cpu13
p4tcc13: <CPU Frequency Thermal Control> on cpu13
est14: <Enhanced SpeedStep Frequency Control> on cpu14
p4tcc14: <CPU Frequency Thermal Control> on cpu14
est15: <Enhanced SpeedStep Frequency Control> on cpu15
p4tcc15: <CPU Frequency Thermal Control> on cpu15
est16: <Enhanced SpeedStep Frequency Control> on cpu16
p4tcc16: <CPU Frequency Thermal Control> on cpu16
est17: <Enhanced SpeedStep Frequency Control> on cpu17
p4tcc17: <CPU Frequency Thermal Control> on cpu17
est18: <Enhanced SpeedStep Frequency Control> on cpu18
p4tcc18: <CPU Frequency Thermal Control> on cpu18
est19: <Enhanced SpeedStep Frequency Control> on cpu19
p4tcc19: <CPU Frequency Thermal Control> on cpu19
est20: <Enhanced SpeedStep Frequency Control> on cpu20
p4tcc20: <CPU Frequency Thermal Control> on cpu20
est21: <Enhanced SpeedStep Frequency Control> on cpu21
p4tcc21: <CPU Frequency Thermal Control> on cpu21
est22: <Enhanced SpeedStep Frequency Control> on cpu22
p4tcc22: <CPU Frequency Thermal Control> on cpu22
est23: <Enhanced SpeedStep Frequency Control> on cpu23
p4tcc23: <CPU Frequency Thermal Control> on cpu23
ZFS filesystem version 5
ZFS storage pool version 28
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
AcpiOsExecute: failed to enqueue task, consider increasing the
debug.acpi.max_tasks tunable
ACPI Error: Method parse/execution failed [\\_GPE._L24] (Node
0xfffffe0018e9fd40), AE_NO_MEMORY (20110527/psparse-560)
ACPI Exception: AE_NO_MEMORY, while evaluating GPE method [_L24]
(20110527/evgpe-606)
AcpiOsExecute: failed to enqueue task, consider increasing the
debug.acpi.max_tasks tunable
usb_alloc_device: set address 2 failed (USB_ERR_TIMEOUT, ignored)
usb_alloc_device: set address 2 failed (USB_ERR_TIMEOUT, ignored)
ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
ada0: <OCZ-VERTEX3 2.25> ATA-8 SATA 3.x device
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 114473MB (234441648 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus3 target 0 lun 0
ada1: ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr
2> on usbus0
<OCZ-VERTEX3 2.25> ATA-8 SATA 3.x device
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 114473MB (234441648 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad6
ada2 at ahcich2 bus 0 scbus4 target 0 lun 0
ada2: <ST9500420AS 0002SDM1> ATA-8 SATA 2.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad8
ada3 at ahcich3 bus 0 scbus5 target 0 lun 0
ada3: <ST9500420ASG 0008APM2> ATA-8 SATA 1.x device
ada3: 150.000MB/s transfers (SATA 1.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad10
ses0 at mps1 bus 0 scbus1 target 8 lun 0
ses0: <LSI CORP SAS2X36 0717> Fixed Enclosure Services SCSI-5 device
ses0: 600.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 SES Device
ses1 at mps1 bus 0 scbus1 target 9 lun 0
ses1: <LSI CORP SAS2X28 0717> Fixed Enclosure Services SCSI-5 device
ses1: 600.000MB/s transfers
ses1: Command Queueing enabled
ses1: SCSI-3 SES Device
SMP: AP CPU #20 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #16 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #22 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #17 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #18 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #21 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #23 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #19 Launched!
Timecounter "TSC-low" frequency 8984551 Hz quality 1000
uhub2: 6 ports with 6 removable, self powered
Root mount waiting for: usbus1 usbus0
ugen0.3: <Winbond Electronics Corp> at usbus0
ums0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0,
rev 1.10/0.01, addr 3> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class
0/0, rev 1.10/0.01, addr 3> on usbus0
kbd0 at ukbd0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr
2> on usbus1
Root mount waiting for: usbus1
uhub3: 8 ports with 8 removable, self powered
ugen1.3: <NOVATEK> at usbus1
ukbd1: <NOVATEK USB Keyboard, class 0/0, rev 1.10/1.04, addr 3> on usbus1
Root mount waiting for: usbus1
kbd2 at ukbd1
uhid0: <NOVATEK USB Keyboard, class 0/0, rev 1.10/1.04, addr 3> on usbus1
Trying to mount root from zfs:zroot []...
igb0: link state changed to UP
igb0: link state changed to DOWN
igb0: link state changed to UP
--
George Kontostanos
---
http://www.aisecure.net
George Kontostanos
2013-02-18 21:48:41 UTC
Permalink
On Mon, Feb 18, 2013 at 8:15 PM, George Kontostanos
Post by George Kontostanos
Hallo everybody,
We are using FreeBSD 9.1-RELEASE with 11 drives WDC WD30EFRX-68AX9N0
(RED 3 TB) in a RAIDz3 connected to an LSI 9207-8e controller with
bios 7.29.00.00 and firmware 15.00.00.00 on a X9DRD-7LN4F-JBOD
SuperMicro board. The board has an on board controller LSI SAS2308
which is running the same firmware and bios.
31072 SMID 281 terminated ioc 804b scsi 0 state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 5a 88 0 1 0 0 length 131072 SMID 407 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 59 88 0 1 0 0 length 131072 SMID 238 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 58 88 0 1 0 0 length 131072 SMID 331 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 57 88 0 1 0 0 length 131072 SMID 443 terminated ioc 804b scsi 0
state c xfer 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): WRITE(10). CDB: 2a
0 1 54 54 a0 0 1 0 0
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): CAM status: SCSI Status Error
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): SCSI status: Check Condition
Feb 17 14:59:25 DLCH010 kernel: (da1:mps0:0:15:0): SCSI sense: UNIT
ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
The errors keep going and going for all drives not just da2. We
Sounds a lot like bad cabling or vibrations in the JBOD chassis.
What kind of chassis do you use for the drives connected to the -8e card?
WD Red drives does not have RAFF and should not be used in a chassis with
more than four drives.
We are using the SUPERMICRO chassis 847e26-RJbod1
(http://www.supermicro.com/products/chassis/4u/847/SC847E26-RJBOD1.cfm?parts=SHOW)
I really don't see any vibrations the JBOD is steady and the cabling
has been changed.
It appears that the error messages don't display anymore in FreeBSD 9.1-STABLE
--
Martin Nilsson, CEO, Mullet Scandinavia AB, Malmö, SWEDEN
Our business is well engineered servers optimised for FreeBSD & Linux
_______________________________________________
http://lists.freebsd.org/mailman/listinfo/freebsd-scsi
--
George Kontostanos
---
http://www.aisecure.net
--
George Kontostanos
---
http://www.aisecure.net
Loading...