The status of the Exadata cellnode flash disks may occasionally be poor performance. If the error numbers are 0 (zero) or too low when you look at the details of the disks, you can normalize the status of these disks as below.
We connect to the cell node and run the cellcli command.
[root@oradb1cel01 ~]# cellcli1 2 3 4 | CellCLI: Release 11.2.3.3.0 - Production on Fri Sep 09 11:34:31 EEST 2016 Copyright (c) 2007, 2013, Oracle. All rights reserved. Cell Efficiency Ratio: 1,178 |
We list the flash disks that are “poor performance”.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 | CellCLI> LIST PHYSICALDISK WHERE DISKTYPE=flashdisk AND STATUS= 'poor performance' DETAIL name: FLASH_4_0 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_0 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J54 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 0" status: poor performance name: FLASH_4_1 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_1 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J55 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 1" status: poor performance name: FLASH_4_2 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_2 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J59 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 2" status: poor performance name: FLASH_4_3 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_3 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J58 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 3" status: poor performance |
We look into the details of flash disks. It is preferable that the error numbers are 0 (zero).
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 | CellCLI> list physicaldisk FLASH_4_0 detail; name: FLASH_4_0 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_0 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J54 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 0" status: poor performance CellCLI> list physicaldisk FLASH_4_1 detail; name: FLASH_4_1 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_1 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J55 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 1" status: poor performance CellCLI> list physicaldisk FLASH_4_2 detail; name: FLASH_4_2 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_2 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J59 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 2" status: poor performance CellCLI> list physicaldisk FLASH_4_3 detail; name: FLASH_4_3 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_3 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J58 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 3" status: poor performance |
One by one we return the status of all flash disks to normal.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 | CellCLI> alter lun 4_0 reenable force; LUN 4_0 on physical disk FLASH_4_0 successfully marked to status normal. CellCLI> list physicaldisk FLASH_4_0 detail; name: FLASH_4_0 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_0 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J54 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 0" status: normal CellCLI> alter lun 4_1 reenable force; LUN 4_1 on physical disk FLASH_4_1 successfully marked to status normal. CellCLI> list physicaldisk FLASH_4_1 detail; name: FLASH_4_1 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_1 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J55 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 1" status: normal CellCLI> alter lun 4_2 reenable force; LUN 4_2 on physical disk FLASH_4_2 successfully marked to status normal. CellCLI> list physicaldisk FLASH_4_2 detail; name: FLASH_4_2 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_2 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J59 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 2" status: normal CellCLI> alter lun 4_3 reenable force; LUN 4_3 on physical disk FLASH_4_3 successfully marked to status normal. CellCLI> list physicaldisk FLASH_4_3 detail; name: FLASH_4_3 diskType: FlashDisk errCmdTimeoutCount: 0 errHardReadCount: 0 errHardWriteCount: 0 errMediaCount: 0 errOtherCount: 0 errSeekCount: 0 luns: 4_3 makeModel: "MARVELL SD88SA02" physicalFirmware: D20Y physicalInsertTime: 2011-11-29T10:20:15+02:00 physicalSerial: 1116M08J58 physicalSize: 22.8880615234375G sectorRemapCount: 0 slotNumber: "PCI Slot: 4; FDOM: 3" status: normal |
When you check the physical disks again, you will see that they all return to normal.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 | CellCLI> LIST PHYSICALDISK 20:0 E0HLLP normal 20:1 E13ARA normal 20:2 E0J2DH normal 20:3 E0J7LA normal 20:4 E0L5WK normal 20:5 E0JART normal 20:6 E0K77N normal 20:7 E0L6NR normal 20:8 E0Z0QP normal 20:9 KGDAAL normal 20:10 E0E0KN normal 20:11 E0JATZ normal FLASH_1_0 1106M06XVW normal FLASH_1_1 1106M06XWG normal FLASH_1_2 1106M06XUH normal FLASH_1_3 1106M06XWE normal FLASH_2_0 1106M06XDD normal FLASH_2_1 1106M06XDK normal FLASH_2_2 1106M06X07 normal FLASH_2_3 1106M06X5E normal FLASH_4_0 1116M08J54 normal FLASH_4_1 1116M08J55 normal FLASH_4_2 1116M08J59 normal FLASH_4_3 1116M08J58 normal FLASH_5_0 1116M08C6W normal FLASH_5_1 1116M08C6X normal FLASH_5_2 1116M08C6V normal FLASH_5_3 1116M08C6U normal |
Finally, be sure to check the flash cache status.
1 2 | CellCLI> list flashcache oradb1cel01_FLASHCACHE normal |