ubuntu20.04 SSD障害発生!

先月サーバを新調し、余っていたSSDで運用していたのですが、再起動後のコマンドの帰りが異常に遅い自体が発生しました。

CPU Loadも問題がなく、途方に暮れそうになりましたがsyslogに見慣れない赤いメッセージが!

どうやらSSDに問題が発生しているようなので、調査してみました。

テキスト版 dmesg

# dmesg

[   85.249419] ata2: hard resetting link
[   85.728530] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   85.728881] ata2.00: supports DRM functions and may not be fully accessible
[   85.731698] ata2.00: supports DRM functions and may not be fully accessible
[   85.734686] ata2.00: configured for UDMA/133
[   85.744800] ahci 0000:00:12.0: port does not support device sleep
[   85.744874] ata2.00: device reported invalid CHS sector 0
[   85.744876] ata2.00: device reported invalid CHS sector 0
[   85.744880] ata2.00: device reported invalid CHS sector 0
[   85.744881] ata2.00: device reported invalid CHS sector 0
[   85.744882] ata2.00: device reported invalid CHS sector 0
[   85.744884] ata2.00: device reported invalid CHS sector 0
[   85.744920] sd 1:0:0:0: [sda] tag#9 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=30s
[   85.744924] sd 1:0:0:0: [sda] tag#9 Sense Key : Illegal Request [current]
[   85.744926] sd 1:0:0:0: [sda] tag#9 Add. Sense: Unaligned write command
[   85.744930] sd 1:0:0:0: [sda] tag#9 CDB: Read(10) 28 00 00 a4 1d e0 00 00 20 00
[   85.744934] blk_update_request: I/O error, dev sda, sector 10755552 op 0x0:(READ) flags 0x80700 phys_seg 4 prio class 0
[   85.744956] sd 1:0:0:0: [sda] tag#10 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=30s
[   85.744958] sd 1:0:0:0: [sda] tag#10 Sense Key : Illegal Request [current]
[   85.744960] sd 1:0:0:0: [sda] tag#10 Add. Sense: Unaligned write command
[   85.744962] sd 1:0:0:0: [sda] tag#10 CDB: Read(10) 28 00 01 11 26 00 00 00 e0 00
[   85.744964] blk_update_request: I/O error, dev sda, sector 17901056 op 0x0:(READ) flags 0x80700 phys_seg 14 prio class 0
[   85.744975] ata2: EH complete
[   85.745198] ata2.00: Enabling discard_zeroes_data
[  132.409345] ata2.00: exception Emask 0x0 SAct 0x600100 SErr 0x50000 action 0x6 frozen
[  132.409354] ata2: SError: { PHYRdyChg CommWake }
[  132.409357] ata2.00: failed command: READ FPDMA QUEUED
[  132.409363] ata2.00: cmd 60/08:40:38:09:44/00:00:0d:00:00/40 tag 8 ncq dma 4096 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  132.409365] ata2.00: status: { DRDY }
[  132.409367] ata2.00: failed command: READ FPDMA QUEUED
[  132.409372] ata2.00: cmd 60/40:a8:40:1b:44/00:00:10:00:00/40 tag 21 ncq dma 32768 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  132.409374] ata2.00: status: { DRDY }
[  132.409376] ata2.00: failed command: WRITE FPDMA QUEUED
[  132.409380] ata2.00: cmd 61/58:b0:f8:34:04/00:00:10:00:00/40 tag 22 ncq dma 45056 out
                        res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
[  132.409382] ata2.00: status: { DRDY }


$ dmesg | grep SError

[   31.306897] ata2: SError: { PHYRdyChg CommWake DevExch }
[   64.460248] ata2: SError: { CommWake }
[  118.964063] ata2: SError: { PHYRdyChg CommWake }
[  131.995260] ata2: SError: { PHYRdyChg CommWake DevExch }
[  142.806616] ata2: SError: { PHYRdyChg CommWake DevExch }
[  170.555899] ata2: SError: { CommWake DevExch }
[  176.564147] ata2: SError: { CommWake DevExch }
[  227.763570] ata2: SError: { PHYRdyChg CommWake DevExch }
[  330.160559] ata2: SError: { PHYRdyChg CommWake DevExch }
[  361.913551] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1140.940382] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1872.831003] ata2: SError: { PHYRdyChg CommWake DevExch }


$ dmesg | grep SEr
[   31.306886] ata2.00: exception Emask 0x10 SAct 0x1 SErr 0x4050000 action 0xe frozen
[   31.306897] ata2: SError: { PHYRdyChg CommWake DevExch }
[   64.460240] ata2.00: exception Emask 0x0 SAct 0x8 SErr 0x40000 action 0x6 frozen
[   64.460248] ata2: SError: { CommWake }
[  118.964054] ata2.00: exception Emask 0x0 SAct 0x80c03800 SErr 0x50000 action 0x6 frozen
[  118.964063] ata2: SError: { PHYRdyChg CommWake }
[  131.995252] ata2.00: exception Emask 0x10 SAct 0x78000000 SErr 0x4050000 action 0xe frozen
[  131.995260] ata2: SError: { PHYRdyChg CommWake DevExch }
[  142.806604] ata2.00: exception Emask 0x10 SAct 0x200 SErr 0x4050000 action 0xe frozen
[  142.806616] ata2: SError: { PHYRdyChg CommWake DevExch }
[  170.555889] ata2.00: exception Emask 0x10 SAct 0x200000 SErr 0x4040000 action 0xe frozen
[  170.555899] ata2: SError: { CommWake DevExch }
[  176.564129] ata2.00: exception Emask 0x10 SAct 0x400000 SErr 0x4040000 action 0xe frozen
[  176.564147] ata2: SError: { CommWake DevExch }
[  227.763562] ata2.00: exception Emask 0x10 SAct 0x2 SErr 0x4050000 action 0xe frozen
[  227.763570] ata2: SError: { PHYRdyChg CommWake DevExch }
[  330.160548] ata2.00: exception Emask 0x10 SAct 0x3e0 SErr 0x4050000 action 0xe frozen
[  330.160559] ata2: SError: { PHYRdyChg CommWake DevExch }
[  361.913540] ata2.00: exception Emask 0x10 SAct 0x381ff00 SErr 0x4050000 action 0xe frozen
[  361.913551] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1140.940371] ata2.00: exception Emask 0x10 SAct 0x2 SErr 0x4050000 action 0xe frozen
[ 1140.940382] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1872.830992] ata2.00: exception Emask 0x10 SAct 0x200000 SErr 0x4050000 action 0xe frozen
[ 1872.831003] ata2: SError: { PHYRdyChg CommWake DevExch }

$ dmesg | grep Gbps
[    1.308014] ahci 0000:00:12.0: AHCI 0001.0301 32 slots 2 ports 6 Gbps 0x3 impl SATA mode
[    1.799033] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   32.182931] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   64.935056] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[  119.440012] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[  131.995245] ata2: limiting SATA link speed to 3.0 Gbps
[  132.867154] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  143.678607] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  171.427900] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  177.436129] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  227.763555] ata2: limiting SATA link speed to 1.5 Gbps
[  228.635396] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  331.032418] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  362.785734] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[ 1141.812338] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[ 1873.702888] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)

まずは定番の「smartmontools」を導入して確認。

sudo apt install smartmontools

sudo smartctl -A /dev/sda1
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.8.0-59-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   100   100   000    Pre-fail  Always       -       0
  5 Reallocate_NAND_Blk_Cnt 0x0032   100   100   010    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       38046
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       154
171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
173 Ave_Block-Erase_Count   0x0032   037   037   000    Old_age   Always       -       954
174 Unexpect_Power_Loss_Ct  0x0032   100   100   000    Old_age   Always       -       117
183 SATA_Interfac_Downshift 0x0032   100   100   000    Old_age   Always       -       36
184 Error_Correction_Count  0x0032   100   100   000    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
194 Temperature_Celsius     0x0022   059   047   000    Old_age   Always       -       41 (Min/Max 11/53)
196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   100   100   000    Old_age   Always       -       14
202 Percent_Lifetime_Remain 0x0030   037   037   001    Old_age   Offline      -       63
206 Write_Error_Rate        0x000e   100   100   000    Old_age   Always       -       0
246 Total_LBAs_Written      0x0032   100   100   000    Old_age   Always       -       200137566374
247 Host_Program_Page_Count 0x0032   100   100   000    Old_age   Always       -       6256459283
248 FTL_Program_Page_Count  0x0032   100   100   000    Old_age   Always       -       11254307859
180 Unused_Reserve_NAND_Blk 0x0033   000   000   000    Pre-fail  Always       -       1255
210 Success_RAIN_Recov_Cnt  0x0032   100   100   000    Old_age   Always       -       0

このうち以下の行が怪しい
199 UDMA_CRC_Error_Count    0x0032   100   100   000    Old_age   Always       -       14
202 Percent_Lifetime_Remain 0x0030   037   037   001    Old_age   Offline      -       63

GUIでSSDの状況が確認できる「Gsmartcontrol」を導入してみました。

ちなみにubuntuでキャプチャーは”ALT+PrtSC”を同時に押すことで「~/Pictures」にpng形式で保存されます。

sudo apt install gsmartcontrol

マウスオーバーすると「202 Remaining Lifetime」欄で「Less than half」というメッセージが表示されました、CrucialのSSDを利用していたのですが、確か購入は4年ぐらい前で、そろそろ交換のタイミングです。

念の為以下のSSDに交換することにしました。

HYUNDAIのSSDは聞いたこともなかったのですが、安かったので試してみます。

参考にさせていただきました。ありがとうございます。

以下自分メモ dmesg

[   31.306886] ata2.00: exception Emask 0x10 SAct 0x1 SErr 0x4050000 action 0xe frozen
[   31.306893] ata2.00: irq_stat 0x00000040, connection status changed
[   31.306897] ata2: SError: { PHYRdyChg CommWake DevExch }
[   31.306900] ata2.00: failed command: WRITE FPDMA QUEUED
[   31.306906] ata2.00: cmd 61/98:00:38:29:04/00:00:10:00:00/40 tag 0 ncq dma 77824 out
                        res 40/00:f4:30:dc:67/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[   31.306908] ata2.00: status: { DRDY }
[   31.306914] ata2: hard resetting link
[   32.182931] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   32.183292] ata2.00: supports DRM functions and may not be fully accessible
[   32.186181] ata2.00: supports DRM functions and may not be fully accessible
[   32.188807] ata2.00: configured for UDMA/133
[   32.198890] ahci 0000:00:12.0: port does not support device sleep
[   32.199002] ata2: EH complete
[   32.199175] ata2.00: Enabling discard_zeroes_data
[   64.460240] ata2.00: exception Emask 0x0 SAct 0x8 SErr 0x40000 action 0x6 frozen
[   64.460248] ata2: SError: { CommWake }
[   64.460252] ata2.00: failed command: READ FPDMA QUEUED
[   64.460257] ata2.00: cmd 60/78:18:00:59:6b/00:00:00:00:00/40 tag 3 ncq dma 61440 in
                        res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[   64.460259] ata2.00: status: { DRDY }
[   64.460265] ata2: hard resetting link
[   64.935056] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   64.935318] ata2.00: supports DRM functions and may not be fully accessible
[   64.938865] ata2.00: supports DRM functions and may not be fully accessible
[   64.941521] ata2.00: configured for UDMA/133
[   64.951566] ahci 0000:00:12.0: port does not support device sleep
[   64.951661] sd 1:0:0:0: [sda] tag#3 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=32s
[   64.951664] sd 1:0:0:0: [sda] tag#3 Sense Key : Illegal Request [current]
[   64.951667] sd 1:0:0:0: [sda] tag#3 Add. Sense: Unaligned write command
[   64.951671] sd 1:0:0:0: [sda] tag#3 CDB: Read(10) 28 00 00 6b 59 00 00 00 78 00
[   64.951675] blk_update_request: I/O error, dev sda, sector 7035136 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0
[   64.951693] ata2: EH complete
[   64.952910] ata2.00: Enabling discard_zeroes_data
[  118.964054] ata2.00: exception Emask 0x0 SAct 0x80c03800 SErr 0x50000 action 0x6 frozen
[  118.964063] ata2: SError: { PHYRdyChg CommWake }
[  118.964066] ata2.00: failed command: READ FPDMA QUEUED
[  118.964071] ata2.00: cmd 60/08:58:78:08:04/00:00:14:00:00/40 tag 11 ncq dma 4096 in
                        res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964073] ata2.00: status: { DRDY }
[  118.964075] ata2.00: failed command: READ FPDMA QUEUED
[  118.964080] ata2.00: cmd 60/08:60:20:4c:04/00:00:1e:00:00/40 tag 12 ncq dma 4096 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964082] ata2.00: status: { DRDY }
[  118.964083] ata2.00: failed command: READ FPDMA QUEUED
[  118.964088] ata2.00: cmd 60/20:68:e0:29:06/00:00:11:00:00/40 tag 13 ncq dma 16384 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964089] ata2.00: status: { DRDY }
[  118.964091] ata2.00: failed command: WRITE FPDMA QUEUED
[  118.964096] ata2.00: cmd 61/08:b0:48:a2:e8/00:00:00:00:00/40 tag 22 ncq dma 4096 out
                        res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964098] ata2.00: status: { DRDY }
[  118.964099] ata2.00: failed command: READ FPDMA QUEUED
[  118.964104] ata2.00: cmd 60/08:b8:88:c1:8b/00:00:10:00:00/40 tag 23 ncq dma 4096 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964105] ata2.00: status: { DRDY }
[  118.964107] ata2.00: failed command: READ FPDMA QUEUED
[  118.964112] ata2.00: cmd 60/20:f8:78:b9:c7/00:00:1c:00:00/40 tag 31 ncq dma 16384 in
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
[  118.964114] ata2.00: status: { DRDY }
[  118.964119] ata2: hard resetting link
[  119.440012] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[  119.440438] ata2.00: supports DRM functions and may not be fully accessible
[  119.444027] ata2.00: supports DRM functions and may not be fully accessible
[  119.446629] ata2.00: configured for UDMA/133
[  119.456697] ahci 0000:00:12.0: port does not support device sleep
[  119.456856] ata2.00: device reported invalid CHS sector 0
[  119.456860] ata2.00: device reported invalid CHS sector 0
[  119.456862] ata2.00: device reported invalid CHS sector 0
[  119.456909] sd 1:0:0:0: [sda] tag#12 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=39s
[  119.456912] sd 1:0:0:0: [sda] tag#12 Sense Key : Illegal Request [current]
[  119.456915] sd 1:0:0:0: [sda] tag#12 Add. Sense: Unaligned write command
[  119.456919] sd 1:0:0:0: [sda] tag#12 CDB: Read(10) 28 00 1e 04 4c 20 00 00 08 00
[  119.456923] blk_update_request: I/O error, dev sda, sector 503598112 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
[  119.456953] sd 1:0:0:0: [sda] tag#13 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=30s
[  119.456955] sd 1:0:0:0: [sda] tag#13 Sense Key : Illegal Request [current]
[  119.456957] sd 1:0:0:0: [sda] tag#13 Add. Sense: Unaligned write command
[  119.456959] sd 1:0:0:0: [sda] tag#13 CDB: Read(10) 28 00 11 06 29 e0 00 00 20 00
[  119.456961] blk_update_request: I/O error, dev sda, sector 285616608 op 0x0:(READ) flags 0x80700 phys_seg 4 prio class 0
[  119.456978] sd 1:0:0:0: [sda] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=45s
[  119.456980] sd 1:0:0:0: [sda] tag#23 Sense Key : Illegal Request [current]
[  119.456982] sd 1:0:0:0: [sda] tag#23 Add. Sense: Unaligned write command
[  119.456985] sd 1:0:0:0: [sda] tag#23 CDB: Read(10) 28 00 10 8b c1 88 00 00 08 00
[  119.456986] blk_update_request: I/O error, dev sda, sector 277594504 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
[  119.456997] sd 1:0:0:0: [sda] tag#31 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=36s
[  119.457000] sd 1:0:0:0: [sda] tag#31 Sense Key : Illegal Request [current]
[  119.457002] sd 1:0:0:0: [sda] tag#31 Add. Sense: Unaligned write command
[  119.457019] sd 1:0:0:0: [sda] tag#31 CDB: Read(10) 28 00 1c c7 b9 78 00 00 20 00
[  119.457021] blk_update_request: I/O error, dev sda, sector 482851192 op 0x0:(READ) flags 0x80700 phys_seg 4 prio class 0
[  119.457027] ata2: EH complete
[  119.472910] ata2.00: Enabling discard_zeroes_data
[  125.802730] FS-Cache: Loaded
[  125.836606] FS-Cache: Netfs 'cifs' registered for caching
[  125.855934] Key type cifs.spnego registered
[  125.855944] Key type cifs.idmap registered
[  125.856527] CIFS: Attempting to mount //192.168.11.200/video/raspberry
[  128.702767] br-1c7df50b6d96: port 1(veth1febf33) entered disabled state
[  128.712832] vethd6784fb: renamed from eth0
[  128.786974] br-1c7df50b6d96: port 1(veth1febf33) entered disabled state
[  128.790401] device veth1febf33 left promiscuous mode
[  128.790416] br-1c7df50b6d96: port 1(veth1febf33) entered disabled state
[  128.945492] br-1c7df50b6d96: port 1(veth94820b4) entered blocking state
[  128.945497] br-1c7df50b6d96: port 1(veth94820b4) entered disabled state
[  128.951705] device veth94820b4 entered promiscuous mode
[  128.954692] br-1c7df50b6d96: port 1(veth94820b4) entered blocking state
[  128.954698] br-1c7df50b6d96: port 1(veth94820b4) entered forwarding state
[  129.648424] eth0: renamed from veth17451f2
[  129.668068] IPv6: ADDRCONF(NETDEV_CHANGE): veth94820b4: link becomes ready
[  130.661397] veth12a090b: renamed from eth0
[  130.693971] br-1c7df50b6d96: port 3(veth423c171) entered disabled state
[  130.705144] br-1c7df50b6d96: port 3(veth423c171) entered disabled state
[  130.712246] device veth423c171 left promiscuous mode
[  130.712258] br-1c7df50b6d96: port 3(veth423c171) entered disabled state
[  130.903296] br-1c7df50b6d96: port 3(veth5d5eeb8) entered blocking state
[  130.903300] br-1c7df50b6d96: port 3(veth5d5eeb8) entered disabled state
[  130.905288] device veth5d5eeb8 entered promiscuous mode
[  130.905532] br-1c7df50b6d96: port 3(veth5d5eeb8) entered blocking state
[  130.905535] br-1c7df50b6d96: port 3(veth5d5eeb8) entered forwarding state
[  131.703324] br-1c7df50b6d96: port 3(veth5d5eeb8) entered disabled state
[  131.953290] eth0: renamed from vethff2a8df
[  131.968416] IPv6: ADDRCONF(NETDEV_CHANGE): veth5d5eeb8: link becomes ready
[  131.968529] br-1c7df50b6d96: port 3(veth5d5eeb8) entered blocking state
[  131.968532] br-1c7df50b6d96: port 3(veth5d5eeb8) entered forwarding state
[  131.995245] ata2: limiting SATA link speed to 3.0 Gbps
[  131.995252] ata2.00: exception Emask 0x10 SAct 0x78000000 SErr 0x4050000 action 0xe frozen
[  131.995257] ata2.00: irq_stat 0x00000040, connection status changed
[  131.995260] ata2: SError: { PHYRdyChg CommWake DevExch }
[  131.995263] ata2.00: failed command: WRITE FPDMA QUEUED
[  131.995269] ata2.00: cmd 61/08:d8:50:eb:cb/00:00:01:00:00/40 tag 27 ncq dma 4096 out
                        res 40/00:d4:b0:7a:94/00:00:07:00:00/40 Emask 0x10 (ATA bus error)
[  131.995271] ata2.00: status: { DRDY }
[  131.995273] ata2.00: failed command: WRITE FPDMA QUEUED
[  131.995278] ata2.00: cmd 61/08:e0:40:09:88/00:00:07:00:00/40 tag 28 ncq dma 4096 out
                        res 40/00:d4:b0:7a:94/00:00:07:00:00/40 Emask 0x10 (ATA bus error)
[  131.995280] ata2.00: status: { DRDY }
[  131.995282] ata2.00: failed command: WRITE FPDMA QUEUED
[  131.995286] ata2.00: cmd 61/08:e8:60:fc:5c/00:00:10:00:00/40 tag 29 ncq dma 4096 out
                        res 40/00:d4:b0:7a:94/00:00:07:00:00/40 Emask 0x10 (ATA bus error)
[  131.995288] ata2.00: status: { DRDY }
[  131.995290] ata2.00: failed command: WRITE FPDMA QUEUED
[  131.995295] ata2.00: cmd 61/08:f0:28:c4:85/00:00:15:00:00/40 tag 30 ncq dma 4096 out
                        res 40/00:d4:b0:7a:94/00:00:07:00:00/40 Emask 0x10 (ATA bus error)
[  131.995297] ata2.00: status: { DRDY }
[  131.995303] ata2: hard resetting link
[  132.867154] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  132.867528] ata2.00: supports DRM functions and may not be fully accessible
[  132.870428] ata2.00: supports DRM functions and may not be fully accessible
[  132.873320] ata2.00: configured for UDMA/133
[  132.883400] ahci 0000:00:12.0: port does not support device sleep
[  132.883521] ata2: EH complete
[  132.883692] ata2.00: Enabling discard_zeroes_data
[  138.750931] veth1ad4da2: renamed from eth0
[  138.780841] br-1c7df50b6d96: port 2(vethf406ce3) entered disabled state
[  138.877215] br-1c7df50b6d96: port 2(vethf406ce3) entered disabled state
[  138.886253] device vethf406ce3 left promiscuous mode
[  138.886269] br-1c7df50b6d96: port 2(vethf406ce3) entered disabled state
[  139.010470] br-1c7df50b6d96: port 2(vethed390dd) entered blocking state
[  139.010478] br-1c7df50b6d96: port 2(vethed390dd) entered disabled state
[  139.013743] device vethed390dd entered promiscuous mode
[  139.014382] br-1c7df50b6d96: port 2(vethed390dd) entered blocking state
[  139.014386] br-1c7df50b6d96: port 2(vethed390dd) entered forwarding state
[  139.798887] br-1c7df50b6d96: port 2(vethed390dd) entered disabled state
[  140.095507] eth0: renamed from veth2117864
[  140.111991] IPv6: ADDRCONF(NETDEV_CHANGE): vethed390dd: link becomes ready
[  140.112104] br-1c7df50b6d96: port 2(vethed390dd) entered blocking state
[  140.112107] br-1c7df50b6d96: port 2(vethed390dd) entered forwarding state
[  142.806604] ata2.00: exception Emask 0x10 SAct 0x200 SErr 0x4050000 action 0xe frozen
[  142.806613] ata2.00: irq_stat 0x00000040, connection status changed
[  142.806616] ata2: SError: { PHYRdyChg CommWake DevExch }
[  142.806620] ata2.00: failed command: READ FPDMA QUEUED
[  142.806625] ata2.00: cmd 60/20:48:20:0a:47/00:00:1d:00:00/40 tag 9 ncq dma 16384 in
                        res 40/00:44:a0:55:50/00:00:10:00:00/40 Emask 0x10 (ATA bus error)
[  142.806627] ata2.00: status: { DRDY }
[  142.806634] ata2: hard resetting link
[  143.678607] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  143.678982] ata2.00: supports DRM functions and may not be fully accessible
[  143.681953] ata2.00: supports DRM functions and may not be fully accessible
[  143.684801] ata2.00: configured for UDMA/133
[  143.694896] ahci 0000:00:12.0: port does not support device sleep
[  143.695021] sd 1:0:0:0: [sda] tag#9 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[  143.695026] sd 1:0:0:0: [sda] tag#9 Sense Key : Illegal Request [current]
[  143.695028] sd 1:0:0:0: [sda] tag#9 Add. Sense: Unaligned write command
[  143.695033] sd 1:0:0:0: [sda] tag#9 CDB: Read(10) 28 00 1d 47 0a 20 00 00 20 00
[  143.695038] blk_update_request: I/O error, dev sda, sector 491194912 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0
[  143.695068] ata2: EH complete
[  143.695227] ata2.00: Enabling discard_zeroes_data
[  170.555889] ata2.00: exception Emask 0x10 SAct 0x200000 SErr 0x4040000 action 0xe frozen
[  170.555896] ata2.00: irq_stat 0x00000040, connection status changed
[  170.555899] ata2: SError: { CommWake DevExch }
[  170.555902] ata2.00: failed command: WRITE FPDMA QUEUED
[  170.555908] ata2.00: cmd 61/68:a8:98:4d:04/00:00:10:00:00/40 tag 21 ncq dma 53248 out
                        res 40/00:a4:d8:1b:c4/00:00:16:00:00/40 Emask 0x10 (ATA bus error)
[  170.555910] ata2.00: status: { DRDY }
[  170.555916] ata2: hard resetting link
[  171.427900] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  171.428238] ata2.00: supports DRM functions and may not be fully accessible
[  171.431800] ata2.00: supports DRM functions and may not be fully accessible
[  171.435488] ata2.00: configured for UDMA/133
[  171.445559] ahci 0000:00:12.0: port does not support device sleep
[  171.445734] ata2: EH complete
[  171.445886] ata2.00: Enabling discard_zeroes_data
[  176.564129] ata2.00: exception Emask 0x10 SAct 0x400000 SErr 0x4040000 action 0xe frozen
[  176.564140] ata2.00: irq_stat 0x00000040, connection status changed
[  176.564147] ata2: SError: { CommWake DevExch }
[  176.564154] ata2.00: failed command: WRITE FPDMA QUEUED
[  176.564166] ata2.00: cmd 61/08:b0:78:6b:94/00:00:07:00:00/40 tag 22 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  176.564171] ata2.00: status: { DRDY }
[  176.564181] ata2: hard resetting link
[  177.436129] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[  177.436583] ata2.00: supports DRM functions and may not be fully accessible
[  177.440767] ata2.00: supports DRM functions and may not be fully accessible
[  177.444245] ata2.00: configured for UDMA/133
[  177.454328] ahci 0000:00:12.0: port does not support device sleep
[  177.454492] ata2: EH complete
[  177.454803] ata2.00: Enabling discard_zeroes_data
[  227.763555] ata2: limiting SATA link speed to 1.5 Gbps
[  227.763562] ata2.00: exception Emask 0x10 SAct 0x2 SErr 0x4050000 action 0xe frozen
[  227.763567] ata2.00: irq_stat 0x00000040, connection status changed
[  227.763570] ata2: SError: { PHYRdyChg CommWake DevExch }
[  227.763574] ata2.00: failed command: WRITE FPDMA QUEUED
[  227.763579] ata2.00: cmd 61/30:08:58:50:04/00:00:10:00:00/40 tag 1 ncq dma 24576 out
                        res 40/00:04:18:55:d8/00:00:1d:00:00/40 Emask 0x10 (ATA bus error)
[  227.763581] ata2.00: status: { DRDY }
[  227.763587] ata2: hard resetting link
[  228.635396] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  228.635740] ata2.00: supports DRM functions and may not be fully accessible
[  228.639335] ata2.00: supports DRM functions and may not be fully accessible
[  228.642750] ata2.00: configured for UDMA/133
[  228.652927] ahci 0000:00:12.0: port does not support device sleep
[  228.653094] ata2: EH complete
[  228.653288] ata2.00: Enabling discard_zeroes_data
[  330.160548] ata2.00: exception Emask 0x10 SAct 0x3e0 SErr 0x4050000 action 0xe frozen
[  330.160555] ata2.00: irq_stat 0x00000040, connection status changed
[  330.160559] ata2: SError: { PHYRdyChg CommWake DevExch }
[  330.160562] ata2.00: failed command: WRITE FPDMA QUEUED
[  330.160567] ata2.00: cmd 61/08:28:88:08:00/00:00:00:00:00/40 tag 5 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  330.160569] ata2.00: status: { DRDY }
[  330.160572] ata2.00: failed command: WRITE FPDMA QUEUED
[  330.160576] ata2.00: cmd 61/08:30:f0:08:00/00:00:00:00:00/40 tag 6 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  330.160578] ata2.00: status: { DRDY }
[  330.160580] ata2.00: failed command: WRITE FPDMA QUEUED
[  330.160584] ata2.00: cmd 61/08:38:80:08:40/00:00:10:00:00/40 tag 7 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  330.160586] ata2.00: status: { DRDY }
[  330.160588] ata2.00: failed command: WRITE FPDMA QUEUED
[  330.160592] ata2.00: cmd 61/08:40:28:0a:40/00:00:10:00:00/40 tag 8 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  330.160594] ata2.00: status: { DRDY }
[  330.160596] ata2.00: failed command: WRITE FPDMA QUEUED
[  330.160600] ata2.00: cmd 61/08:48:58:0a:40/00:00:10:00:00/40 tag 9 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  330.160602] ata2.00: status: { DRDY }
[  330.160608] ata2: hard resetting link
[  331.032418] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  331.032794] ata2.00: supports DRM functions and may not be fully accessible
[  331.035824] ata2.00: supports DRM functions and may not be fully accessible
[  331.038522] ata2.00: configured for UDMA/133
[  331.048622] ahci 0000:00:12.0: port does not support device sleep
[  331.048731] ata2: EH complete
[  331.048913] ata2.00: Enabling discard_zeroes_data
[  361.913540] ata2.00: exception Emask 0x10 SAct 0x381ff00 SErr 0x4050000 action 0xe frozen
[  361.913547] ata2.00: irq_stat 0x00000040, connection status changed
[  361.913551] ata2: SError: { PHYRdyChg CommWake DevExch }
[  361.913554] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913560] ata2.00: cmd 61/10:40:e8:08:e8/00:00:1d:00:00/40 tag 8 ncq dma 8192 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913562] ata2.00: status: { DRDY }
[  361.913564] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913568] ata2.00: cmd 61/08:48:00:08:00/00:00:00:00:00/40 tag 9 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913570] ata2.00: status: { DRDY }
[  361.913572] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913577] ata2.00: cmd 61/08:50:28:09:40/00:00:10:00:00/40 tag 10 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913579] ata2.00: status: { DRDY }
[  361.913581] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913585] ata2.00: cmd 61/08:58:b8:08:44/00:00:10:00:00/40 tag 11 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913587] ata2.00: status: { DRDY }
[  361.913589] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913594] ata2.00: cmd 61/08:60:40:09:80/00:00:10:00:00/40 tag 12 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913596] ata2.00: status: { DRDY }
[  361.913597] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913602] ata2.00: cmd 61/08:68:60:14:80/00:00:10:00:00/40 tag 13 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913604] ata2.00: status: { DRDY }
[  361.913606] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913627] ata2.00: cmd 61/08:70:90:1c:80/00:00:10:00:00/40 tag 14 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913628] ata2.00: status: { DRDY }
[  361.913630] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913635] ata2.00: cmd 61/08:78:b8:25:84/00:00:10:00:00/40 tag 15 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913637] ata2.00: status: { DRDY }
[  361.913638] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913643] ata2.00: cmd 61/08:80:70:63:84/00:00:10:00:00/40 tag 16 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913644] ata2.00: status: { DRDY }
[  361.913646] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913651] ata2.00: cmd 61/08:b8:30:16:00/00:00:14:00:00/40 tag 23 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913652] ata2.00: status: { DRDY }
[  361.913654] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913659] ata2.00: cmd 61/08:c0:78:08:04/00:00:14:00:00/40 tag 24 ncq dma 4096 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913675] ata2.00: status: { DRDY }
[  361.913678] ata2.00: failed command: WRITE FPDMA QUEUED
[  361.913699] ata2.00: cmd 61/10:c8:28:08:c0/00:00:1d:00:00/40 tag 25 ncq dma 8192 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[  361.913701] ata2.00: status: { DRDY }
[  361.913707] ata2: hard resetting link
[  362.785734] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  362.786100] ata2.00: supports DRM functions and may not be fully accessible
[  362.788962] ata2.00: supports DRM functions and may not be fully accessible
[  362.791601] ata2.00: configured for UDMA/133
[  362.801672] ahci 0000:00:12.0: port does not support device sleep
[  362.801877] ata2: EH complete
[  362.802033] ata2.00: Enabling discard_zeroes_data
[ 1029.526414] RTL871X: send eapol packet
[ 1029.526528] RTL871X: set group key to hw: alg:4(WEP40-1 WEP104-5 TKIP-2 AES-4) keyid:1
[ 1140.940371] ata2.00: exception Emask 0x10 SAct 0x2 SErr 0x4050000 action 0xe frozen
[ 1140.940378] ata2.00: irq_stat 0x00000040, connection status changed
[ 1140.940382] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1140.940385] ata2.00: failed command: WRITE FPDMA QUEUED
[ 1140.940390] ata2.00: cmd 61/18:08:78:6f:04/00:00:10:00:00/40 tag 1 ncq dma 12288 out
                        res 40/00:04:60:14:80/00:00:10:00:00/40 Emask 0x10 (ATA bus error)
[ 1140.940392] ata2.00: status: { DRDY }
[ 1140.940398] ata2: hard resetting link
[ 1141.812338] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[ 1141.812680] ata2.00: supports DRM functions and may not be fully accessible
[ 1141.816274] ata2.00: supports DRM functions and may not be fully accessible
[ 1141.819450] ata2.00: configured for UDMA/133
[ 1141.829520] ahci 0000:00:12.0: port does not support device sleep
[ 1141.829693] ata2: EH complete
[ 1141.829843] ata2.00: Enabling discard_zeroes_data
[ 1299.843776] perf: interrupt took too long (2517 > 2500), lowering kernel.perf_event_max_sample_rate to 79250
[ 1599.848235] perf: interrupt took too long (3171 > 3146), lowering kernel.perf_event_max_sample_rate to 63000
[ 1872.830992] ata2.00: exception Emask 0x10 SAct 0x200000 SErr 0x4050000 action 0xe frozen
[ 1872.830999] ata2.00: irq_stat 0x00000040, connection status changed
[ 1872.831003] ata2: SError: { PHYRdyChg CommWake DevExch }
[ 1872.831023] ata2.00: failed command: WRITE FPDMA QUEUED
[ 1872.831028] ata2.00: cmd 61/10:a8:b0:cb:04/00:00:10:00:00/40 tag 21 ncq dma 8192 out
                        res 50/00:00:00:00:00/00:00:00:00:00/a0 Emask 0x10 (ATA bus error)
[ 1872.831030] ata2.00: status: { DRDY }
[ 1872.831036] ata2: hard resetting link
[ 1873.702888] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[ 1873.703322] ata2.00: supports DRM functions and may not be fully accessible
[ 1873.706918] ata2.00: supports DRM functions and may not be fully accessible
[ 1873.710094] ata2.00: configured for UDMA/133
[ 1873.720174] ahci 0000:00:12.0: port does not support device sleep
[ 1873.720359] ata2: EH complete
[ 1873.720545] ata2.00: Enabling discard_zeroes_data
[ 1892.939554] VDF_enable
[ 1893.056082] VDF_enable
[ 1893.174147] VDF_enable
[ 2144.368610] perf: interrupt took too long (3969 > 3963), lowering kernel.perf_event_max_sample_rate to 50250