end_request: I/O error

susindram · April 23, 2012, 3:52am

My Code

Hi All,

I m getting below error in one of redhat linux server.I am new to redhat.Please let us know any issue with HDD???

Mycode

kernel: ll header: ff:ff:ff:ff:ff:ff:00:11:43:5a:20:e5:08:00
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdb, sector 2097024
kernel: end_request: I/O error, dev sdb, sector 2097136
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdb, sector 8
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdc, sector 2097024
kernel: end_request: I/O error, dev sdc, sector 2097136
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdc, sector 8
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sdd, sector 2097024
kernel: end_request: I/O error, dev sdd, sector 2097136
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sdd, sector 8
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sde, sector 2097024
kernel: end_request: I/O error, dev sde, sector 2097136
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sde, sector 8
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdf, sector 2097024
kernel: end_request: I/O error, dev sdf, sector 2097136
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdf, sector 8
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdg, sector 0
kernel: end_request: I/O error, dev sdg, sector 2097024
kernel: end_request: I/O error, dev sdg, sector 2097136
kernel: end_request: I/O error, dev sdg, sector 0
kernel: end_request: I/O error, dev sdg, sector 8
kernel: end_request: I/O error, dev sdg, sector 0
kernel: end_request: I/O error, dev sdh, sector 0
kernel: end_request: I/O error, dev sdh, sector 2097024
kernel: end_request: I/O error, dev sdh, sector 2097136
kernel: end_request: I/O error, dev sdh, sector 0
kernel: end_request: I/O error, dev sdh, sector 8
kernel: end_request: I/O error, dev sdh, sector 0
kernel: end_request: I/O error, dev sdi, sector 0
kernel: end_request: I/O error, dev sdi, sector 2097024
kernel: end_request: I/O error, dev sdi, sector 2097136
kernel: end_request: I/O error, dev sdi, sector 0
kernel: end_request: I/O error, dev sdi, sector 8
kernel: end_request: I/O error, dev sdi, sector 0
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdb, sector 2097024
kernel: end_request: I/O error, dev sdb, sector 2097136
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdb, sector 8
kernel: end_request: I/O error, dev sdb, sector 0
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdc, sector 2097024
kernel: end_request: I/O error, dev sdc, sector 2097136
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdc, sector 8
kernel: end_request: I/O error, dev sdc, sector 0
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sdd, sector 2097024
kernel: end_request: I/O error, dev sdd, sector 2097136
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sdd, sector 8
kernel: end_request: I/O error, dev sdd, sector 0
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sde, sector 2097024
kernel: end_request: I/O error, dev sde, sector 2097136
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sde, sector 8
kernel: end_request: I/O error, dev sde, sector 0
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdf, sector 2097024
kernel: end_request: I/O error, dev sdf, sector 2097136
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdf, sector 8
kernel: end_request: I/O error, dev sdf, sector 0
kernel: end_request: I/O error, dev sdg, sector 0
kernel: end_request: I/O error, dev sdg, sector 2097024
kernel: end_request: I/O error, dev sdg, sector 2097136

$ more /etc/fstab
LABEL=/                   /                     ext3    defaults         1 1
LABEL=/var                /var                  ext3    defaults,nodev   1 2
LABEL=/boot               /boot                 ext3    defaults,nodev   1 2
LABEL=/appltgb            /appltgb              ext3    defaults,nodev   1 2
tmpfs                     /dev/shm              tmpfs   defaults         0 0
devpts                    /dev/pts              devpts  gid=5,mode=620   0 0
sysfs                     /sys                  sysfs   defaults         0 0
proc                      /proc                 proc    defaults         0 0
LABEL=SWAP-sda2           swap                  swap    defaults         0 0
none                      /tmp                  tmpfs   mode=1777        0
$

Thanks,
Susi.S

hedkandi · April 23, 2012, 4:06am

hi there

what is the output of vgdisplay -v?

It looks like the disks weren't configured properly. Have you tried rebooting?

susindram · April 23, 2012, 4:12am

Its production server.I didn't rebooted yet.Please find the below for vgdisplay output.

$ sudo /usr/sbin/vgdisplay -v
    Finding all volume groups
  /dev/sdb: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdc: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 0: Input/output error
  /dev/sde: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdf: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdg: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdh: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 0: Input/output error
$

hedkandi · April 23, 2012, 4:42am

Hi there

paste the output for

sfdisk -l /dev/sdc

---------- Post updated at 04:42 PM ---------- Previous update was at 04:31 PM ----------

susindram · April 23, 2012, 5:04am

$ sudo /sbin/fdisk -l

Disk /dev/sda: 146.1 GB, 146163105792 bytes
255 heads, 63 sectors/track, 17769 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          16      128488+  83  Linux
/dev/sda2              17        4193    33551752+  82  Linux swap / Solaris
/dev/sda3            4194        6021    14683410   83  Linux
/dev/sda4            6022       17769    94365810    5  Extended
/dev/sda5            6022        6282     2096451   83  Linux
/dev/sda6            6283       17769    92269296   83  Linux
$

Scrutinizer · April 23, 2012, 7:07am

@susindram, are you also new to Linux? You should let an expert handle this..

hedkandi · April 23, 2012, 9:56pm

ops sorry my bad! :o

susindram · April 24, 2012, 3:33am

Scrutinzer@

Thanks..I am new to linux...Let me wait for some expert help.

Thanks,
Susi.S

mark54g · April 24, 2012, 10:44am

susindram,

I believe he meant that you should HIRE an expert, not wait for one here.

venikathir · May 1, 2012, 5:57am

With Storage knowledge also

IKE0000 · May 1, 2012, 8:35am

When dealing with hard-disk malfunction in a production server,
the first thing you should do is to check out whether you have a proper backup.
If not, you should better shutdown the server and contact your hardware vendor immediately.

methyl · May 1, 2012, 9:14am

I agree. Time to review your backup status and fish out the system installation documentation and hardware map. You will need to know what this system looked like before it broke. First impression is that an external disc storage cabinet has vapourised but do take professional advice.