[SOLVED] Read error at byte 0, while reading X bytes: Input/output error

Discussion in 'Proxmox VE: Installation and configuration' started by Razva, Nov 12, 2014.

  1. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    Hey,

    Last night's backup posted this error:
    Code:
    INFO: starting new backup job: vzdump 101 100 --quiet 1 --mode snapshot --compress gzip --storage pmx1-web1 --node mh-pmx1
    INFO: filesystem type on dumpdir is 'fuse.sshfs' -using /var/tmp/vzdumptmp2445 for temporary files
    INFO: Starting Backup of VM 100 (openvz)
    INFO: CTID 100 exist mounted running
    INFO: status = running
    INFO: backup mode: snapshot
    INFO: ionice priority: 7
    INFO: creating lvm snapshot of /dev/mapper/pve-data ('/dev/pve/vzsnap-mh-pmx1-0')
    INFO:   Logical volume "vzsnap-mh-pmx1-0" created
    INFO: creating archive '/nfs/web1/dump/vzdump-openvz-100-2014_11_12-02_00_02.tar.gz'
    INFO: Total bytes written: 35348459520 (33GiB, 20MiB/s)
    INFO: archive file size: 19.47GB
    INFO: Finished Backup of VM 100 (00:29:38)
    INFO: filesystem type on dumpdir is 'fuse.sshfs' -using /var/tmp/vzdumptmp2445 for temporary files
    INFO: Starting Backup of VM 101 (openvz)
    INFO: CTID 101 exist mounted running
    INFO: status = running
    INFO: backup mode: snapshot
    INFO: ionice priority: 7
    INFO: creating lvm snapshot of /dev/mapper/pve-data ('/dev/pve/vzsnap-mh-pmx1-0')
    INFO:   Logical volume "vzsnap-mh-pmx1-0" created
    INFO: creating archive '/nfs/web1/dump/vzdump-openvz-101-2014_11_12-02_29_40.tar.gz'
    INFO: tar: ./home/mysite/descarca/revista_2.pdf: File shrank by 5920717 bytes; padding with zeros
    INFO: tar: ./home/mysite/descarca/revista_3.pdf: Read error at byte 0, while reading 10240 bytes: Input/output error
    INFO: tar: ./home/mysite/site/: Cannot savedir: Input/output error
    INFO: tar: ./home/mysite/site/phpinfo.php: Read error at byte 0, while reading 19 bytes: Input/output error
    INFO: tar: ./home/mysite/css/: Cannot savedir: Input/output error
    INFO: tar: ./home/mysite/css/sequencejs-theme.modern-slide-in.css: Read error at byte 0, while reading 3584 bytes: Input/output error
    INFO: tar: ./home/mysite/css/jquery.fancybox.css: Read error at byte 0, while reading 8192 bytes: Input/output error
    INFO: tar: ./home/mysite/css/fancybox-y.png: Read error at byte 0, while reading 176 bytes: Input/output error
    INFO: tar: ./home/mysite/css/sequencejs-theme.modern-slide-in.ie.css: Read error at byte 0, while reading 29 bytes: Input/output error
    INFO: tar: ./home/mysite/css/style.css: Read error at byte 0, while reading 7168 bytes: Input/output error
    INFO: tar: ./home/mysite/css/fancybox.png: Read error at byte 0, while reading 5120 bytes: Input/output error
    INFO: tar: ./home/mysite/css/normalize.css: Read error at byte 0, while reading 9004 bytes: Input/output error
    INFO: tar: ./home/mysite/css/fancybox-x.png: Read error at byte 0, while reading 203 bytes: Input/output error
    INFO: tar: ./home/mysite/downloads.php: Read error at byte 0, while reading 392 bytes: Input/output error
    INFO: tar: ./home/mysite/search.php: Read error at byte 0, while reading 1586 bytes: Input/output error
    INFO: tar: ./home/mysite/resetare-parola.php: Read error at byte 0, while reading 1823 bytes: Input/output error
    INFO: tar: ./home/mysite/googlebbb5b9e4e5511985.html: Read error at byte 0, while reading 53 bytes: Input/output error
    INFO: tar: ./home/mysite/blogroll.php: Read error at byte 0, while reading 2048 bytes: Input/output error
    INFO: tar: ./home/mysite/mysql.php: Read error at byte 0, while reading 1327 bytes: Input/output error
    INFO: tar: ./home/mysite/emails/: Cannot savedir: Input/output error
    INFO: tar: ./home/mysite/emails/trimitere-factura.php: Read error at byte 0, while reading 206 bytes: Input/output error
    INFO: tar: ./home/mysite/emails/factura.php: Read error at byte 0, while reading 5632 bytes: Input/output error
    INFO: tar: ./home/mysite/emails/lost-password.php: Read error at byte 0, while reading 141 bytes: Input/output error
    INFO: tar: ./home/mysite/emails/contact.php: Read error at byte 0, while reading 370 bytes: Input/output error
    INFO: tar: ./home/mysite/emails/comanda-online-aprobata.php: Read error at byte 0, while reading 353 bytes: Input/output error
    INFO: tar: ./home/mysite/epayment/: Cannot savedir: Input/output error
    INFO: tar: ./home/mysite/epayment/function.php: Read error at byte 0, while reading 512 bytes: Input/output error
    INFO: tar: ./home/mysite/epayment/pay.php: Read error at byte 0, while reading 4840 bytes: Input/output error
    INFO: tar: ./home/mysite/epayment/ep_reply.php: Read error at byte 0, while reading 2357 bytes: Input/output error
    INFO: tar: ./home/mysite/nws.php: Read error at byte 0, while reading 284 bytes: Input/output error
    INFO: tar: ./home/mysite/plata.php: Read error at byte 0, while reading 370 bytes: Input/output error
    INFO: tar: ./home/mysite/comanda.php: Read error at byte 0, while reading 5258 bytes: Input/output error
    INFO: tar: ./home/mysite/articol.php: Read error at byte 0, while reading 2048 bytes: Input/output error
    
    ...with "Read error at byte 0..." repeating for every other file on *all* CTs.

    Please note that:

    • before using GZIP we've used LZO for backups and had no issues
    • the NFS share is mounted and fully functional
    • node and attached NFS have enough space
    • node and attached NFS use new SSDs and have 0 corrupted sectors
    Can you please give me a hint?

    Thanks,
    Razvan
     
  2. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    The log ends with this:
     
  3. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,384
    Likes Received:
    292
    Any hint in /var/log/syslog why sending that backup mail failed?

    Those Input/output error usually indicates that you run out of LVM snapshot space, see

    # man vzdump

    related parameter is called '--size'
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  4. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    Here's the log: http://pastebin.com/AXH2ytJU

    I've separated the backup part from the other info (search for ==========).

    I can see these errors repeating:
    And after that:
    It may be more so please be so kind and check the log.

    Any idea how can I fix it?

    Thank you very much for your time!
     
  5. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    I've read the vzdump manual but it's not so "explicit":
    So this is the maximum size of a snapshot?

    Thinking at the fact that I have no idea what size really represents, I've set "size: 204800" in /etc/vzdump.conf (max. CT on the node has ~200gb).

    Any solution please?

    Later edit: this might be useful?

    Thanks!
     
    #5 Razva, Nov 12, 2014
    Last edited: Nov 12, 2014
  6. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,384
    Likes Received:
    292
    what is the output of

    # vgdisplay
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  7. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    Tonight's backup error is this:
    So I suppose it's something related to free space...?

    Thanks!
     
  8. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,384
    Likes Received:
    292
    You opnly have 16GB free space inside the VG, so you cannot use 'size: 204800' (try 'size: 8192' instead)
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  9. Razva

    Razva Member

    Joined:
    Dec 3, 2013
    Messages:
    70
    Likes Received:
    2
    Understood. Well I didn't really touched anything when installing Proxmox, so the partitioning is "default".

    Is there any documentation regarding VG? I've used "8192" and seems to work for some small CTs (I'll wait till tonight to make backups of the bigger ones). Is this value too low, thinking at the fact that the node has a CTs with sizes that vary between 10gb - 200gb?

    Thanks!
     
  10. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,384
    Likes Received:
    292
    No, snapshot only stores changes, so 8GB should be good enough.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice