Server migration

M

mhammett

Renowned Member
Mar 11, 2009
161
2
83
DeKalb, Illinois, United States
I'm migrating a bunch of containers off an old server onto a new one. 3 of the 10 failed. I reran them and this is the console output.

[root@Char ~]# ./vzmigrate.sh 10.1.5.7
OPT:--remove-area
OPT:--keep-dst
OPT:10.1.5.7
Starting migration of CT 110 to 10.1.5.7
Preparing remote node
Initializing remote quota
Syncing private
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/110/var/log/secure": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (115080 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Stopping container
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/110/var/log/secure": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (114658 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Error: Failed to sync container private areas
Starting container ...
Container is mounted
Adding IP address(es): 10.1.5.110
Setting CPU units: 1000
Configure meminfo: 49152
Set hostname: dns.ICS.local
File resolv.conf was modified
Container start in progress...
OPT:--remove-area
OPT:--keep-dst
OPT:10.1.5.7
Starting migration of CT 120 to 10.1.5.7
Preparing remote node
Initializing remote quota
Syncing private
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/120/var/lib/rpm/Packages": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (19260 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Stopping container
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/120/var/lib/rpm/Packages": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (98 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Error: Failed to sync container private areas
Starting container ...
Container is mounted
Adding IP address(es): 10.1.5.120
Setting CPU units: 1000
Configure meminfo: 524288
Set hostname: ntop.ICS.local
File resolv.conf was modified
Container start in progress...
OPT:--remove-area
OPT:--keep-dst
OPT:10.1.5.7
Starting migration of CT 121 to 10.1.5.7
Preparing remote node
Initializing remote quota
Syncing private
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/121/root/web/icstrac/log/trac.log": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (556934 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Stopping container
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/121/root/web/icstrac/log/trac.log": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (556598 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Error: Failed to sync container private areas
Starting container ...
Container is mounted
Adding IP address(es): 10.1.5.121
Setting CPU units: 1000
Configure meminfo: 65536
Set hostname: intranet.ICS.local
File resolv.conf was modified
Container start in progress...
Click to expand...

I'm seeing disk quota exceeded messages. I should have approximately 1.5 TB of storage and I'd wager that I don't pass 100 GB of usage. Why would I be full anywhere?
Fenix:~# df -ha
Filesystem Size Used Avail Use% Mounted on
/dev/pve/root 95G 26G 65G 28% /
tmpfs 1.9G 0 1.9G 0% /lib/init/rw
proc 0 0 0 - /proc
sysfs 0 0 0 - /sys
procbususb 0 0 0 - /proc/bus/usb
udev 10M 2.7M 7.4M 27% /dev
tmpfs 1.9G 4.0K 1.9G 1% /dev/shm
devpts 0 0 0 - /dev/pts
/dev/mapper/pve-data 1.3T 38G 1.3T 3% /var/lib/vz
/dev/sda1 504M 32M 448M 7% /boot
Click to expand...

On the ProxMox home screen it says the following. It appears ProxMox isn't even using the big ass partition.
HD Space root (94.49GB/23.78GB)
Click to expand...

Does /vz need to point to a different partition? I'll admit Linux partitioning is rather confusing.
 
/vz is the default folder for OpenVZ. When you migrate containers over, that is where it puts them, despite that not being where Proxmox uses by default.

I manually moved the containers over to /var/lib/vz earlier and changed the conf file to reflect the new location, but now nothing that was migrated will start. Newly created containers work just fine.

Also, the quotas and diskspace usage seem to be incorrect for the migrated machines.

What sort of log files do you need to see?
 
Created and I get the following errors when trying to migrate. I made sure to rm-rf the private folders for 110 and 121 first.

[root@Char ~]# ./vzmigrate.sh 10.1.5.7
OPT:-v
OPT:--remove-area
OPT:--keep-dst
OPT:10.1.5.7
Starting migration of CT 110 to 10.1.5.7
OpenVZ is running...
Loading /etc/vz/vz.conf and /etc/vz/conf/110.conf files
Check IPs on destination node: 10.1.5.110
Preparing remote node
Copying config file
110.conf 100% 1747 1.7KB/s 00:00
Saved parameters for CT 110
Creating remote container root dir
Creating remote container private dir
Initializing remote quota
Quota init
Turning remote quota on
Syncing private
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/110/var/log/secure": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (116395 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Stopping container
Stopping container ...
Container was stopped
Container is unmounted
Syncing private (2nd pass)
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: write failed on "/vz/private/110/var/log/secure": Disk quota exceeded (122)
rsync error: error in file IO (code 11) at receiver.c(298) [receiver=3.0.3]
rsync: connection unexpectedly closed (115603 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Error: Failed to sync container private areas
Starting container ...
Container is mounted
Adding IP address(es): 10.1.5.110
Setting CPU units: 1000
Configure meminfo: 49152
Set hostname: dns.ICS.local
File resolv.conf was modified
Container start in progress...
OPT:-v
OPT:--remove-area
OPT:--keep-dst
OPT:10.1.5.7
Starting migration of CT 121 to 10.1.5.7
OpenVZ is running...
Loading /etc/vz/vz.conf and /etc/vz/conf/121.conf files
Check IPs on destination node: 10.1.5.121
Preparing remote node
Copying config file
121.conf 100% 1754 1.7KB/s 00:00
Saved parameters for CT 121
Creating remote container root dir
Creating remote container private dir
Initializing remote quota
Quota init
Turning remote quota on
Syncing private
Killed by signal 2.
rsync error: unexplained error (code 255) at rsync.c(260) [sender=2.6.8]
Error: Failed to sync container private areas
vzquota : (error) Quota off syscall for id 121: Device or resource busy
vzquota : (warning) Quota is running for id 121
Click to expand...
 
I can assure you ti is not out of disk space.

Fenix:~# df -ha
Filesystem Size Used Avail Use% Mounted on
/dev/pve/root 95G 2.8G 87G 4% /
tmpfs 1.9G 0 1.9G 0% /lib/init/rw
proc 0 0 0 - /proc
sysfs 0 0 0 - /sys
procbususb 0 0 0 - /proc/bus/usb
udev 10M 2.6M 7.5M 26% /dev
tmpfs 1.9G 4.0K 1.9G 1% /dev/shm
devpts 0 0 0 - /dev/pts
/dev/mapper/pve-data 1.3T 74G 1.2T 6% /var/lib/vz
/dev/sda1 504M 32M 448M 7% /boot
Click to expand...
 
it still looks like a misunderstand between /vz and /var/lib/vz

/vz is the standard on rpm based systems, on Debian its /var/lib/vz.

so just symlink /vz to /var/lib/vz.
 
I already created the symlink.

Fenix:/# pwd
/
Fenix:/# ls -al
total 100
drwxr-xr-x 22 root root 4096 Dec 11 14:35 .
drwxr-xr-x 22 root root 4096 Dec 11 14:35 ..
-rw------- 1 root root 1024 May 22 2010 .rnd
drwxr-xr-x 2 root root 4096 Nov 26 08:23 bin
drwxr-xr-x 4 root root 4096 May 22 2010 boot
drwxr-xr-x 15 root root 13460 Feb 2 06:25 dev
drwxr-xr-x 3 root root 4096 May 22 2010 emul
drwxr-xr-x 76 root root 4096 Feb 1 18:05 etc
drwxr-xr-x 2 root root 4096 Aug 30 2009 home
drwxr-xr-x 11 root root 12288 Feb 1 16:54 lib
lrwxrwxrwx 1 root root 20 May 22 2010 lib32 -> /emul/ia32-linux/lib
lrwxrwxrwx 1 root root 4 May 22 2010 lib64 -> /lib
drwx------ 2 root root 16384 May 22 2010 lost+found
drwxr-xr-x 2 root root 4096 Feb 2 2010 media
drwxr-xr-x 2 root root 4096 Aug 30 2009 mnt
drwxr-xr-x 2 root root 4096 Feb 2 2010 opt
dr-xr-xr-x 288 root root 0 Feb 1 16:42 proc
drwxr-xr-x 8 root root 4096 Feb 1 17:10 root
drwxr-xr-x 2 root root 4096 Feb 1 16:54 sbin
drwxr-xr-x 2 root root 4096 Sep 16 2008 selinux
drwxr-xr-x 2 root root 4096 Feb 2 2010 srv
drwxr-xr-x 11 root root 0 Feb 1 16:42 sys
drwxrwxrwt 4 root root 4096 Feb 2 06:25 tmp
drwxr-xr-x 11 root root 4096 May 22 2010 usr
drwxr-xr-x 15 root root 4096 Jun 10 2010 var
lrwxrwxrwx 1 root root 11 Dec 11 14:35 vz -> /var/lib/vz
Fenix:/#
Click to expand...
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back