Proxmox Offline Mirror - too many symlins - os error 40

[Sokoban]

Hi All,

this tool is pretty cool stuff. Thanks!
Unfortunately we are receiving the following error upon syncing to the medium.



Error: Too many levels of symbolic links (os error 40)

We are syncing PVE, Debian bullseye and Ubuntu jammy repos.

Here is our config:

mirror: debian_bullseye_updates
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/debian-archive-bullseye-automatic.gpg
        repository deb http://deb.debian.org/debian bullseye-updates main contrib
        skip-sections debug
        skip-sections games
        sync true
        verify true

mirror: debian_bullseye_main
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/debian-archive-bullseye-automatic.gpg
        repository deb http://deb.debian.org/debian bullseye main contrib
        skip-sections debug
        skip-sections games
        sync true
        verify true

mirror: debian_bullseye_security
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/debian-archive-bullseye-security-automatic.gpg
        repository deb http://deb.debian.org/debian-security bullseye-security main contrib
        skip-sections debug
        skip-sections games
        sync true
        verify true

mirror: ubuntu_jammy_main_uni_multi
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/ubuntu-keyring-2018-archive.gpg
        repository deb http://de.archive.ubuntu.com/ubuntu jammy main restricted universe multiverse
        sync true
        verify true

mirror: ubuntu_jammy_updates
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/ubuntu-keyring-2018-archive.gpg
        repository deb http://de.archive.ubuntu.com/ubuntu jammy-updates main restricted universe multiverse
        sync true
        verify true

mirror: ubuntu_jammy_security
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/ubuntu-keyring-2018-archive.gpg
        repository deb http://de.archive.ubuntu.com/ubuntu jammy-security main restricted universe multiverse
        sync true
        verify true

mirror: ubuntu_jammy_backports
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /usr/share/keyrings/ubuntu-keyring-2018-archive.gpg
        repository deb http://de.archive.ubuntu.com/ubuntu jammy-backports main restricted universe multiverse
        sync true
        verify true

mirror: pve_bullseye_no_subscription
        architectures amd64
        architectures all
        base-dir /mnt/pve/NASBackup/apt_mirror
        ignore-errors false
        key-path /etc/apt/trusted.gpg.d/proxmox-release-bullseye.gpg
        repository deb http://download.proxmox.com/debian/pve bullseye pve-no-subscription
        sync true
        verify true

medium: proxmox-offline1
        mirrors ubuntu_jammy_security
        mirrors debian_bullseye_updates
        mirrors debian_bullseye_security
        mirrors debian_bullseye_main
        mirrors pve_bullseye_no_subscription
        mirrors ubuntu_jammy_main_uni_multi
        mirrors ubuntu_jammy_updates
        mirrors ubuntu_jammy_backports
        mountpoint /mnt/proxmox-offline
        sync true
        verify true

Any ideas? Probably the syncing could be done with rsync alternatively?

Thanks!
Best Regards
Sokoban

 

[fabian]

could you also post the full output of the command? what is /mnt/proxmox-offline ? (just a directory, or actually a mountpoint? if the latter, what is mounted there? if not, what is the parent mountpoint/filesystem?)

 

[Sokoban]

The issued command was:
proxmox-offline-mirror medium sync proxmox-offline1

/mnt/proxmox-offline is a usb attached ext4 volume that is mounted here.

This is on a PVE Server with latest updates (no-subscription). FS of / is ext4 also.
/mnt/pve/NASBackup is a nfs volume from a NAS, the filesystem of the NAS volume is also ext4.

 

[fabian]

please post the full output of the command (in code tags or as attachment as .txt file), as well as the last 200 lines or so of the following command

strace -ff proxmox-offline-mirror medium sync proxmox-offline1

 

[Sokoban]

Find attached

• the output from a sync (sync_all.log),
• the last 200 lines from the strace of the above command (strace_200_last.log)
• a zip archive containing the strace output from the subprocesses.

HTH and thanks!

 

[fabian]

"/mnt/pve/NASBackup/apt_mirror/ubuntu_jammy_main_uni_multi/2023-04-17T13:21:01Z/ubuntu_main_latest" seems to be the file tripping it up - did you manually create that?

 

[Sokoban]

Ah I see. Yes, it's created manually. I wanted to create a link to the most recent snapshot to set as a repository for the offline hosts. So they can keep it, and I only need to set the link to the most recent snapshot... Or am I missing something? Probably there is a more convinient way to handle this?

I will delete the manually created links and try syncing again.

 

[fabian]

tracked here: https://bugzilla.proxmox.com/show_bug.cgi?id=4379

see my last two comments there

 

[Sokoban]

Alright! At least it's not only me running into this. Probably a good idea to put a note on that into the manual? Thanks for your help Fabian. I will come back if the promlem still occurs after link removal.

 

[Sokoban]

I am afraid, the problem seems to persist after softlink removal.



Is it necessary to clean the medium and start syncing from scratch?

 

[fabian]

could you run the command with strace again and post the last few lines?

 

[Sokoban]

Sorry, my fault. strace revealed another softlink that I was not aware of. Thanks again for your help.