Q: Preferred way to setup local mirror of non-subscription repo?

[fortechitsolutions]

Hi, just a small 'fun question'. I have a client project which requires that I setup a standalone instance of (a) Proxmox 3.X "no-subscription" repo (as per, http://pve.proxmox.com/wiki/Package_repositories#Proxmox_VE_No-Subscription_Repository ) and also (b) suitable debian repo (ie, for wheezy - likely will simply do via "FtpSync" script set, using rsync protocol, as per directions at, http://www.debian.org/mirror/ftpmirror#how )

The idea with this,

- there are a few hosts which need to get updates
- they don't all have public internet after they are deployed
- there is a desire to do updates on them a few times a year.

I believe the model will be to have a small Debian/similar VM on a laptop, which is updated while the laptop is on 'the net'. Then laptop goes to site where the ProxVE hosts live, and they are pointed at the IP of this VM which has 'currrent' repo data for ProxVE No-subscribe packages and also wheezy deb packages. That way updates can be applied .. without too much drama.

I know that there are 'recommended' ways for doing this with Debian - use Rsync; this deals with Hard Links nicely, etc - and I was curious if there is something similar one should do for ProxVE repo - or if it really is just a matter of recursively pulling a copy of all files from the URL, http://download.proxmox.com/debian/dists/wheezy/ - more or less - and then ensuring this is consistently available in the expected directory structure via HTTP on the VM which is going to be making this data available to the not-connected-to-internet-hosts.

Any thoughts:comments are appreciated.

Many thanks,


Tim Chipman

 

[tom]

e.g. http://packages.debian.org/wheezy/apt-mirror

 

[fortechitsolutions]

Sounds great - thanks for this pointer.

Tim

 

[Milkwyrm]

or apt-cache. works a treat.

 

[fortechitsolutions]

Hi, just curious when you say, 'apt-cache' do you mean, 'apt-cacher' as per: http://www.debuntu.org/how-to-set-up-a-repository-cache-with-apt-cacher/ and not actually 'apt-cache' ?

Thanks,

Tim

 

[Milkwyrm]

Tim. yes apt-cacher may be want I meant. I'm on leave at the moment without access to the system I setup ages ago so can't check at what it was I went with in the end.

 

[fortechitsolutions]

Hi Tom (et al.): A brief sanity check around this: I configured apt-mirror on a debian VM host, then configured it so it would pull from 3 sources as per a standard ProxVE 3.X host

Things I am trying to mirror are:

deb http://ftp.debian.org/debian wheezy main contrib
deb http://download.proxmox.com/debian wheezy pve-no-subscription
deb http://security.debian.org/ wheezy/updates main contrib

It tells me it wants to pull ~43 gigs of content. This seems a bit bigger than I had expected so wanted to briefly ask if this sounds 'correct' and my initial size assumptions were simply uninformed/lowball.

ie, it shows me:

root@debian:/etc/apt# apt-mirrorDownloading 27 index files using 20 threads...
Begin time: Wed Oct 16 18:08:03 2013
[20]... [19]... [18]... [17]... [16]... [15]... [14]... [13]... [12]... [11]... [10]... [9]... [8]... [7]... [6]... [5]... [4]... [3]... [2]... [1]... [0]...
End time: Wed Oct 16 18:08:17 2013


Proceed indexes: [PPP]


43.6 GiB will be downloaded into archive.
Downloading 37040 archive files using 20 threads...

Thanks!

Tim

 

[tom]

Debian is the distribution with a lot of packages, for a lot of architectures. if you want a full Debian mirror, you need a lot.

but you just need the amd64 packages?

see my /etc/apt/mirror.list (for my local apt-mirror)

#AMD64 Wheezy Mirror
deb-amd64 [URL]http://ftp.at.debian.org/debian[/URL] wheezy main non-free contrib
deb-amd64 [URL]http://ftp.at.debian.org/debian[/URL] wheezy-backports main non-free contrib
deb-amd64 [URL]http://ftp.at.debian.org/debian/[/URL] wheezy-updates main contrib non-free
deb-amd64 [URL]http://security.debian.org/debian-security[/URL] wheezy/updates main non-free contrib

 

[fpausp]

How must the list look like for Proxmox 5 and debian ?

 

[morph027]

You could also try apt-cacher-ng, which just mirrors all the packages being downloaded during update/installation