Skip to content

Instantly share code, notes, and snippets.

@ackerleytng
Last active January 3, 2019 23:17
Show Gist options
  • Save ackerleytng/696b80420e03d985843cd7b38f0da779 to your computer and use it in GitHub Desktop.
Save ackerleytng/696b80420e03d985843cd7b38f0da779 to your computer and use it in GitHub Desktop.
Mirroring centos from mirror.0x.sg
wget --recursive --no-parent --no-host-directories \
--reject 'index.html*' \
--exclude-directories 'centos/2*' \
--exclude-directories 'centos/3*' \
--exclude-directories 'centos/4*' \
--exclude-directories 'centos/5*' \
--exclude-directories 'centos/6*' \
--exclude-directories 'centos/7' \
--reject 'HEADER.html' \
--exclude-directories 'centos/HEADER.images' \
--exclude-directories 'centos/build' \
--reject 'TIME' \
--reject 'dir_sizes' \
--reject 'filelist.gz' \
--reject 'timestamp.txt' \
--exclude-directories 'centos/dostools' \
--exclude-directories 'centos/graphics' \
--exclude-directories 'centos/7*/atomic' \
--exclude-directories 'centos/7*/cloud' \
--exclude-directories 'centos/7*/configmanagement' \
--exclude-directories 'centos/7*/cr' \
--exclude-directories 'centos/7*/dotnet' \
--exclude-directories 'centos/7*/fasttrack' \
--exclude-directories 'centos/7*/isos' \
--exclude-directories 'centos/7*/nfv' \
--exclude-directories 'centos/7*/opstools' \
--exclude-directories 'centos/7*/paas' \
--exclude-directories 'centos/7*/rt' \
--exclude-directories 'centos/7*/sclo' \
--exclude-directories 'centos/7*/storage' \
--exclude-directories 'centos/7*/virt' \
http://mirror.0x.sg/centos/
wget --recursive --no-parent --no-host-directories \
--reject 'index.html*' \
--exclude-directories 'epel/4' \
--exclude-directories 'epel/4AS' \
--exclude-directories 'epel/4ES' \
--exclude-directories 'epel/4WS' \
--exclude-directories 'epel/5' \
--exclude-directories 'epel/5Client' \
--exclude-directories 'epel/5Server' \
--exclude-directories 'epel/6' \
--exclude-directories 'epel/6Server' \
--exclude-directories 'epel/7Server' \
--exclude-directories 'epel/testing' \
--reject 'RPM-GPG-KEY-EPEL' \
--reject 'RPM-GPG-KEY-EPEL-4' \
--reject 'RPM-GPG-KEY-EPEL-5' \
--reject 'RPM-GPG-KEY-EPEL-6' \
--reject 'RPM-GPG-KEY-EPEL-6Server' \
--reject 'RPM-GPG-KEY-EPEL-7Server' \
--reject 'epel-release-latest-6.noarch.rpm' \
--reject 'fullfilelist*' \
--reject 'fullfiletimelist-epel*' \
--reject 'imagelist-epel' \
--reject 'mirrors.nipa.cloud' \
--exclude-directories 'epel/7/SRPMS' \
--exclude-directories 'epel/7/aarch64' \
--exclude-directories 'epel/7/ppc64' \
--exclude-directories 'epel/7/ppc64le' \
--exclude-directories 'epel/7/x86_64/debug' \
--reject 'state' \
http://mirrors.nipa.cloud/epel/
# How I use this file:
# rsync -avrt --no-perms --no-owner --no-group --exclude-from=rsync-mirror-centos rsync://mirror.0x.sg/centos/ ./centos
# Skip the symlinks (7, for example, is symlinked to the latest version in 7)
- 2
- 3
- 4
- 5
- 6
- 7
# Skip earlier versions
- 2.*
- 3.*
- 4.*
- 5.*
- 6.*
# Only mirror keys that we need
+ RPM-GPG-KEY-CentOS-7
+ RPM-GPG-KEY-CentOS-Debug-7
+ RPM-GPG-KEY-CentOS-Testing-7
- RPM-GPG-KEY-CentOS-*
# Stuff we don't need in the root directory on mirror.0x.sg
- HEADER.html
- HEADER.images
- build
- TIME
- dir_sizes
- filelist.gz
- timestamp.txt
- dostools
- graphics
# Don't mirror the repos we don't need
- atomic
- cloud
- configmanagement
- cr
- dotnet
- fasttrack
- isos
- nfv
- opstools
- paas
- rt
- sclo
- storage
- virt
# How I use this file:
# rsync -avrt --no-perms --no-owner --no-group --exclude-from=rsync-mirror-epel rsync://mirrors.nipa.cloud/epel/ ./epel
# Mirror only directories that we need
- 4
- 4AS
- 4ES
- 4WS
- 5
- 5Client
- 5Server
- 6
- 6Server
- testing
- RPM-GPG-KEY-EPEL
- RPM-GPG-KEY-EPEL-4
- RPM-GPG-KEY-EPEL-5
- RPM-GPG-KEY-EPEL-6
- RPM-GPG-KEY-EPEL-6Server
- epel-release-latest-6.noarch.rpm
- fullfilelist
- fullfilelist.AwiES3LjSB
- fullfilelist.KDUVzc9WPK
- fullfiletimelist-epel
- fullfiletimelist-epel.WaO7KUHvYz
- imagelist-epel
- mirrors.nipa.cloud
# Skip architectures we don't need
- SRPMS
- aarch64
- ppc64
- ppc64le
- state
# Skip debug packages
- debug
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment