Skip to content

Instantly share code, notes, and snippets.

@natefoo
Last active April 30, 2025 14:36
Show Gist options
  • Save natefoo/e486ac27f189db7a0c1aa51e1b3332eb to your computer and use it in GitHub Desktop.
Save natefoo/e486ac27f189db7a0c1aa51e1b3332eb to your computer and use it in GitHub Desktop.
Singularity image download and conversion test

curl from depot

Total time: 10s

[rocky@js2-gxit-medium1 ~]$ curl -o test.sif https://depot.galaxyproject.org/singularity/biobb_wf_mutations%3A0.0.6--py_0
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  572M  100  572M    0     0  14.4M      0  0:00:39  0:00:39 --:--:-- 17.1M

Docker pull

Total time: 56s

[rocky@js2-gxit-medium1 ~]$ time docker pull quay.io/biocontainers/biobb_wf_mutations:0.0.6--py_0
0.0.6--py_0: Pulling from biocontainers/biobb_wf_mutations
4f4fb700ef54: Pull complete
b0dc45cd432d: Pull complete
9466b3513669: Pull complete
ddd482ea7b54: Pull complete
7ff999a2256f: Pull complete
e7c454e5167d: Pull complete
dfda3e01f2b6: Pull complete
10c3bb32200b: Pull complete
c6140d3abc11: Pull complete
Digest: sha256:1ba4802bea11a7c4814b999a69d796fe6cf701fc2bb6176ba905440e7f004d10
Status: Downloaded newer image for quay.io/biocontainers/biobb_wf_mutations:0.0.6--py_0
quay.io/biocontainers/biobb_wf_mutations:0.0.6--py_0

real	0m56.129s
user	0m0.039s
sys	0m0.054s

Apptainer build, block storage

Total time: 5m 24s

[rocky@js2-gxit-medium1 ~]$ time apptainer build test.sif docker://quay.io/biocontainers/biobb_wf_mutations:0.0.6--py_0
INFO:    Starting build...
Copying blob e7c454e5167d done   |
Copying blob 4f4fb700ef54 done   |
Copying blob b0dc45cd432d done   |
Copying blob 9466b3513669 done   |
Copying blob ddd482ea7b54 done   |
Copying blob 7ff999a2256f done   |
Copying blob dfda3e01f2b6 done   |
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 10c3bb32200b done   |
Copying blob c6140d3abc11 done   |
Copying config 0cb2714f13 done   |
Writing manifest to image destination
2025/04/30 13:53:51  info unpack layer: sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1
2025/04/30 13:53:51  info unpack layer: sha256:b0dc45cd432d14fb6df7d3239dc15d09c63906f8e7bfd373a4647b107fc3746c
2025/04/30 13:53:51  warn rootless{dev/console} creating empty file in place of device 5:1
2025/04/30 13:53:51  info unpack layer: sha256:9466b3513669459396338a74673ede0166f534ab64923f66ecca58176d1ffe5e
2025/04/30 13:53:51  info unpack layer: sha256:ddd482ea7b54727ff2b6748188290b75f6441ba4091d15a5e62d2a0ed47c81dd
2025/04/30 13:53:51  info unpack layer: sha256:7ff999a2256f84141f17d07d26539acea8a4d9c149fefbbcc9a8b4d15ea32de7
2025/04/30 13:53:51  info unpack layer: sha256:e7c454e5167ddab5101c53d104c90c0a037c3ee3930b9a74a14da40c852134cc
2025/04/30 13:53:51  info unpack layer: sha256:dfda3e01f2b637b7b89adb401f2f763d592fcedd2937240e2eb3286fabce55f0
2025/04/30 13:53:51  info unpack layer: sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1
2025/04/30 13:53:51  info unpack layer: sha256:10c3bb32200bdb5006b484c59b5f0c71b4dbab611d33fca816cd44f9f5ce9e3c
2025/04/30 13:53:51  info unpack layer: sha256:c6140d3abc119d17ab908b4db3b2c9e9a27a708000a8fa16d6bb74b2dc1d5335
INFO:    Creating SIF file...
INFO:    Build complete: test.sif

real	5m24.261s
user	4m56.349s
sys	0m13.710s

Apptainer build, shared storage

Total time: 30m 46s

[rocky@js2-gxit-medium1 ~]$ APPTAINER_CACHEDIR=/jetstream2/scratch/rocky/singularity/cache APPTAINER_TMPDIR=/jetstream2/scratch/rocky/singularity/tmp time apptainer build /jetstream2/scratch/rocky/singularity/test.sif docker://quay.io/biocontainers/biobb_wf_mutations:0.0.6--py_0
WARNING: 'nodev' mount option set on /jetstream2/scratch, it could be a source of failure during build process
INFO:    Starting build...
Copying blob b0dc45cd432d done   |
Copying blob e7c454e5167d done   |
Copying blob 4f4fb700ef54 done   |
Copying blob 9466b3513669 done   |
Copying blob ddd482ea7b54 done   |
Copying blob 7ff999a2256f done   |
Copying blob dfda3e01f2b6 done   |
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 10c3bb32200b done   |
Copying blob c6140d3abc11 done   |
Copying config 0cb2714f13 done   |
Writing manifest to image destination
2025/04/30 14:02:42  info unpack layer: sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1
2025/04/30 14:02:42  info unpack layer: sha256:b0dc45cd432d14fb6df7d3239dc15d09c63906f8e7bfd373a4647b107fc3746c
2025/04/30 14:02:43  warn rootless{dev/console} creating empty file in place of device 5:1
2025/04/30 14:02:48  info unpack layer: sha256:9466b3513669459396338a74673ede0166f534ab64923f66ecca58176d1ffe5e
2025/04/30 14:02:48  info unpack layer: sha256:ddd482ea7b54727ff2b6748188290b75f6441ba4091d15a5e62d2a0ed47c81dd
2025/04/30 14:02:48  info unpack layer: sha256:7ff999a2256f84141f17d07d26539acea8a4d9c149fefbbcc9a8b4d15ea32de7
2025/04/30 14:02:48  info unpack layer: sha256:e7c454e5167ddab5101c53d104c90c0a037c3ee3930b9a74a14da40c852134cc
2025/04/30 14:02:49  info unpack layer: sha256:dfda3e01f2b637b7b89adb401f2f763d592fcedd2937240e2eb3286fabce55f0
2025/04/30 14:02:49  info unpack layer: sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1
2025/04/30 14:02:49  info unpack layer: sha256:10c3bb32200bdb5006b484c59b5f0c71b4dbab611d33fca816cd44f9f5ce9e3c
2025/04/30 14:02:49  info unpack layer: sha256:c6140d3abc119d17ab908b4db3b2c9e9a27a708000a8fa16d6bb74b2dc1d5335
INFO:    Creating SIF file...
INFO:    Build complete: /jetstream2/scratch/rocky/singularity/test.sif

314.46  user
210.74  system
30:46.20  elapsed
28%CPU (0avgtext+0avgdata 1654420maxresident)k
0inputs+1856outputs (0major+447110minor)pagefaults 0swaps
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment