Clone all repositories of a Github user

clone.bash

curl -s https://api.github.com/users/milanboers/repos | grep \"clone_url\" | awk '{print $2}' | sed -e 's/"//g' -e 's/,//g' | xargs -n1 git clone

Wrote a simple menu based script for this issue:
https://github.com/2kabhishek/ghpm
Check it out if you need a quick and reusable solution

why not pages=500 or counting it and then adjust it to i+1?
Except of that awesome code, especially that you're using ssh for cloneing.

GitHub API has limitation for 100 repos per page, but I have added a fix for that now It can clone all user repos in one go, no matter the count. Also added filtering for user repos only, so we don't get repos from orgs

Awesome!
I still have less than 100 repos so I wasn't able to check if the limit is 100.
But I guess you read the docs.

@BitesizedLion GitHub Archive works as intended and will simply log an error when attempting to clone/pull a repo that has been DMCA'd which is intentional since GitHub won't allow access to the repo once this occurs. For more details, see the discussion on this issue

this one doesn't work without modification, and doesn't paginate

yep it need modification to set username
but sorry what did you mean by 'doesn't paginate' ?

This worked for me, replace the username

curl -s "https://api.github.com/users/raysan5/repos?per_page=100" | jq -r ".[].clone_url" | xargs -L1 git clone

Hopefully:

• you can easily install packages like jq, curl, and xargs and not have a deathmatch with your computer
• the user doesn't have useless forks that are of no interest to you
• github doesn't change the api by the time you read this or above comments

Further I pray you don't have to try to install a Python or JS script (javascript script lol). God help those that do.

If you would prefer to use a cli that can also clone all repos from the GitHub Organization you can download ghorg then run...

# clone all user repos
ghorg clone <user> --clone-type=user --token=<PAT>

# clone all org repos
ghorg clone <org> --token=<PAT>

install jq
clone only original repos not forked
curl -s "https://api.github.com/users/USER/repos?per_page=100" | jq -r '.[] | select(.fork == false) | select(.name).clone_url' | xargs -L1 git clone

Hi all
I wrote a simple script to clone all the repositories from GitHub, either from a user or whole organization. Please check it out, I'm sure you'll find it useful

Hi all I wrote a simple script to clone all the repositories from GitHub, either from a user or whole organization. Please check it out, I'm sure you'll find it useful

Nice script though! Keep in mind that you just crawl 100 each and you don't "loop" over that. So if you have > 100 you will only see 100 per page and no more pages. Hope it makes sense.

I finally switched to 'gickup' in a docker container for this (highly recommend!) which automagically downloads everything you have and anything you have access to.

Hi all I wrote a simple script to clone all the repositories from GitHub, either from a user or whole organization. Please check it out, I'm sure you'll find it useful

Nice script though! Keep in mind that you just crawl 100 each and you don't "loop" over that. So if you have > 100 you will only see 100 per page and no more pages. Hope it makes sense.

I encountered the same issue and made this helper has a bunch of other useful utilities too for managing your github projects

I encountered the same issue and made this helper has a bunch of other useful utilities too for managing your github projects

((page_count = public_repos / 100 + 1))

+10 for this smart move, you fetched the API repo amount and then use it for pagination to expand the crawl limits.

Will try your tool at some time, atm no ongoing tasks for that. But still good job! 👍