betteradbcopy - Multi-threaded SCP to/from Android device over USB/WiFi with Termux

betteradbcopy

#!/bin/bash
# Make sure to have OpenSSH setup in Termux as well as setting a password with `passwd` 
# Requires https://github.com/upa/mscp and adb platform tools on your local machine

init_sshd() {
        adb shell -t "run-as com.termux files/usr/bin/bash -lic 'export PATH=/data/data/com.termux/files/usr/bin:$PATH; export LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so; sshd'"
        adb forward tcp:8022 tcp:8022; 
}
stop_sshd() {
        adb shell -t "run-as com.termux files/usr/bin/bash -lic 'export PATH=/data/data/com.termux/files/usr/bin:$PATH; export LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so; killall sshd'"
        adb forward --remove tcp:8022;
}

pull_path="$2"
case "$1" in
        pull)
                init_sshd
                mscp -P 8022 [email protected]:"$pull_path" .
                stop_sshd
                ;;
        push)
                push_path="$3"
                init_sshd
                mscp -P 8022 "$pull_path" [email protected]:"$push_path"
                stop_sshd
                ;;
        *)
                echo "Invalid option"
                ;;
esac

Transferred 50 gigabytes of fairly small files from the phone in just shy of 14 minutes. I plan on implementing push as well, eventually.

(deck@steamdeck 3DLiveScanner)$ ~/Downloads/Packages/mscp.linux.x86_64.static -P 8022 [email protected]:/storage/3139-3238/Documents/.Old/ .
Password: 
[====================================================================================] 100% 31.0GB/31.0GB   59.2MB/s  09:23 

(deck@steamdeck 3DLiveScanner)$ ~/Downloads/Packages/mscp.linux.x86_64.static -P 8022 [email protected]:/sdcard/Documents/ .
Password: 
[====================================================================================] 100% 19.6GB/19.6GB   74.4MB/s  04:43    

EDIT: Updated with push

ohhhhhh thanksies will sure find use for that sometime

Comparison with adb push/pull with the same data set

(deck@steamdeck speed_test)$ time betteradbcopy push . /sdcard/speed_test/
8022
Password: 
[====================================================================================] 100% 10.0GB/10.0GB   24.9MB/s  07:12    

real    7m14.266s
user    1m26.889s
sys     1m4.384s
(deck@steamdeck speed_test)$ time adb push . /sdcard/speed_test/
./: 21757 files pushed, 0 skipped. 9.9 MB/s (10749811472 bytes in 1040.715s)

real    17m20.734s
user    0m44.581s
sys     0m10.049s
(deck@steamdeck speed_test)$ rm -rf *
(deck@steamdeck speed_test)$ time betteradbcopy pull /sdcard/speed_test/
8022
Password: 
[====================================================================================] 100% 10.0GB/10.0GB   58.3MB/s  03:04    

real    3m7.590s
user    1m16.308s
sys     1m21.279s
(deck@steamdeck speed_test)$ rm -rf *
(deck@steamdeck speed_test)$ time adb pull /sdcard/speed_test/
/sdcard/speed_test/: 21757 files pulled, 0 skipped. 14.1 MB/s (10749811472 bytes in 726.675s)

real    12m6.696s
user    0m1.944s
sys     0m21.217s

[unawesome@unawesomePC]$ ./betteradbcopy pull /sdcard/
bash: syntax error near unexpected token `('
8022
Password:
stat: /sdcard/ Permission denied
total 0 byte transferred
bash: syntax error near unexpected token `('

I'm having a bit of trouble running it. I have installed mscp and set passwd but it doesn't seem to work. Any possible solution?

[unawesome@unawesomePC]$ ./betteradbcopy pull /sdcard/
bash: syntax error near unexpected token `('
8022
Password:
stat: /sdcard/ Permission denied
total 0 byte transferred
bash: syntax error near unexpected token `('

I'm having a bit of trouble running it. I have installed mscp and set passwd but it doesn't seem to work. Any possible solution?

So you have Termux on the phone, OpenSSH installed, password set, and granted storage? termux-setup-storage

Not sure why the adb invocation is producing the unexpected token.

After verifying everything above post your output for

bash -x ./betteradbcopy pull /sdcard/

So we can get an idea of what is being built out as it's running.

Termux on phone, openssh installed, password set and termux-setup-storage has been run

[unawesomeguy@unawesomepc unawesomeguy]$ bash -x ./betteradbcopy pull /sdcard/
+ pull_path=/sdcard/
+ case "$1" in
+ init_sshd
+ adb shell -t 'run-as com.termux files/usr/bin/bash -lic '\''export PATH=/data/data/com.termux/files/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files (x86)/Eclipse Adoptium/jdk-8.0.322.6-hotspot/bin:/mnt/c/Program Files (x86)/Eclipse Adoptium/jre-8.0.322.6-hotspot/bin:/mnt/c/Program Files (x86)/Eclipse Adoptium/jre-11.0.14.101-hotspot/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA NvDLISR:/mnt/c/ProgramData/chocolatey/bin:/mnt/c/Program Files/OpenJDK/openjdk-8u312-b07-jre/bin:/mnt/c/Program Files/OpenJDK/openjdk-11.0.13_8-jre/bin:/mnt/g/Util/A/platform-tools:/mnt/c/Program Files/dotnet/:/mnt/c/WINDOWS/system32:/mnt/c/WINDOWS:/mnt/c/WINDOWS/System32/Wbem:/mnt/c/WINDOWS/System32/WindowsPowerShell/v1.0/:/mnt/c/WINDOWS/System32/OpenSSH/:/mnt/g/mmm:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files (x86)/ZeroTier/One/:/mnt/c/Program Files/nodejs/:/mnt/c/Program Files/Docker/Docker/resources/bin:/mnt/c/Program Files/gsudo/Current:/mnt/c/Program Files/WireGuard/:/mnt/c/Users/unawesomeguy/AppData/Local/Programs/Python/Python310/Scripts/:/mnt/c/Users/unawesomeguy/AppData/Local/Programs/Python/Python310/:/mnt/c/Users/unawesomeguy/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/unawesomeguy/AppData/Roaming/npm:/mnt/c/Users/unawesomeguy/Desktop/SillyTavern - Copy/TavernAI-extras/ss; export LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so; sshd'\'''
bash: syntax error near unexpected token `('
+ adb forward tcp:8022 tcp:8022
8022
+ mscp -P 8022 [email protected]:/sdcard/ .
Password:
stat: /sdcard/ Permission denied
total 0 byte transferred
+ stop_sshd
+ adb shell -t 'run-as com.termux files/usr/bin/bash -lic '\''export PATH=/data/data/com.termux/files/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files (x86)/Eclipse Adoptium/jdk-8.0.322.6-hotspot/bin:/mnt/c/Program Files (x86)/Eclipse Adoptium/jre-8.0.322.6-hotspot/bin:/mnt/c/Program Files (x86)/Eclipse Adoptium/jre-11.0.14.101-hotspot/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA NvDLISR:/mnt/c/ProgramData/chocolatey/bin:/mnt/c/Program Files/OpenJDK/openjdk-8u312-b07-jre/bin:/mnt/c/Program Files/OpenJDK/openjdk-11.0.13_8-jre/bin:/mnt/g/Util/A/platform-tools:/mnt/c/Program Files/dotnet/:/mnt/c/WINDOWS/system32:/mnt/c/WINDOWS:/mnt/c/WINDOWS/System32/Wbem:/mnt/c/WINDOWS/System32/WindowsPowerShell/v1.0/:/mnt/c/WINDOWS/System32/OpenSSH/:/mnt/g/mmm:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files (x86)/ZeroTier/One/:/mnt/c/Program Files/nodejs/:/mnt/c/Program Files/Docker/Docker/resources/bin:/mnt/c/Program Files/gsudo/Current:/mnt/c/Program Files/WireGuard/:/mnt/c/Users/unawesomeguy/AppData/Local/Programs/Python/Python310/Scripts/:/mnt/c/Users/unawesomeguy/AppData/Local/Programs/Python/Python310/:/mnt/c/Users/unawesomeguy/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/unawesomeguy/AppData/Roaming/npm:/mnt/c/Users/unawesomeguy/Desktop/SillyTavern - Copy/TavernAI-extras/ss; export LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so; killall sshd'\'''
bash: syntax error near unexpected token `('
+ adb forward --remove tcp:8022

I guess it doesn't expect to be ran on WSL2 but I don't understand why permission is denied. I tried passwd only and passwd parker. I'm also connecting adb using WiFi.

You need to escape the path in the adb command. Mine was pulling in the computer path as well, but because it was all Unix, it didn't mess with it.

files/usr/bin/bash -lic 'export PATH=/data/data/com.termux/files/usr/bin:"$PATH"; export

It's either double or single quotes I don't recall exactly.

Worst comes to worse. I guess it's not really needed since mine was all garbage too.

files/usr/bin/bash -lic 'export PATH=/data/data/com.termux/files/usr/bin; export

That solved one problem but stat: /sdcard/ Permission denied is still an issue.

And you can list the SD card within termux directly?

Only thing I can think of is maybe try removing the trailing forward slash.

pull /sdcard

I can cd into sdcard and make it show the files. I tried what you suggested and it's just the same.

Ok this must be something new with Android 14. I'm seeing the same error here. I can list in Termux but not over the adb shell termux wrapper or SSH.

I'll let you know if I get it working.

In the meantime, the proper fix for path is \ escaping the $

adb shell -t "run-as com.termux files/usr/bin/bash -lic 'export PATH=/data/data/com.termux/files/usr/bin:\$PATH; export LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so; bash'"```

Thanks for the script, transferring my photos/videos with 250MB/s now. Much better than mtp.

That solved one problem but stat: /sdcard/ Permission denied is still an issue.

But you did give Termux access to files right? :P

I've figured out the solution. The way to correctly allow permissions is to disable files permission, termux-setup-storage, enable files permission and it would work.