Try adding {posargs} in the commands section of your tox.ini, like this:
commands =
python manage.py test {posargs}
Then at the command line, something like:
tox -- --pattern='some_specific_test.py'
Everything after the -- will be substituted in as {posargs}