Integration (acceptance) tests that use the mediawiki action api and rest apis:
- Take a long time to run (1m30s for #mobile-content-service)
- Locally it destroys any TDD cycle or rapid feedback cycle
- Are brittle to failures and other production conditions on such external services for continuous integration or local development.
There are known solutions for these problems, knowingly recording external http requests by running the tests and caching them, so that subsequent test runs use the cached results. See https://www.ctl.io/developers/blog/post/http-apis-test-code for informative post.
Requirements for such tool: