- Shodan : community access + commercial access
- Censys : community + commercial access (access posible for independent researchers)
- ZoomEye : community + commercial access
- Onyphe : community + commercial access
- BinaryEdge : commercial access only
Twitter allows users to download parts of their data, see How to download your Twitter archive.
But what's not included in that data dump is the usernames/handles of the people that you follow or are following you. All you get is account IDs which is just an internal number and so a bit useless when it comes to archival.
Here's a way to get that data (you need to know how to run stuff in the terminal):
- Go to your Twitter profile in a desktop browser (Firefox or Chrome)
- Right click on page → Inspect → Network tab
- Click on the Following link (e.g. https://twitter.com/{yourusername}/following)
The following guide was copied from our private internal documentation, but there's nothing private in it, we just don't have anywhere to publish documentation like this. By the time you read it, it will likely be out of date and may not reflect our current practice. Some references to our internal configuration management remain; you'll have to figure those bits out for yourself.
Provisioning of PostgreSQL replicas is complicated. It's more complicated still if we want to use secure authentication, which is why we haven't done it before (despite the best of intentions). This guide will follow my (wollman's) process in setting this up for