Skip to content

Instantly share code, notes, and snippets.

@kylemcdonald
Last active June 27, 2024 04:09
Show Gist options
  • Save kylemcdonald/8fdabd6526924012c1f5afe538d7dc09 to your computer and use it in GitHub Desktop.
Save kylemcdonald/8fdabd6526924012c1f5afe538d7dc09 to your computer and use it in GitHub Desktop.
Collect video URLs and GPS data for Parler videos.

Parler video GPS data

My goal is to help people researching the spread of far-right movements, and trying to identify people tresspassing at the Capitol on January 6th. Do not contact me about doxxing someone, or leave comments attempting to doxx someone, just because they uploaded a video.

Download the collected CSV data here.

Using metadata collected by https://twitter.com/donk_enby

No rights reserved

image

How to view a video on Parler

Let's say you have a video ID, like wfy02V209EwU taken from this map

The link for the video kiBnNejo0JW0 is at https://video.parler.com/ki/Bn/kiBnNejo0JW0. Notice that the link is: https://video.parler.com/ followed by the first two characters of the video ID, then /, then the next two characters, another /, and the video ID.

But if you click on this, you will get an error.

This is because the Parler video servers are still running (as of January 12) but the Domain Name System (DNS) is not running.

That means that video.parler.com does not get mapped to the video server address correctly.

To fix this, you need to manually patch your system's DNS records. Then you can click on the link.

Mac

  1. Open the Terminal app.
  2. Type sudo nano /etc/hosts
  3. Type your password.
  4. Press the down arrow key until you are past the lines starting with #.
  5. Paste this line: 8.240.242.124 video.parler.com
  6. Type Ctrl+O to save.
  7. Type Ctrl+X to exit.

Windows

Follow these instructions and add the line 8.240.242.124 video.parler.com to your hosts file.

Errors

Some of the videos have been taken down. These will show a message saying "AllAccessDisabled".

Display the source blob
Display the rendered blob
Raw
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@philshem
Copy link

philshem commented Jan 12, 2021

in the file writing step, it should be

for meta in to_download:

instead of

for e in to_download:

also, for the download, you can use wget with a list of urls

wget -i ../washington-area.txt

@bendoh
Copy link

bendoh commented Jan 12, 2021

Is there a way to connect the videos to users / usernames and their posts?

@jeagramonte
Copy link

jeagramonte commented Jan 12, 2021

I would like access to the data if at all possible. Messages and raw footage especially. I would like to help in the crowd source identification of all the participants and their roles. The FBI doesn't have the time or resources to go through every message thread. Please email me at [email protected]

@inarius
Copy link

inarius commented Jan 12, 2021

Is there a way to connect the videos to users / usernames and their posts?

Also would be good to know if a video was marked deleted or private

@andrewortman
Copy link

AFIAK the archiveteam was able to archive most posts from parler, and they are working on getting those in archive.org. Soon, the WARC files will be available and you will be able to see what posts contained what videos using a MR/spark job to go through all of it quickly

@rb0087
Copy link

rb0087 commented Jan 12, 2021

Great work, and thanks for sharing the details! For anyone who is just looking for the relevant video addresses (Jan 6th DC area or Jan 6 Capitol Area), they are available here: https://gofile.io/d/HIADdr . Obviously you would need to have added the IP in your /etc/hosts file as he explained first before you could access these.
Note: I understand that some of the URL's do not work, but many do.

@inarius
Copy link

inarius commented Jan 12, 2021

Great work, and thanks for sharing the details! For anyone who is just looking for the relevant video addresses (Jan 6th DC area or Jan 6 Capitol Area), they are available here: https://gofile.io/d/HIADdr . Obviously you would need to have added the IP in your /etc/hosts file as he explained first before you could access these.
Note: I understand that some of the URL's do not work, but many do.

Thanks for this. I'd also like to point out that many videos with GPS also have a 'CreationDate' field that doesn't always match the file's CreateDate. In a very rough search I found 127 video files within the Capitol geographic area created after 1/6 with a creation stamp on 1/6. Maybe these are re-uploads? Maybe they were files edited on-device before upload? Do you think this changes the number of videos that should be examined?

@aurimasniekis
Copy link

the same CSV file but with just added URL for video https://gofile.io/d/Q9E5zT

@JamesHagerman
Copy link

Excel: = "https://video.parler.com/"&MID(D2,1,2)&"/"&MID(D2,3,2)&"/"&D2&".mp4"

Or just use ☝️ 😄

Copy link

ghost commented Jan 18, 2021

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

Screen Shot 2021-01-18 at 00 38 22

@philshem
Copy link

philshem commented Jan 18, 2021

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

A week ago I found that only 5 of 35 videos taken in Switzerland were recoverable, and for the 30 that I couldn't download, I had a similar message. But the good news is that the Archive Team is working on processing the full archive.

You can monitor the progress here: https://www.archiveteam.org/index.php?title=Parler

@philshem
Copy link

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

The full data is now available for download: https://ddosecrets.com/wiki/Parler

and here is a command to download an individual video

aws s3 cp --request-payer requester s3://ddosecrets-parler/D2fovQB1v4M2 ./D2fovQB1v4M2.mp4

Copy link

ghost commented Jan 25, 2021

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

The full data is now available for download: https://ddosecrets.com/wiki/Parler

and here is a command to download an individual video

aws s3 cp --request-payer requester s3://ddosecrets-parler/D2fovQB1v4M2 ./D2fovQB1v4M2.mp4

Thanks. Since I don't have a card, I'm unable to access the content. I'll just have to remember to get the data in the future when I do have a card.

@philshem
Copy link

Thanks. Since I don't have a card, I'm unable to access the content. I'll just have to remember to get the data in the future when I do have a card.

here you go: https://archive.org/details/parler-D2fovQB1v4M2

direct download link: https://archive.org/download/parler-D2fovQB1v4M2/D2fovQB1v4M2.mp4

Copy link

ghost commented Jan 27, 2021

Thanks! :)

@freedom-fighter2121
Copy link

Is it possible to hack into the bank accounts of Myanmar military generals (most likely in one of the Singaporean banks) and expose how much dirty money they have been stealing from the country? It would also be nice to expose the collaborations between China and General Min Aung Hlaing. Publishing ASEAN members' correspondence regarding Myanmar will also be of great value to the citizens fighting for democracy in Myanmar. Thanking you in advance for your invaluable assistance.

Copy link

ghost commented Mar 1, 2021

Is it possible to hack into the bank accounts of Myanmar military generals (most likely in one of the Singaporean banks) and expose how much dirty money they have been stealing from the country? It would also be nice to expose the collaborations between China and General Min Aung Hlaing. Publishing ASEAN members' correspondence regarding Myanmar will also be of great value to the citizens fighting for democracy in Myanmar. Thanking you in advance for your invaluable assistance.

???

This isn't the movies. Even if we knew how to do that, I wouldn't recommend doing that.

@freedom-fighter2121
Copy link

freedom-fighter2121 commented Mar 20, 2021 via email

@freedom-fighter2121
Copy link

freedom-fighter2121 commented Mar 21, 2021 via email

@abrahami
Copy link

abrahami commented Apr 7, 2021

Is there a way to connect the videos to users / usernames and their posts?

Did anyone find a way to do so?

@kylemcdonald
Copy link
Author

kylemcdonald commented Apr 10, 2021

A few quick notes for anyone still following this. This original GoFile link has been taken down, but it might still be available at this magnet URL:

magnet:?xt=urn:btih:1723e27bc79186c4574ff056ddb458d771c26e2f&dn=metadata.tar.gz&tr=wss%3A%2F%2Ftracker.btorrent.xyz&tr=wss%3A%2F%2Ftracker.openwebtorrent.com&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fexplodie.org%3A6969&tr=udp%3A%2F%2

The SHA256 is 66809d9ae0a5a6577a3c80bb623562274ceccd96b35519f15f568d09cefc56f8.

For connecting videos to usernames and posts, check this dataset from Aliapoulios et al. I've also done some plots of term frequency.

If you are specifically interested in posts from January 6/7 please check the massive JSON linked to by this tweet. (direct link to torrent)

This may be the same as the 18GB torrent provided by DDOSecrets but I haven't checked.

@jderekito
Copy link

Hello,
I have a couple of questions: 1) is there location data and 2) can you identify the users across locations?
Thanks,
Derek

@jderekito
Copy link

Is there a way to connect the videos to users / usernames and their posts?

Hello. I have this same question. Did you get it answered per chance? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment