Wed, 22 Mar 2023 12:59:17 GMT

TudbuT: Come-back of UA-post-archive

I used to host an archiver for reddit posts about the russo-ukrainian war on https://tudbut.de. I shut this down when I ran out of space to store all of the posts. Now, I am considering starting this back up again as I think it could still be of use.

What do you think?

Here's some more info on what it used to do:

> Scraping sources

Posts were scraped from Reddit, tho I intend[ed] to add a Twitter scraper as well, which I now do not anymore because Twitter has gone to shit.

Subreddits:
- r/WW3
- r/CombatFootage
- r/openrussia
- r/ukraine
- r/UkraineWarReports
- r/RussianWarCrimes
- r/RussiaUkraineWar2022
- r/UkrainianConflict
- r/RussianWarSecrets
- r/RussiaWarInUkraine

> Features

- Reddit posts scraped every 10 seconds
- New Reddit posts were converted to TheForum posts
- They were mirrored to a Discord server
- As usual with TheForum, all posts were put into a JSON file.

---

The limiting factor right now is the JSON file and my storage space. I think I'd need to add some sort of compression (maybe?), or optimize the JSON reading/writing so it won't take so much CPU by writing it all the time.

However, the storage space issue is not solvable for me alone and I'd need to set up some donation page so I can buy more storage and use that for the server.

Signed:

52e9235ff5379dc5d93dc2f10ce9553c88b66809751396aa0fdec60aadb967a5