A collection of scraping tools. ### Platform specific - [[CharacterAI]] - [[TikTok Scrapers]] - [[Twitter Scrapers]] ### General list - [`threads-py`](https://github.com/junhoyeo/threads-py): Unofficial, Reverse-Engineered Python client for Meta's Threads. ### Promising approach [Kevin Carmody](https://skinofstars.com/experience/), from [Who Targets Me](https://github.com/WhoTargetsMe/Who-Targets-Me/tree/master), shared a clever approach for scraping that gets around parsing HTML components (which is prone to break for social media platforms as they periodically update them). The general idea as he described it is to "capture content before it gets to the components." They "overload XHR requests and look for anything to the graphql backend." He shared a link to [this](https://github.com/WhoTargetsMe/Who-Targets-Me/blob/master/src/daemon/collector/overload/overload.js) githubpage from Who Targets Me. --- #### Related #data_collection #scraping