flâneur — a map of the web's best reading

LibGen's Bloat Problem

liberalgeneral.neocities.org · 336 words · saved by 1 readers

Edit: I feel compelled to make a small clarification; I'm not arguing for purging all files greater than X MiB (even though I still think LibGen has a non-negligible amount of junk and duplicate content but neither are easy to remove without significant manpower and LibGen lacks mechanisms to crowdsource the work). Instead, I'm advocating a leaner and more "practical" version of LibGen that is easier to self-host and distribute. An extreme example of such is libgen-text, LibGen in a text only form.

LibGen's Bloat Problem LibGen's Bloat Problem 2022-08-21 LibGen and Sci-Hub are my two most favorite resources on the Internet, an utopia came true through the herculean efforts of few individuals taking massive risks and thousands of active contributors donating their time, bandwidth, and/or money. The database dump of LibGen I have at hand tells that the library has around 3.16M non-fiction e-books with a total 51.50 TB. The more the merrier of course, although its magnitude makes it more difficult to redistribute/decentralize the collection. Unfortunately LibGen is full of duplicate books,

Explore this link on the map →

related reading