Archiving like a boss! (UPDATE)

4 min read

Deviation Actions

Lahirien's avatar
By
Published:
4.2K Views
Stupid me deleted all the old rips. I'm working on getting a new one.

Update: Current as of 8/29/13. New download link: docs.google.com/file/d/0B38kVw…

Most of the description below still applies. Download is now in 7z format www.7-zip.org/ to avoid breaking some poor computer that tries to open it with the clunky windows zipper.

Addendum: This time, the archive rip consists of 83,784 files. No, they haven't written quite that many new fics in six months, I just didn't prune the lowest size entries this time. Previously, I deleted everything below 3 KB. These small files are either fics where no more than the title has been written, epubs that are broken for one reason or another (I suspect they're the very first stage of pre-publishing), or a few empty placeholders. Whatever they are, you can safely ignore them unless you're specifically looking for them and you know they're supposed to be complete, in which case you can download a replacement manually. I just kept everything so I'd have an exhaustive title reference while I work through the five-stars and four-stars so I don't run into anything that is completely missing. It's a bit less work now, since these come *almost* fully tagged, but I still have to gather them manually.

Also, remember... This has EVERYTHING on Fimfiction. Use caution unless you want to be scarred for life.






So I've managed to pull a copy of (as far as I can tell) every single story on FimFiction in EPUB format. That's forty-thousand files! Even with the best download manager I could find, using FimFiction's sequential numbering scheme, queueing 40,000 files was almost more than my poor computer could handle.

It's a raw rip, so the file names are a bit messy, for example "its-always-sunny-in-fillydelphia-story=20936.epub", though the Title and Author tags, at least, are intact. It weighs 1.13 GB, is current as of February 9, and may take up to 20 minutes to decompress due to the sheer number of files. If you are feeling adventurous, or are a fellow archive warrior or fanfic connoisseur, here's the download link. docs.google.com/file/d/0B38kVw… (Warning, this has EVERY fanfic on FimFiction, including the ones I'd rather not think about, and the ones that aren't much more than a title.)

I'm also in the process of making a much more organized and fully tagged Kindle Collection using only the fanfics that were good enough to make it to Equestria Daily. I am tagging each one, including their descriptions, completely by hand, thus it's obviously taking a while, and isn't ready for release yet. After 5 months, and 900 fanfics later, I've finished tagging the entirity of Nallar's Collection (nallar.me/fics/?order=length). Since that collection only contains fics that are hosted on Google Docs, I still have more work to do to get the others, thus the crazy FimFiction rip above. If that number on EqD is right, I have about 1500 more to go.

Obviously this endeavor will never really be complete, since new fics are being written all the time, but if I get enough interest, I will release the collection as it currently exists on my Kindle (just the stuff from Nallar).

(You may also be interested in my BGM and Everfree collections. fav.me/d5vrqn4)

(In case you were wondering, yes, I am indeed completely insane.)


© 2013 - 2024 Lahirien
Comments37
Join the community to add your comment. Already a deviant? Log In
ybnrmalatall's avatar
Uh, ya'll can just use calibre and fanficfare, ya know?