Audiofic Archive: Crowd Sourcing Options

[paraka]

Has everyone been missing the Audiofic Archive as much as I have? As we've all probably noticed by now, there are a lot of dead links on the archive. I was really hoping we'd have results from the backups by now, but since we haven't had a status update in a while and since I know archivists have been quietly trying to upload what they can of the backlog, I thought it would be useful to approach it in an organized fashion.

To start off, the amazing kronos999 wrote a script that went through the AA and tested all the links that linked to a .zip file. This produced a list of about 20K missing files.

Now there are ways of transferring files from server to server without having to download the file in between. This won't work with most file sharing sites like box or mediafire, but works perfectly for people who host on ParakaProductions. Of those 20K missing files, about 9.5K are podfics by podficcers who host with ParakaProductions.

I've created a Google Doc with this info.

If you're an archivist
If you're an archivist interested in uploading some of the missing files, the best use of your time would be to upload the files in the "Missing Files (not on PP)" tab. These files are going to have to be manually uploaded (unless the restores come through).

If you're not an archivist
If you're not an archivist you can still help! You can:

• Help track down PP links. In order to transfer the file from server to server, I need to match an active link from ParakaProductions to the missing .zip file. It would save me a ton of time if people could help me gather that info. Go to the "PP to Transfer" tab, pick a podficcer (they're arranged alphabetically by podficcer) and go through their AO3/LJ/Amplificathon posts and match the download links to the podfic. There's an empty column (H) at the end of each row, just put the link in there.


• Upload Files.
If you have podfics in the "Missing Files (not on PP)" tab, and you already have hosting with me, create a temporary folder, upload the podfic, and drop me a link, I'll transfer it to the AA and will let you know to delete it from your server.
If you don't have hosting with me, but feel comfortable using an FTP, email me, and I'll send you a temporary place to upload them to ParakaProductions so we can get them transferred.

My email is parakaproductions at gmail dot com

Note: I've been moving files to the "Done" tab once they're uploaded, but even if others don't, I've set up the first column of both lists of missing files to be a check against a list of files that I pull down periodically (about once a day) of the files in the audfile folder on the AA. If the file has been uploaded, the start of the row will read "Done" otherwise it'll read #N/A.

Comments

[luzula]

A lot of my podfics are on the "Missing Files (not on PP)" tab, but luckily I have backups of everything (as mp3:s, if not m4b:s). I'm sure I can figure out the FTP thing, so please do get me somewhere to upload them. I'm going away tomorrow and won't get back until Monday, though, so no hurry.

And you are awesome for doing this!

[paraka]

Can you let me know what your email is? Either by emailing me or leaving a comment here? I'll send you a password for the FTP, I just don't want to publicly post it here in case garbage ends up up there if a bot finds the info. :)

[podfic_lover]

Hi Luz, I´m happy to help with the m4b audiobooks of your podfics. I should have most of them, especially the ones I made for you.

[desireearmfeldt]

Have pinged you via email. Thanks for doing this!

[paraka]

I have responded!

[susan_voight]

I asked that my podfics be taken off the archive quite a while ago, so please, don't restore my stuff! If you could take it off the missing tab that would be great, even. Thanks!

[paraka]

Ahh, I've deleted you from the spreadsheet, sorry! We had done the initial data pull back in June, and had only updated to check if the files were added, not if the entries had been deleted.

[kitsuneheart]

Woah...this is...amazing.

What's going to be our policy on modified stuff? For example, my personal podfic collection is vast, but I've converted everything to 32kbps, so I could store more. Still go looking for originals, or should I just upload what I have?

[fire_juggler]

Second this. I have a ton of podfic, but I've converted everything I have to m4b for my personal collection if it was originally mp3. And some I've added some (really crappy covers to, so I can find them easily). I could re-convert them to mp3, but there is probably some loss of quality.

[opalsong]

I said this on twitter but I'll say it here so everyone can see it: I have all of my podfics (including any multi-voice ones I was a main part (see 1 of 3 people) of or produced). I'm also an archivist so I'll handle everything of mine.

[anatsuno]

I probably have all of my podfic - will look into it next week (after my work deadline). I grabbed and copied all the lines about my podfics from the "missing files (not on PP)" tabs for now to help me gather everything listed. I feel comfortable using FTP to upload them to you for transfer so I'll email to ask for instructions.

If I'm not mistaken, the best for you would be that every podfic I find and mean to upload to you be first zipped and and the zip renamed to correspond to the zip file name listed for that podfic in the google spreadsheet, yeah?

thank you for this push, it's an amazing effort! <33

[xancredible]

I'd like a to know about the zipping as well? I've already uploaded a bunch of fics and commented on the spreadsheet with the links. I still have a bunch of files to go through and I'd rather know beforehand if they needed to be zipped with the correct file name, or if the "bare" files were enough? Since it wasn't mentioned in your post, paraka, that files need to be re-zipped. Since you asked to have other PP files tracked down and linked, and those definitely weren't zipped with the corresponding archive file name, I'm assuming you have an "easy" way of re-zipping and renaming the files once you have a PP link?

I'm hoping this theory proves correct, because, as I've said, I've already uploaded a bunch, and still have more to come. If you did want them pre-zipped, since I'm uploading them form my hard drive anyway, let me know asap, please! I'll be sure to zip whatever I haven't uploaded by then yet (or repeat the whole process with anything that's already up).

[ayremis]

I'd like to help and I have some of the "Missing Files (not on PP)". I have sent you an e-mail.

Thank you for doing this :)

[podfic_lover]

I´m also happy to use the FTP option for my various missing podfics and I'm going to email you next.

Thank you for organizing!

[pennyplainknits]

There's no way I have all of my podfics though I know several friends have chunks of them, and the kind listeners in this post http://amplificathon.dreamwidth.org/3061255.html have more

I have to say this whole thing has really put me off ever making podfic again-- just the thought of all that is lost is so demoralising

[xancredible]

Noooooo, don't stop! I love your podfics D:

[thilia]

I have all of my own mp3 podfics (most of which are on the missing list) on my computer and on dropbox. I can upload them... would the FTP thing make things much easier or should I submit them the regular way with my dropbox links? If so, I'll try to figure out the FTP thing this weekend or sometime next week!

I also have like, probably 80ish % of all the Teen Wolf podfics in original quality (mostly mp3s) that are on AO3 with only the "iTunes info" of the files slightly modified, so I guess I'll wait for the original podficcers to upload them themselves and if they're not up after a while, I'll start submitting those?

Also, if you're still looking for archivists, I think I'll have some time now, so... I volunteer! :D (or I guess I should do that in one of the posts that are actually about becoming an archivist :p)

[juniperphoenix]

My podfics are on the Missing Files (not on PP) list. A while back I sent a message through the archive contact form letting the archivists know where they can get my files. Should I do this too? Sorry to be obtuse; I'm just not sure how this overlaps with existing efforts, and I don't want to duplicate work for anyone.

[paraka]

Unfortunately the people who are in charge of the archive (including that email) and the rest of the archivists aren't really in communication these days? So these efforts are being done separately. :S So if you could add your info to this spreadsheet it would certainly get your podfics up faster.

[paraka]

*delayed response*
Are you refreshing that list programmatically?
The list is updated semi-automatically. Whenever I work on the list I'll pull down a complete list of the files in the audfiles folder on the archive and copy it into the files tab of the spreadsheet. Column A of the 3 active tabs is a vlookup against that files tab to see if the .zip file is listed: if the .zip file is listed in that tab, it changes to "Done", otherwise it shows as "#N/A".

I generally update that tab multiple times a day, however I might update it 10 times in over 2 hours, then it'll remain static the rest of the day, so it can get a little out of date.

How I do, methods I've learned to go faster. Anyone else have tools?

[kitsuneheart]

1) I pick a prolific podficcer to focus on. I have a spreadsheet here, with everyone listed by number of fics needed and a link to their reader page. https://docs.google.com/spreadsheets/d/1AmPQW23BRgHbjHj1fNfYKZ6J5_AHkgvUa_yR1poX0sA/edit?usp=sharing

2) After picking someone, I go to Paraka's spreadsheet, on a different window. One window has the podficcer's posts, the other the spreadsheet, and I just go through, new-tab-opening the "link to podficcer" bit of each post, until I've reached the end (or my computer complains about RAM).

3) I go through those opened tabs and get whatever downloads I can. To make this easier, I use the Chrono Sniffer extension (https://chrome.google.com/webstore/detail/chrono-download-manager/mciiogijehkdemklbdcbfkefimifhecn?hl=en) so I can pull any direct links automatically, and I went into my Chrome settings to change it so I don't get asked where things will be saved for every download (Settings>Show Advanced Settings>Downloads>Unclick the check mark about asking where to save). It also seems to make downloading from MediaFire less onerous!

4) If there's m4a, m4b, or other files needed, I run them through Freemake Audio Converter. (http://www.freemake.com/free_audio_converter/) This will get me from mp3 to m4a or m4a to mp3.
a) It's not quite the same as the original m4b files, but those are pretty much all gone, since the podficcers generally didn't make the early m4b files themselves, it was done by archivers. I opt for "optimal quality" in my conversions, so the converted files are still very good.

5) Freemake only makes m4a files. M4b files are the same file as an m4a file, just with the extension changed. To get m4b files, I run a command line script in the folder where the files are being kept.
a) To have JUST m4b files at the end, run: rename *.m4a *.m4b
b) For m4b AND m4a files, run: xcopy *.m4a *.m4b

6) Sort mp3, m4a, and m4b files into separate folders. This is important for the zipping, do not skip. Also, put already-zipped files into a folder, so they don't get re-zipped.

7) For zipping, I use 7-zip (http://www.7-zip.org/download.html), which allows me to use a script to zip everything at once. It is: for %i IN (*.*) DO "c:\Program Files\7-Zip\7z.exe" a "%~ni.zip" "%i"
a) If you install 7-zip elsewhere on your computer, you'll need to change the location in the above script.
b) Again, if you have not sorted out the files, files with the same name (ignoring suffixes) will be put into the same zipped file or just overwritten. So your mp3, m4a, and m4b versions will all be in the same zipped file, or just be left out.

8) Zip up folders, since the script doesn't do folders.

9) Go back to original spreadsheet and proceed to rename all the zipped files with the appropriate archive name.

10) For whatever is left, contact the podficcer to see if they have copies. After a week of them looking or of no communication, I'll upload my versions of the fics (which have metadata changed, so they're less-optimal, but still better than nothing).




....WHEW. It's all a lot faster than it sounds from typing.

So...anyone else have tools they use to go faster? I only discovered most of these BECAUSE of re-archiving things, so I'm curious what more tech-savvy people might be using.

Re: How I do, methods I've learned to go faster. Anyone else have tools?

[glittertine]

<3 thanks for sharing your methodology!

[arabiana]

Hi paraka! I did a lot of work on the PP transfer file tab yesterday. I think maybe 500 links? I just wanted to make sure that everything I had done was correct? If you could maybe take a look I would appreciate it!

[paraka]

Whoa! Great job! They all looked good and most should be transferred now. :)

[glovered]

Hi I'd love to help with this

[glovered]

Whoops, it sent before I'd finished the comment. I'd love to help with this but I want to make sure I'm finding the right links. The links people seem to be adding to the spreadsheet start with the podficcer's name, ie http://cantarina.parakaproductions.com/... whereas the ones I'm finding on AO3 are http://parakaproductions.com/audio/TSCC-The%20Once%20and%20Future%20King%20by%20indiefic-cantarina,paraka.mp3

Does that link look correct? I want to make sure before doing a bunch!

I have some

[vamous]

I saw something from glovered that said you were looking for lost podfic. I pretty much downloaded anything that was Sam/Dean or Jensen/Jared, or anything with Jensen in it. I've already found a few that are on your list that I have. I'm afraid I'm not very computer literate, so don't quite know what all your upload things mean, but happy to upload anything I have that is on your list if you want to send me a link I can use.

[helens78]

Everything by me (me as reader) is mirrored at my own podfic archive:

http://helensfic.net/podfic/index

podfic_lover says you're missing these:

http://helensfic.net/podfic/2012/quietly-melt-down-by-sabine/
http://helensfic.net/podfic/2012/reprieve-by-cesare-and-helens78/
http://helensfic.net/podfic/2011/the-man-who-has-everything-by-telesilla/
http://helensfic.net/podfic/2011/whiskey-tango-foxtrot-by-telesilla/

Super excited to see the Audiofic Archive coming back!

[podfic_lover]

Thank you for the fast reply, helens!

Your personal archive was very helpful for collecting the missing files.

We´re looking for the m4b podbook versions of the remaining four recordings though, which were probably created by the original AA archivist. If you don´t have backups of these, we´re going to try to find them via crowd sourcing or recreate them from your mp3 versions.

[originally_dw]

Hi all,

Sorry I'm late. I only just saw this post after I got mentioned in a (what seemed to me) really weird tweet from paraka about uploading my podfic, haha. If there's anything of mine missing, let me know. I will probably have it. There's an index of my podfic folder here (I sent it in to the archive when this first happened but I guess that email never got read).

belated offer

[eileenlufkin]

I have a folder with around 300 podfic files that were on the missing list as of 1/27. I would be happy to upload them. I think I sent you an email; I can resend it.

Updated list?

[vamous]

Hi there

I do have a lot of podfics, all SPN or J2. Is there an updated list that I can look at to see if I have any of the ones you need?

Viki