Note, this is no longer maintained, and doesn't work any more. Preserved if someone wants to adapt the code
Contents
Description
Screenshots
Features
System requirements
Short Tutorial
Update
Download
Known bugs
Changelog
Acknowledgements
Description
The GalleryGrabber collects images from multiple sites (deviantArt, VCL, FChan, Furaffinity). You can get all images since the last download or since a date from the artists/subpages you selected.
Screenshots
Features
- Download of the newest images/flashes from deviantArt, VCL, FChan andFuraffinity
- Download of all images and flash files since a specified date
- Languages: English, German, French, Russian (Thanks, Kirshental)
- Proxy support (TOR using Privoxy possible)
- Clear display of the result in a HTML document
- Generates a nice directory structure if you do not want to use the HTML
- Platform independent (Linux, Windows, Mac, Bsd..)
- No spyware, adware, malware or similar
- Passwords are encrypted
System requirements
Java2 version 6 or newer. You can check if you have it using this command line command (Windows: Start->run->cmd):
java -version
If you get nothing or if it's telling you that it doesn't know the command "java", you probably don't have java. If you get something, it should look like this:
java version "1.6.0_16" Java(TM) SE Runtime Environment (build 1.6.0_16-b01)
If the number is 1.6 or larger, GalleryGrabber should run.
If you don't have Java or an old version, you can download the newest one at "Download".
Short tutorial
If everything works, you can just double-click the jar file, but sometimes a compressing software like WinZip graps this file extension.
If that happens, open the jar with javaw (Windows: right click -> Open with... -> Browse -> javaw.exe in the java install directory auswählen (also tick the "always open with"-box))
Update
To update GalleryGrabber, just copy the file accounts.sve from the Workfiles directory of the old version to the same directory of the new version.
Download
GalleryGrabber 1.8
Sourcecode GalleryGrabber 1.8
Java:
Oracle pulled a fast one on us, newest (Oracle) Java versions have horrible licencing. So either choose 1.8, the last proper version, or chose OpenJDK:
Java 1.8 via Java.com
Newest Java via adoptOpenJDK.com
Known bugs
- The encryption of the password file is not secure - everyone who takes a look in the sourcecode could decrypt it.
Changelog
Version 1.8
- Made FA work again
Version 1.7
- Fixed loads of stuff for deviantArt, like login, download, timezone... I hate dA..
Version 1.6
- Fixed Furaffinity image grabbing
- Fixed DeviantArt login
Version 1.5
- Fixed Furaffinity comment grabbing
Version 1.4
- Fixed Username/Password saving mechanism. Sorry for that, guys
- Fixed FurAffinity Spring Update bug
Version 1.3
- Small fix for sticky threads on fchan
Version 1.2
- Added possibility to add multiple users at once
- Added possibility to not delete the result directories on the next download
Acknowledgements
I'd like to thank the following people:
- Naut: Idea
- DreadCat: Basis for the logo
- Tambako: French translation
- Rob MacGrogan: Date ComboBox
- Java Tech Tips: Cookie- and ListCookieHandler class (The original creeps with errors - I would have had less work if I implemented it from scratch)
- Santhosh Kumar: Implementation of a progress bar in a modular dialog
Comments
#206 Tedexisi wrote at 07/08/2013 01:18 AM (EST):
Having a weird problem with 1.6. It seems that everytime I download it deletes the "Downloaded_Images" folder. Prior I was using an older version and just updating the files. I changing different permissions for the folder but nothing changed it .
Any ideas for something I've overlooked?
#207 Klaue wrote at 07/09/2013 04:23 AM (EST):
Just untick the checkbox "Delete old downloads"
#208 Tedexisi wrote at 07/09/2013 07:10 PM (EST):
Thanks, I'm an idiot . I recently reinstalled windows, and didn't copy over the older files, and had been thinking it was a windows problem . Also, do you by chance ever play games on steam or anything like that?
#209 Klaue wrote at 07/09/2013 11:11 PM (EST):
I do, but only seldomly online, I'm more of a singleplayer guy :)
#210 Tedexisi wrote at 07/11/2013 02:54 AM (EST):
Alright, well I know you didn't want to accept money as a donation, but if you'd like something on steam just let me know, I put my email in the notice field my steam is the same a the email, but not here; I wouldn't want anyone claiming to be you to message me .
#196 hidemy wrote at 04/28/2013 12:27 AM (EST):
Could you please make it stop creating date folders in the hierarchy? So it would avoid re-downloading? I mean straight from Downloaded_Images to the sitename folder, And ignoring downloads based on existing filenames, not date. Otherwise, it works like a charm.
#197 hidemy wrote at 04/28/2013 02:58 AM (EST):
The whole log is made of these sequences:
java.io.IOException: Server returned HTTP response code: 403 for URL: http://www.furaffinity.net/full/1716668/
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
at klaue.DownloadHelper.Downloader.downloadPage(Downloader.java:105)
at Sites.FurAffinity.getImage(FurAffinity.java:278)
at Sites.FurAffinity.getImagesFromAccount(FurAffinity.java:216)
at Sites.FurAffinity.getImagesFromAccount(FurAffinity.java:260)
at Sites.FurAffinity.getImages(FurAffinity.java:132)
at GalleryGrabber$Task.getImages(GalleryGrabber.java:1195)
at GalleryGrabber$Task.run(GalleryGrabber.java:1045)
at java.lang.Thread.run(Unknown Source)
Is it normal?
#198 hidemy wrote at 04/28/2013 03:10 AM (EST):
It also reports a couple to a dozen errors after downloading.
And is there a way to make it stop generating HTML galleries?
#199 hidemy wrote at 04/28/2013 03:22 AM (EST):
The program follows this pattern on runs:
first run: could not connect to the internet
second run: could not log in to FA
third run: nothing happens the preparing bar just vanishes
forth run: works fine but with the problems previously described.
#200 hidemy wrote at 04/28/2013 03:24 AM (EST):
#201 Klaue wrote at 04/28/2013 09:24 AM (EST):
The whole program is date based, so no, there's not really anything I can do.
Pictures are put in folders with the date because people complained that old pics were deleted on new runs. Tick the "delete old downloads"-checkbox to get rid of them (but it will still do a complete download since the specified date. That's just how the whole prog is built, sorry)
As for your other problems, could it be that your internet connection is shitty? Those problems shouldn't be happening. For example, to test for the internet connection, it tries to access the google homepage, which is pretty much online all the time, so if that fails, something must be wrong with your internet connection.
#202 hidemy wrote at 04/29/2013 02:13 AM (EST):
When the programs gets to work the network meter gadget shows an average of 1.1Mpbs down rate which is not that bad i assume. And what those 403 errors have to do with the speed anyway? Which translates: 3/4 of the downloads are skipped._.
#203 Klaue wrote at 04/29/2013 01:31 PM (EST):
shitty connection != shitty speed. Maybe you have plenty of packet loss or something.
Whatever it may be, I had no problems with my tests: not a single 403 on FA in my test downloads, so I'm afraid it has to be something on your end.
#204 hidemy wrote at 05/01/2013 02:45 PM (EST):
A bit of tampering here and there its close to two megabits now. Finally came up with a solution. Since the 403ed submission are not the same everytime, i just run the grabber four times in a row, then merge the results. Seems like a pain in the posterior but since i'm not like watching five hundred artists with two hundred new submissions everyday, and not planning to update every week, it's rather convenient. Everytime about a fifth of the downloads are skipped but repeated four times, it becomes one in 600. Yay! Statistics. Thanks for the program, dude. Among lazyass furfags you are a king.
#205 Klaue wrote at 05/02/2013 01:07 PM (EST):
good you found a solution, but your problem still kinda puzzles me. You could try only donwloading one artist at once - maybe FA intentionally throws in some error pages after a while to reduce load on its servers, so single artists with a short break between each could work.
If that was the case, I could add a delay of a second or five after each artist.
And yes, lazyness was also the reason this furfag originally made it. Had I know at the time how often FA/da/etc update their site code, I would've been too lazy for it :D
#193 Tedexisi wrote at 04/26/2013 04:18 PM (EST):
Sorry, I see I left out one important word.
I want to bulk edit the logins; otherwise it i will take a while to change them all.
#194 Klaue wrote at 04/26/2013 08:32 PM (EST):
If you update a single account from a site with the new user/password, say a single one of deviantart, all accounts of deviantart will be updated with the new login automatically
#189 pinkerton wrote at 04/22/2013 03:03 PM (EST):
at java.lang.Thread.run(Unknown Source)
Did I break something? Using proxy.
#190 pinkerton wrote at 04/22/2013 03:18 PM (EST):
btw wtf happened to sergey kirshental and his sdvision.org?
#192 Klaue wrote at 04/24/2013 12:49 PM (EST):
I Dunno LOL ¯\\(°_o)/¯
#191 Klaue wrote at 04/24/2013 12:48 PM (EST):
Can't help you with only the least usable part of the error message..
#195 pinkerton wrote at 04/27/2013 01:53 AM (EST):
oh forget it it's working now. thanks a zillion for such an incredible program ;)
#184 Jack wrote at 03/28/2013 05:30 AM (EST):
I hope this program will be updated soon...
#188 Klaue wrote at 03/29/2013 12:22 PM (EST):
Is "1 day" soon enough? ;) just updated it, finally.
#183 Grunt wrote at 02/09/2013 07:41 AM (EST):
Is it possible to download club lists on dA including the subfolders? I tried "#pwfa" and it would load like 3 pics and thats it...
#179 Tedexisi wrote at 01/09/2013 07:01 PM (EST):
Also if someone can confirm is it broken on FurAffinity seem to give the message of no new images.
#180 Duraldon wrote at 01/11/2013 09:00 PM (EST):
Kann ich bestätigen. Habe selbst gestern bemerkt das der Gallerygrabber nichts mehr von Furaffinity downloaded.
Habe verschiedenste Möglichkeiten ausprobiert wie: "Mit Darum, Letztem Download, ein einzelnes Konto oder gleich Alle. Bei allen Optionen kam bei Furaffinity folgende Hinweismeldung: "Keine neuen Bilder gefunden."
Testweise mal ein ganz neues Konto hinzugefügt aber selbst hier werden keine Bilder gefunden.
#181 Klaue wrote at 01/14/2013 01:10 PM (EST):
Hat wohl FA mal wieder ein update gefahren. Ich guck, wenn ich mal Zeit habe, was sich geändert hat. Dass die aber auch nie die Finger von ihrem Code lassen können...
#182 Duraldon wrote at 02/02/2013 06:31 AM (EST):
Würde ich mich sehr freuen. Wie ich bereits schonmal erwähnte gewöhnt man sich doch recht schnell an so ein nützliches Tool. :)
#186 Klaue wrote at 03/29/2013 12:21 PM (EST):
Hat zwar etwas gedauert, aber nun klappt's wieder
#187 Klaue wrote at 03/29/2013 12:21 PM (EST):
Took my sweet time, but it works again
#178 Tedexisi wrote at 01/09/2013 04:10 PM (EST):
Is there any easy way to edit the user name, and passwords of the account to be used for the download ? Old drive died without back up , and it will be quite a lot too redownload and would like to be on an expendable account via proxy . Thanks
#185 Klaue wrote at 03/29/2013 09:02 AM (EST):
This answer is probably too late for you (missed your comment), but maybe someone else needs it: just select an account from the site and hit edit, then update user/password. Should update it on all accounts of this site
#176 Yang738 wrote at 08/19/2012 04:22 PM (EST):
Es wäre wirklich schön nicht nur nach Artists etwas runter zu laden sondern auch per tag. Ansonsten gutes download-programm
#177 derp wrote at 10/07/2012 04:01 PM (EST):
great program!
#175 Kanto wrote at 07/10/2012 02:14 PM (EST):
Servus.
Sagmal, wäre es möglich eine Art "lite" Version von dem Programm zu bekommen, welches nur die URL's der Bilder in eine Liste packt und diese dann speichert, am Besten nach Artist/Account sortiert?
So sehr ich dein Programm mag, würde ich gerne einen Downloader verwenden, mit dem ich den Download anhalten und später fortführen kann. Daher meine Idee, mit dem "URL Grabber".