Wednesday, September 2, 2009

MACRO downloading






Using macros when downloading is a powerful thing. Offline Explorer Enterprise Edition can help you quite a deal. If you have 10 pictures on a http server like this:

http://www.server.com/pictures/image01.jpg
http://www.server.com/pictures/image02.jpg
http://www.server.com/pictures/image03.jpg
http://www.server.com/pictures/image04.jpg
http://www.server.com/pictures/image05.jpg
http://www.server.com/pictures/image06.jpg
http://www.server.com/pictures/image07.jpg
http://www.server.com/pictures/image08.jpg
http://www.server.com/pictures/image09.jpg
http://www.server.com/pictures/image10.jpg

Then you can download all 10 directly by using a numbering macro in OEEE. Write this in your download box.

http://www.server.com/pictures/image{:01..10}.jpg
That will do the job and generate 10 urls when you hit the run/play button in OEEE. Now you can spiff up the numbering macro a bit by using a enumerater step. Let's say that the pictures are numbered 01,03,05,07,09,11 instead of a direct squence. Then you can create your macro like this:
http://www.server.com/pictures/image{:01..11|2}.jpg
That will generate the urls:
http://www.server.com/pictures/image01.jpg
http://www.server.com/pictures/image03.jpg
http://www.server.com/pictures/image05.jpg
http://www.server.com/pictures/image07.jpg
http://www.server.com/pictures/image09.jpg
http://www.server.com/pictures/image11.jpg
Now this is all handy. The big advantage is being able to use multiple macros in the same command. Very often you need set names to your download list. If the webmaster of the site of your choice is drug free (which is almost none) then the sets will be numbered 001, 002 and so forth. But this is almost NEVER the case, although Ann-Angel's webmaster does that - thank you for that.

The easiest way of obtaining set names is to visit whatever gallery page that holds the episodes/sets you wish to download. Let's try with an example. Reality Kings has a site called Mikes In Brazil. Visit the url hxxp://www.mikesinbrazil.com and save the intro page to your hdd. It should be the page which is is the commercial page which lists a bunch of episodes.

Each of the episodes has a episode name. This is hidden a little. But if you let your mouse hover over the Watch Trailer button then you can spot the episode name as the first part of the wmv file. Example sol.wmv. The episode name is: sol.

With your saved file run this command on the command line:

grep -Po "(?<=trailer=)[a-z0-9]*" mikesinbrazil.html >set_names_mib.txt
If you do not redirect the output to the text file set_names_mib.txt then your result could look very much like the picture below.


With a file of episode names we can enhance our OEEE macro download a bit. We can now construct it to use the set names and a numbering macro.

http://www.server.com/{:file=c:\set_names_mib.txt}/pictures/image{:001..321}.jpg

The macro download will pr0duce 321*8 = 2568 direct urls for downloading images. The urls will look something like:

http://www.server.com/sol/pictures/image001.jpg
http://www.server.com/sol/pictures/image002.jpg
...
http://www.server.com/sol/pictures/image321.jpg
http://www.server.com/natashia2/pictures/image001.jpg
http://www.server.com/natashia2/pictures/image002.jpg
...
and so forth
I hope this will help you in your downloading.

No comments:

Post a Comment