]> gitweb.michael.orlitzky.com - dead/whatever-dl.git/log
dead/whatever-dl.git
13 years agoAdd support for www.mentalzero.com.
Michael Orlitzky [Wed, 9 Feb 2011 03:12:59 +0000 (22:12 -0500)]
Add support for www.mentalzero.com.

13 years agoAdd support for xxxbunker.com.
Michael Orlitzky [Tue, 25 Jan 2011 03:27:06 +0000 (22:27 -0500)]
Add support for xxxbunker.com.

13 years agoClean up the code for UriUtilities.
Michael Orlitzky [Tue, 25 Jan 2011 02:17:05 +0000 (21:17 -0500)]
Clean up the code for UriUtilities.

13 years agoAllow the downloaders to take advantage of the websites' headers.
Michael Orlitzky [Tue, 25 Jan 2011 02:07:08 +0000 (21:07 -0500)]
Allow the downloaders to take advantage of the websites' headers.

13 years agoWhitespace cleanup.
Michael Orlitzky [Tue, 25 Jan 2011 01:56:34 +0000 (20:56 -0500)]
Whitespace cleanup.

13 years agoMake headers a property of the website class rather than passing them to get_page_data.
Michael Orlitzky [Tue, 25 Jan 2011 01:49:17 +0000 (20:49 -0500)]
Make headers a property of the website class rather than passing them to get_page_data.
Define a USER_AGENT in the configuration file.

13 years agoAdd support for xvideos.com.
Michael Orlitzky [Tue, 25 Jan 2011 00:45:58 +0000 (19:45 -0500)]
Add support for xvideos.com.

13 years agoFix the hashlink parsing for Redtube.
Michael Orlitzky [Sun, 16 Jan 2011 21:18:54 +0000 (16:18 -0500)]
Fix the hashlink parsing for Redtube.

13 years agoFix the Efukt video url regex.
Michael Orlitzky [Sun, 9 Jan 2011 20:16:13 +0000 (15:16 -0500)]
Fix the Efukt video url regex.

13 years agoAdd support for deviantclip.com.
Michael Orlitzky [Wed, 5 Jan 2011 02:22:00 +0000 (21:22 -0500)]
Add support for deviantclip.com.

13 years agoAdd support for ehow.com.
Michael Orlitzky [Wed, 5 Jan 2011 02:20:55 +0000 (21:20 -0500)]
Add support for ehow.com.

13 years agoAdd support for liveleak.com.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:25 +0000 (20:15 -0500)]
Add support for liveleak.com.

13 years agoFix an off-by-one error in veoh.rb.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:07 +0000 (20:15 -0500)]
Fix an off-by-one error in veoh.rb.

13 years agoAdd a missing character to VALID_BLIPTV_REDIR_URL_REGEX.
Michael Orlitzky [Mon, 18 Oct 2010 03:28:20 +0000 (23:28 -0400)]
Add a missing character to VALID_BLIPTV_REDIR_URL_REGEX.
Unescape the blip.tv redirect URL.

13 years agoAdd blip.tv support for URLs of the form http://blip.tv/play/<foo>.
Michael Orlitzky [Mon, 18 Oct 2010 03:19:47 +0000 (23:19 -0400)]
Add blip.tv support for URLs of the form http://blip.tv/play/<foo>.

13 years agoRemove the Youtube fixtures and format parsing tests until they can be updated.
Michael Orlitzky [Fri, 23 Jul 2010 22:37:42 +0000 (18:37 -0400)]
Remove the Youtube fixtures and format parsing tests until they can be updated.

13 years agoRemove t_parameter tests for the Youtube class.
Michael Orlitzky [Fri, 23 Jul 2010 22:34:08 +0000 (18:34 -0400)]
Remove t_parameter tests for the Youtube class.

13 years agoFix the Youtube class for the latest update to the site.
Michael Orlitzky [Fri, 23 Jul 2010 22:31:40 +0000 (18:31 -0400)]
Fix the Youtube class for the latest update to the site.
Remove the t_parameter code, replacing it with fmt_url_map parsing.

14 years agoAdd support for dailymotion.com, with tests.
Michael Orlitzky [Sat, 17 Apr 2010 19:31:09 +0000 (15:31 -0400)]
Add support for dailymotion.com, with tests.

14 years agoAllow passing headers (default: {}) to the Website get_page_data method.
Michael Orlitzky [Sat, 17 Apr 2010 19:28:17 +0000 (15:28 -0400)]
Allow passing headers (default: {}) to the Website get_page_data method.

14 years agoAdded tests/fixtures for the most recent Youtube changes.
Michael Orlitzky [Wed, 7 Apr 2010 16:09:14 +0000 (12:09 -0400)]
Added tests/fixtures for the most recent Youtube changes.

14 years agoAdd Youtube support for the "fmt_list" and "t" variables stored as URL parameters.
Michael Orlitzky [Wed, 7 Apr 2010 15:58:55 +0000 (11:58 -0400)]
Add Youtube support for the "fmt_list" and "t" variables stored as URL parameters.

14 years agoRemoved an old (completed) todo item, and added a new one in its place.
Michael Orlitzky [Mon, 5 Apr 2010 06:20:26 +0000 (02:20 -0400)]
Removed an old (completed) todo item, and added a new one in its place.

14 years agoRemoved string.rb since the old Redtube class was its only customer.
Michael Orlitzky [Thu, 1 Apr 2010 22:55:12 +0000 (18:55 -0400)]
Removed string.rb since the old Redtube class was its only customer.

14 years agoUpdate all of the Redtube tests for the new class.
Michael Orlitzky [Thu, 1 Apr 2010 22:54:51 +0000 (18:54 -0400)]
Update all of the Redtube tests for the new class.

14 years agoUpdate the Redtube class. It is no longer necessary to perform magic rituals prior...
Michael Orlitzky [Thu, 1 Apr 2010 22:53:27 +0000 (18:53 -0400)]
Update the Redtube class. It is no longer necessary to perform magic rituals prior to calculating the video URL.

14 years agoModified the default get_video_filename() so that it removes URL parameters.
Michael Orlitzky [Thu, 1 Apr 2010 22:29:57 +0000 (18:29 -0400)]
Modified the default get_video_filename() so that it removes URL parameters.

14 years agoAdded new tests for (yet another) Veoh URL format.
Michael Orlitzky [Thu, 1 Apr 2010 04:45:21 +0000 (00:45 -0400)]
Added new tests for (yet another) Veoh URL format.
Generalized the Veoh URL regex to accept anything ending in what looks like a video id.

14 years agoAdded tests for the new Veoh URL formats.
Michael Orlitzky [Thu, 1 Apr 2010 04:37:11 +0000 (00:37 -0400)]
Added tests for the new Veoh URL formats.

14 years agoAdded URL/parse support for two new Veoh formats.
Michael Orlitzky [Thu, 1 Apr 2010 04:36:43 +0000 (00:36 -0400)]
Added URL/parse support for two new Veoh formats.

14 years agoRaise errors if the Youtube class can't parse either the video id or the format list.
Michael Orlitzky [Wed, 31 Mar 2010 18:57:08 +0000 (14:57 -0400)]
Raise errors if the Youtube class can't parse either the video id or the format list.
Add video id parsing for the new URL format.

14 years agoAdded a new URL format for the Youtube class.
Michael Orlitzky [Wed, 31 Mar 2010 18:56:21 +0000 (14:56 -0400)]
Added a new URL format for the Youtube class.
Created a test for the new URL format.

14 years agoUpdated the BlipTV regular expressions to support the "ogv" extension.
Michael Orlitzky [Thu, 18 Mar 2010 19:04:41 +0000 (15:04 -0400)]
Updated the BlipTV regular expressions to support the "ogv" extension.

14 years agoAdded the fixture used in the new Youtube tests.
Michael Orlitzky [Thu, 14 Jan 2010 04:14:14 +0000 (23:14 -0500)]
Added the fixture used in the new Youtube tests.

14 years agoAdded two new Youtube tests for the available/desired video formats.
Michael Orlitzky [Thu, 14 Jan 2010 04:13:43 +0000 (23:13 -0500)]
Added two new Youtube tests for the available/desired video formats.

14 years agoAdded high-definition video support to the Youtube class.
Michael Orlitzky [Thu, 14 Jan 2010 04:12:50 +0000 (23:12 -0500)]
Added high-definition video support to the Youtube class.

14 years agoAdded the OGG/Vorbis format parsing to Bliptv.
Michael Orlitzky [Mon, 7 Dec 2009 17:46:04 +0000 (12:46 -0500)]
Added the OGG/Vorbis format parsing to Bliptv.
Created a test case for the OGG/Vorbis parsing.
Renamed an existing Bliptv test which was copied incorrectly.

14 years agoAdded support for motherless.com.
Michael Orlitzky [Tue, 24 Nov 2009 02:07:14 +0000 (21:07 -0500)]
Added support for motherless.com.

14 years agoAdded GetOpt option parsing.
Michael Orlitzky [Thu, 29 Oct 2009 14:47:47 +0000 (10:47 -0400)]
Added GetOpt option parsing.
Take a '--continue' option, passed on to the downloader, which determines whether or not we attempt to continue a previous download.
Modified the downloaders to throw an IOError if the output file already exists and we're not continuing a previous download.
Print the external command used to execute Wget.

14 years agoUpdated Redtube to work with the site's new algorithm.
Michael Orlitzky [Fri, 2 Oct 2009 19:28:39 +0000 (15:28 -0400)]
Updated Redtube to work with the site's new algorithm.
Made one local Redtube test a remote test.
Updated the remote test suite to include the Redtube remote tests.
Added a local fixture for Redtube tests.
Added one local test utilizing the new fixture.

14 years agoAdded support for blip.tv.
Michael Orlitzky [Fri, 2 Oct 2009 02:16:02 +0000 (22:16 -0400)]
Added support for blip.tv.
Created the Bliptv class.
Added several tests, along with fixtures, for the new class.
Added the Bliptv tests to the test suite.

14 years agoRemoved whitespace.
Michael Orlitzky [Fri, 2 Oct 2009 02:09:06 +0000 (22:09 -0400)]
Removed whitespace.

14 years agoAdded configurable downloaders.
Michael Orlitzky [Sun, 27 Sep 2009 04:52:46 +0000 (00:52 -0400)]
Added configurable downloaders.
Created three new classes: Downloader, OpenUriDownloader, and WgetDownloader.
Created a configuration file.
Modified whatever-dl to use the configuration information.

14 years agoFixed brain error re: symbols/methods.
Michael Orlitzky [Sun, 27 Sep 2009 00:46:50 +0000 (20:46 -0400)]
Fixed brain error re: symbols/methods.

14 years agoReplaced the Yikers algorithm with a simpler one (that actually works).
Michael Orlitzky [Sun, 27 Sep 2009 00:46:01 +0000 (20:46 -0400)]
Replaced the Yikers algorithm with a simpler one (that actually works).
Removed the obsolete Yikers tests and fixtures.

14 years agoRemoved the redundant get_page_data method from the Yikers class.
Michael Orlitzky [Sun, 27 Sep 2009 00:25:48 +0000 (20:25 -0400)]
Removed the redundant get_page_data method from the Yikers class.

14 years agoFixed the Howcast downloads.
Michael Orlitzky [Sun, 27 Sep 2009 00:20:41 +0000 (20:20 -0400)]
Fixed the Howcast downloads.
Modified the Howcast class to parse an XML file containing the real video URL.
Added a test for the new method.

14 years agoFixed the KCODE is NONE warning.
Michael Orlitzky [Sun, 27 Sep 2009 00:19:40 +0000 (20:19 -0400)]
Fixed the KCODE is NONE warning.

14 years agoMerged upstream branch (master).
Michael Orlitzky [Fri, 2 Oct 2009 02:45:37 +0000 (22:45 -0400)]
Merged upstream branch (master).

14 years agoAdded support for a second filename pattern to the Efukt class.
Michael Orlitzky [Sun, 30 Aug 2009 02:47:10 +0000 (22:47 -0400)]
Added support for a second filename pattern to the Efukt class.
Created a fixture and a test case for the new pattern.

14 years agoFixed a typo in the Efukt class.
Michael Orlitzky [Sun, 30 Aug 2009 02:21:06 +0000 (22:21 -0400)]
Fixed a typo in the Efukt class.

15 years agoAdded the net/http requirement to the Website class (which now needs it).
Michael Orlitzky [Wed, 1 Apr 2009 06:49:37 +0000 (02:49 -0400)]
Added the net/http requirement to the Website class (which now needs it).
Removed some redundant requires from the website subclasses.

15 years agoAdded the beginnings of Megaporn support. There's still something missing, but the...
Michael Orlitzky [Sat, 21 Mar 2009 04:37:32 +0000 (00:37 -0400)]
Added the beginnings of Megaporn support. There's still something missing, but the decryption routine is (probably) implemented correctly.

15 years agoSilly whitespace changes.
Michael Orlitzky [Sat, 21 Mar 2009 04:36:36 +0000 (00:36 -0400)]
Silly whitespace changes.

15 years agoFactored out the Youtube implementation of get_page_data into the Website superclass.
Michael Orlitzky [Sat, 21 Mar 2009 04:35:54 +0000 (00:35 -0400)]
Factored out the Youtube implementation of get_page_data into the Website superclass.

15 years agoAdded the ability to download FuckedTube (http://www.fuckedtube.com/) videos.
Michael Orlitzky [Tue, 17 Mar 2009 23:09:13 +0000 (19:09 -0400)]
Added the ability to download FuckedTube (http://www.fuckedtube.com/) videos.

15 years agoUpdated the Youtube URL regex to allow any hostname.youtube.com pattern.
Michael Orlitzky [Mon, 2 Mar 2009 00:14:09 +0000 (19:14 -0500)]
Updated the Youtube URL regex to allow any hostname.youtube.com pattern.
Added a test to ensure that uk.youtube.com URLs are handled properly.

15 years agoModified the Youtube class to accept in.youtube.com URLs.
Michael Orlitzky [Mon, 12 Jan 2009 00:46:40 +0000 (19:46 -0500)]
Modified the Youtube class to accept in.youtube.com URLs.
Added a test for the new behavior.

15 years agoI take that last commit back. Now the relative include path issue is fixed. The previ...
Michael Orlitzky [Fri, 21 Nov 2008 22:01:32 +0000 (17:01 -0500)]
I take that last commit back. Now the relative include path issue is fixed. The previous commit fails to include all of the website classes since the Dir.glob method doesn't necessarily (usually) look in the correct place.

15 years agoFixed the relative path require issue. Now we should be able to symlink the main...
Michael Orlitzky [Sat, 15 Nov 2008 23:46:54 +0000 (18:46 -0500)]
Fixed the relative path require issue. Now we should be able to symlink the main executable and run it from wherever.

15 years agoAdded the ability to download videos from http://www.efukt.com/.
Michael Orlitzky [Tue, 11 Nov 2008 01:34:43 +0000 (20:34 -0500)]
Added the ability to download videos from http://www.efukt.com/.

15 years agoAdded the ability to download videos from http://www.yikers.com/.
mjo [Fri, 31 Oct 2008 17:09:08 +0000 (13:09 -0400)]
Added the ability to download videos from http://www.yikers.com/.
Created tests for the new Yikers class.
Added a method to the Website class returning the host portion of its URL.

15 years agoMade the output filename the responsibility of the website subclass.
Michael Orlitzky [Sun, 7 Sep 2008 05:51:52 +0000 (01:51 -0400)]
Made the output filename the responsibility of the website subclass.

Added a factory method to the website class which creates the appropriate subclass based on the URL given to it.
Added a get_video_filename method to the website class.
Made two Website methods abstract via NotImplementedError, get_video_url and owns_url?.
Created a default implementation of get_video_filename in the Website class.
Made the site URL member data of the Website class.
Fixed a bug in the URL handling for Youtube.
Added output stating the filename for the download.
Replaced all code in the classes/tests to accommodate the other changes.

15 years agoFixed a bug in the Youtube class' parsing of the "t" parameter.
Michael Orlitzky [Sat, 6 Sep 2008 03:44:59 +0000 (23:44 -0400)]
Fixed a bug in the Youtube class' parsing of the "t" parameter.

Modified the "t" parsing regex to catch non-alphanumeric characters, which from experience I now know are possible.
Added a test/fixture to expose the bug.
The whatever-dl executable now outputs "Fetching #{video_url}" before actually fetching the file.

15 years agoAdded a documentation directory with a short todo list.
mjo [Tue, 2 Sep 2008 22:17:12 +0000 (18:17 -0400)]
Added a documentation directory with a short todo list.

15 years agoAdded the ability to download Youtube videos.
mjo [Tue, 2 Sep 2008 22:13:40 +0000 (18:13 -0400)]
Added the ability to download Youtube videos.

Fixed a typo in the main executable which was causing a crash.
Added the progress bar tests back to the suite.
Added a Youtube class and the accompanying unit tests/fixtures.

15 years agoAdded independent (non-wget) file downloads via open-uri.
Michael Orlitzky [Tue, 2 Sep 2008 03:01:13 +0000 (23:01 -0400)]
Added independent (non-wget) file downloads via open-uri.

Removed a bad vimeo_remote_test require from the remote test suite.
Added the UriUtilities class and a bunch of tests for it.
Included the ProgressBar class in the vendor directory so that the UriUtilities class can display a progress bar during downloads.
Added the ProgressBar tests to the test suite.
Added error handling to the main whatever-dl script for newly-possible IO/connection errors.
Removed the wget exec() call in favor of the open-uri call.

15 years agoAdded the ability to download Vimeo videos.
mjo [Fri, 29 Aug 2008 21:37:30 +0000 (17:37 -0400)]
Added the ability to download Vimeo videos.

Created a Vimeo class.
Created a bunch of tests for the new Vimeo class.
Added a fixture for the Vimeo tests: an XML file containing the video data.
Added a GPLv3 notice to the top of any file which did not contain one.

15 years agoAdded the ability to download Veoh files.
Michael Orlitzky [Sat, 28 Jun 2008 05:11:00 +0000 (01:11 -0400)]
Added the ability to download Veoh files.

Added a new Veoh class, along with a couple of tests and one fixture file (of video details data).

15 years agoAdded the Infoq site.
Michael Orlitzky [Mon, 16 Jun 2008 03:43:00 +0000 (23:43 -0400)]
Added the Infoq site.

Added support for infoq.com by adding a new website class. Infoq
attempts to obscure their video URLs with Base64 encoding which is
easy enough to get around. I implemented this, and a couple of tests
for the new class.

15 years agoInitial commit.
Michael Orlitzky [Fri, 13 Jun 2008 03:17:16 +0000 (23:17 -0400)]
Initial commit.