dead/whatever-dl.git
7 years agoWhitespace cleanup. master
Michael Orlitzky [Mon, 9 Dec 2013 16:23:48 +0000 (11:23 -0500)]
Whitespace cleanup.

7 years agoFix an unused variable warning.
Michael Orlitzky [Mon, 9 Dec 2013 16:23:37 +0000 (11:23 -0500)]
Fix an unused variable warning.

7 years agoFix a use of the cfg object before it was created.
Michael Orlitzky [Mon, 9 Dec 2013 16:23:01 +0000 (11:23 -0500)]
Fix a use of the cfg object before it was created.

7 years agoAdd a license to the gemspec.
Michael Orlitzky [Mon, 9 Dec 2013 16:22:36 +0000 (11:22 -0500)]
Add a license to the gemspec.

7 years agoFix filenames for Pornhd videos.
Michael Orlitzky [Tue, 19 Nov 2013 15:48:02 +0000 (10:48 -0500)]
Fix filenames for Pornhd videos.

7 years agoNew website: http://www.pornhd.com/.
Michael Orlitzky [Tue, 19 Nov 2013 15:41:46 +0000 (10:41 -0500)]
New website: http://www.pornhd.com/.

9 years agoFix the motherless video URL regex.
Michael Orlitzky [Sun, 14 Oct 2012 21:57:26 +0000 (17:57 -0400)]
Fix the motherless video URL regex.

9 years agoAdd a gemspec file, completing(?) the move to a sane package layout.
Michael Orlitzky [Wed, 13 Jun 2012 03:33:36 +0000 (23:33 -0400)]
Add a gemspec file, completing(?) the move to a sane package layout.

9 years agoFix the progressbar require path in uri_utilities.rb.
Michael Orlitzky [Wed, 13 Jun 2012 03:27:32 +0000 (23:27 -0400)]
Fix the progressbar require path in uri_utilities.rb.
Replace the makefile with a Rakefile.
Update all of the test code to run under `rake test`.
Add a short README.

9 years agoEliminate the redundand 'vendor' directory.
Michael Orlitzky [Wed, 13 Jun 2012 02:52:57 +0000 (22:52 -0400)]
Eliminate the redundand 'vendor' directory.
Remove the remote tests, mosts of which fail now.

9 years agoUpdate the makefile to build/install a gem.
Michael Orlitzky [Wed, 13 Jun 2012 02:03:06 +0000 (22:03 -0400)]
Update the makefile to build/install a gem.

9 years agoUse strings instead of symbols for the downloader type.
Michael Orlitzky [Wed, 13 Jun 2012 02:02:40 +0000 (22:02 -0400)]
Use strings instead of symbols for the downloader type.

9 years agoFix website require paths.
Michael Orlitzky [Wed, 13 Jun 2012 01:58:38 +0000 (21:58 -0400)]
Fix website require paths.

9 years agoMake the Configuration module a class.
Michael Orlitzky [Wed, 13 Jun 2012 01:56:51 +0000 (21:56 -0400)]
Make the Configuration module a class.

9 years agoFix a missing slash.
Michael Orlitzky [Wed, 13 Jun 2012 01:51:41 +0000 (21:51 -0400)]
Fix a missing slash.

9 years agoUse the logger class to log warnings and errors.
Michael Orlitzky [Wed, 13 Jun 2012 01:44:21 +0000 (21:44 -0400)]
Use the logger class to log warnings and errors.
Run the main script whether or not it was invoked directly.
Move the exit codes into their own module.

9 years agoFix a few require paths.
Michael Orlitzky [Mon, 11 Jun 2012 01:34:47 +0000 (21:34 -0400)]
Fix a few require paths.

9 years agoUpdate bin/whatever-dl and the configuration class for the other changes.
Michael Orlitzky [Mon, 11 Jun 2012 01:24:13 +0000 (21:24 -0400)]
Update bin/whatever-dl and the configuration class for the other changes.

9 years agoAdd the base 'rb' file which includes all of the other requirements.
Michael Orlitzky [Mon, 11 Jun 2012 01:23:45 +0000 (21:23 -0400)]
Add the base 'rb' file which includes all of the other requirements.

9 years agoAdd an example config file.
Michael Orlitzky [Mon, 11 Jun 2012 01:23:28 +0000 (21:23 -0400)]
Add an example config file.

9 years agoMove all of the 'src' code under the more-standard 'lib'.
Michael Orlitzky [Mon, 11 Jun 2012 01:22:45 +0000 (21:22 -0400)]
Move all of the 'src' code under the more-standard 'lib'.
Create a yaml-based configuration class.

9 years agoFix all Ruby 1.9 errors and warnings.
Michael Orlitzky [Mon, 11 Jun 2012 00:23:39 +0000 (20:23 -0400)]
Fix all Ruby 1.9 errors and warnings.

9 years agoUpdate the makefile and test code so that the tests run with Ruby 1.9 and pass generally.
Michael Orlitzky [Mon, 11 Jun 2012 00:22:52 +0000 (20:22 -0400)]
Update the makefile and test code so that the tests run with Ruby 1.9 and pass generally.

9 years agoRemove a number of fixtures whose tests no longer pass.
Michael Orlitzky [Mon, 11 Jun 2012 00:15:16 +0000 (20:15 -0400)]
Remove a number of fixtures whose tests no longer pass.

9 years agoRewrite most of Bliptv to work with their new scheme.
Michael Orlitzky [Wed, 11 Jan 2012 01:18:39 +0000 (20:18 -0500)]
Rewrite most of Bliptv to work with their new scheme.

9 years agoRemove 'www' from the Vimeo details URL.
Michael Orlitzky [Fri, 18 Nov 2011 23:35:28 +0000 (18:35 -0500)]
Remove 'www' from the Vimeo details URL.

9 years agoAdd "?start=0" to the end of motherless URLs.
Michael Orlitzky [Thu, 3 Nov 2011 14:17:27 +0000 (10:17 -0400)]
Add "?start=0" to the end of motherless URLs.
Whitespace cleanup in motherless.rb.

10 years agoRe-fix the Youtube itag parameter. It works in both duplicated and non-duplicated...
Michael Orlitzky [Sat, 15 Oct 2011 13:24:43 +0000 (09:24 -0400)]
Re-fix the Youtube itag parameter. It works in both duplicated and non-duplicated cases now.

10 years agoAdd a fix for Youtube's itag parameter.
Michael Orlitzky [Fri, 14 Oct 2011 20:10:24 +0000 (16:10 -0400)]
Add a fix for Youtube's itag parameter.
Make the fmt_stream_url selection smarter.

10 years agoUse single quotes around the URL in our 'wget' command.
Michael Orlitzky [Sat, 6 Aug 2011 16:55:20 +0000 (12:55 -0400)]
Use single quotes around the URL in our 'wget' command.
Add a fallback method for parsing Youtube video URLs.

10 years agoAdd HTML5 source element src parsing to the Redtube class.
Michael Orlitzky [Sun, 24 Jul 2011 06:03:47 +0000 (02:03 -0400)]
Add HTML5 source element src parsing to the Redtube class.
Prefer the HTML5 videos over Flash ones where applicable.

10 years agoUpdate the Motherless class for their new Flash variable scheme.
Michael Orlitzky [Sat, 4 Jun 2011 01:05:35 +0000 (21:05 -0400)]
Update the Motherless class for their new Flash variable scheme.

10 years agoUpdate the generic URL parser to avoid matching single and double quotes in URLs.
Michael Orlitzky [Sat, 4 Jun 2011 00:52:22 +0000 (20:52 -0400)]
Update the generic URL parser to avoid matching single and double quotes in URLs.

10 years agoFix the Vimeo class for their new scheme.
Michael Orlitzky [Thu, 2 Jun 2011 17:04:01 +0000 (13:04 -0400)]
Fix the Vimeo class for their new scheme.

10 years agoAdd a generic parser that will hopefully supplant some site-specific subclasses.
Michael Orlitzky [Fri, 11 Mar 2011 02:53:05 +0000 (21:53 -0500)]
Add a generic parser that will hopefully supplant some site-specific subclasses.

10 years agoAdd support for xnxx.com.
Michael Orlitzky [Thu, 10 Feb 2011 03:49:13 +0000 (22:49 -0500)]
Add support for xnxx.com.

10 years agoMove the TODO I just wrote into the todo.txt document.
Michael Orlitzky [Wed, 9 Feb 2011 03:16:04 +0000 (22:16 -0500)]
Move the TODO I just wrote into the todo.txt document.

10 years agoAdd support for www.mentalzero.com.
Michael Orlitzky [Wed, 9 Feb 2011 03:12:59 +0000 (22:12 -0500)]
Add support for www.mentalzero.com.

10 years agoAdd support for xxxbunker.com.
Michael Orlitzky [Tue, 25 Jan 2011 03:27:06 +0000 (22:27 -0500)]
Add support for xxxbunker.com.

10 years agoClean up the code for UriUtilities.
Michael Orlitzky [Tue, 25 Jan 2011 02:17:05 +0000 (21:17 -0500)]
Clean up the code for UriUtilities.

10 years agoAllow the downloaders to take advantage of the websites' headers.
Michael Orlitzky [Tue, 25 Jan 2011 02:07:08 +0000 (21:07 -0500)]
Allow the downloaders to take advantage of the websites' headers.

10 years agoWhitespace cleanup.
Michael Orlitzky [Tue, 25 Jan 2011 01:56:34 +0000 (20:56 -0500)]
Whitespace cleanup.

10 years agoMake headers a property of the website class rather than passing them to get_page_data.
Michael Orlitzky [Tue, 25 Jan 2011 01:49:17 +0000 (20:49 -0500)]
Make headers a property of the website class rather than passing them to get_page_data.
Define a USER_AGENT in the configuration file.

10 years agoAdd support for xvideos.com.
Michael Orlitzky [Tue, 25 Jan 2011 00:45:58 +0000 (19:45 -0500)]
Add support for xvideos.com.

10 years agoFix the hashlink parsing for Redtube.
Michael Orlitzky [Sun, 16 Jan 2011 21:18:54 +0000 (16:18 -0500)]
Fix the hashlink parsing for Redtube.

10 years agoFix the Efukt video url regex.
Michael Orlitzky [Sun, 9 Jan 2011 20:16:13 +0000 (15:16 -0500)]
Fix the Efukt video url regex.

10 years agoAdd support for deviantclip.com.
Michael Orlitzky [Wed, 5 Jan 2011 02:22:00 +0000 (21:22 -0500)]
Add support for deviantclip.com.

10 years agoAdd support for ehow.com.
Michael Orlitzky [Wed, 5 Jan 2011 02:20:55 +0000 (21:20 -0500)]
Add support for ehow.com.

10 years agoAdd support for liveleak.com.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:25 +0000 (20:15 -0500)]
Add support for liveleak.com.

10 years agoFix an off-by-one error in veoh.rb.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:07 +0000 (20:15 -0500)]
Fix an off-by-one error in veoh.rb.

11 years agoAdd a missing character to VALID_BLIPTV_REDIR_URL_REGEX.
Michael Orlitzky [Mon, 18 Oct 2010 03:28:20 +0000 (23:28 -0400)]
Add a missing character to VALID_BLIPTV_REDIR_URL_REGEX.
Unescape the blip.tv redirect URL.

11 years agoAdd blip.tv support for URLs of the form http://blip.tv/play/<foo>.
Michael Orlitzky [Mon, 18 Oct 2010 03:19:47 +0000 (23:19 -0400)]
Add blip.tv support for URLs of the form blip.tv/play/<foo>.

11 years agoRemove the Youtube fixtures and format parsing tests until they can be updated.
Michael Orlitzky [Fri, 23 Jul 2010 22:37:42 +0000 (18:37 -0400)]
Remove the Youtube fixtures and format parsing tests until they can be updated.

11 years agoRemove t_parameter tests for the Youtube class.
Michael Orlitzky [Fri, 23 Jul 2010 22:34:08 +0000 (18:34 -0400)]
Remove t_parameter tests for the Youtube class.

11 years agoFix the Youtube class for the latest update to the site.
Michael Orlitzky [Fri, 23 Jul 2010 22:31:40 +0000 (18:31 -0400)]
Fix the Youtube class for the latest update to the site.
Remove the t_parameter code, replacing it with fmt_url_map parsing.

11 years agoAdd support for dailymotion.com, with tests.
Michael Orlitzky [Sat, 17 Apr 2010 19:31:09 +0000 (15:31 -0400)]
Add support for dailymotion.com, with tests.

11 years agoAllow passing headers (default: {}) to the Website get_page_data method.
Michael Orlitzky [Sat, 17 Apr 2010 19:28:17 +0000 (15:28 -0400)]
Allow passing headers (default: {}) to the Website get_page_data method.

11 years agoAdded tests/fixtures for the most recent Youtube changes.
Michael Orlitzky [Wed, 7 Apr 2010 16:09:14 +0000 (12:09 -0400)]
Added tests/fixtures for the most recent Youtube changes.

11 years agoAdd Youtube support for the "fmt_list" and "t" variables stored as URL parameters.
Michael Orlitzky [Wed, 7 Apr 2010 15:58:55 +0000 (11:58 -0400)]
Add Youtube support for the "fmt_list" and "t" variables stored as URL parameters.

11 years agoRemoved an old (completed) todo item, and added a new one in its place.
Michael Orlitzky [Mon, 5 Apr 2010 06:20:26 +0000 (02:20 -0400)]
Removed an old (completed) todo item, and added a new one in its place.

11 years agoRemoved string.rb since the old Redtube class was its only customer.
Michael Orlitzky [Thu, 1 Apr 2010 22:55:12 +0000 (18:55 -0400)]
Removed string.rb since the old Redtube class was its only customer.

11 years agoUpdate all of the Redtube tests for the new class.
Michael Orlitzky [Thu, 1 Apr 2010 22:54:51 +0000 (18:54 -0400)]
Update all of the Redtube tests for the new class.

11 years agoUpdate the Redtube class. It is no longer necessary to perform magic rituals prior...
Michael Orlitzky [Thu, 1 Apr 2010 22:53:27 +0000 (18:53 -0400)]
Update the Redtube class. It is no longer necessary to perform magic rituals prior to calculating the video URL.

11 years agoModified the default get_video_filename() so that it removes URL parameters.
Michael Orlitzky [Thu, 1 Apr 2010 22:29:57 +0000 (18:29 -0400)]
Modified the default get_video_filename() so that it removes URL parameters.

11 years agoAdded new tests for (yet another) Veoh URL format.
Michael Orlitzky [Thu, 1 Apr 2010 04:45:21 +0000 (00:45 -0400)]
Added new tests for (yet another) Veoh URL format.
Generalized the Veoh URL regex to accept anything ending in what looks like a video id.

11 years agoAdded tests for the new Veoh URL formats.
Michael Orlitzky [Thu, 1 Apr 2010 04:37:11 +0000 (00:37 -0400)]
Added tests for the new Veoh URL formats.

11 years agoAdded URL/parse support for two new Veoh formats.
Michael Orlitzky [Thu, 1 Apr 2010 04:36:43 +0000 (00:36 -0400)]
Added URL/parse support for two new Veoh formats.

11 years agoRaise errors if the Youtube class can't parse either the video id or the format list.
Michael Orlitzky [Wed, 31 Mar 2010 18:57:08 +0000 (14:57 -0400)]
Raise errors if the Youtube class can't parse either the video id or the format list.
Add video id parsing for the new URL format.

11 years agoAdded a new URL format for the Youtube class.
Michael Orlitzky [Wed, 31 Mar 2010 18:56:21 +0000 (14:56 -0400)]
Added a new URL format for the Youtube class.
Created a test for the new URL format.

11 years agoUpdated the BlipTV regular expressions to support the "ogv" extension.
Michael Orlitzky [Thu, 18 Mar 2010 19:04:41 +0000 (15:04 -0400)]
Updated the BlipTV regular expressions to support the "ogv" extension.

11 years agoAdded the fixture used in the new Youtube tests.
Michael Orlitzky [Thu, 14 Jan 2010 04:14:14 +0000 (23:14 -0500)]
Added the fixture used in the new Youtube tests.

11 years agoAdded two new Youtube tests for the available/desired video formats.
Michael Orlitzky [Thu, 14 Jan 2010 04:13:43 +0000 (23:13 -0500)]
Added two new Youtube tests for the available/desired video formats.

11 years agoAdded high-definition video support to the Youtube class.
Michael Orlitzky [Thu, 14 Jan 2010 04:12:50 +0000 (23:12 -0500)]
Added high-definition video support to the Youtube class.

11 years agoAdded the OGG/Vorbis format parsing to Bliptv.
Michael Orlitzky [Mon, 7 Dec 2009 17:46:04 +0000 (12:46 -0500)]
Added the OGG/Vorbis format parsing to Bliptv.
Created a test case for the OGG/Vorbis parsing.
Renamed an existing Bliptv test which was copied incorrectly.

11 years agoAdded support for motherless.com.
Michael Orlitzky [Tue, 24 Nov 2009 02:07:14 +0000 (21:07 -0500)]
Added support for motherless.com.

11 years agoAdded GetOpt option parsing.
Michael Orlitzky [Thu, 29 Oct 2009 14:47:47 +0000 (10:47 -0400)]
Added GetOpt option parsing.
Take a '--continue' option, passed on to the downloader, which determines whether or not we attempt to continue a previous download.
Modified the downloaders to throw an IOError if the output file already exists and we're not continuing a previous download.
Print the external command used to execute Wget.

12 years agoUpdated Redtube to work with the site's new algorithm.
Michael Orlitzky [Fri, 2 Oct 2009 19:28:39 +0000 (15:28 -0400)]
Updated Redtube to work with the site's new algorithm.
Made one local Redtube test a remote test.
Updated the remote test suite to include the Redtube remote tests.
Added a local fixture for Redtube tests.
Added one local test utilizing the new fixture.

12 years agoAdded support for blip.tv.
Michael Orlitzky [Fri, 2 Oct 2009 02:16:02 +0000 (22:16 -0400)]
Added support for blip.tv.
Created the Bliptv class.
Added several tests, along with fixtures, for the new class.
Added the Bliptv tests to the test suite.

12 years agoRemoved whitespace.
Michael Orlitzky [Fri, 2 Oct 2009 02:09:06 +0000 (22:09 -0400)]
Removed whitespace.

12 years agoAdded configurable downloaders.
Michael Orlitzky [Sun, 27 Sep 2009 04:52:46 +0000 (00:52 -0400)]
Added configurable downloaders.
Created three new classes: Downloader, OpenUriDownloader, and WgetDownloader.
Created a configuration file.
Modified whatever-dl to use the configuration information.

12 years agoFixed brain error re: symbols/methods.
Michael Orlitzky [Sun, 27 Sep 2009 00:46:50 +0000 (20:46 -0400)]
Fixed brain error re: symbols/methods.

12 years agoReplaced the Yikers algorithm with a simpler one (that actually works).
Michael Orlitzky [Sun, 27 Sep 2009 00:46:01 +0000 (20:46 -0400)]
Replaced the Yikers algorithm with a simpler one (that actually works).
Removed the obsolete Yikers tests and fixtures.

12 years agoRemoved the redundant get_page_data method from the Yikers class.
Michael Orlitzky [Sun, 27 Sep 2009 00:25:48 +0000 (20:25 -0400)]
Removed the redundant get_page_data method from the Yikers class.

12 years agoFixed the Howcast downloads.
Michael Orlitzky [Sun, 27 Sep 2009 00:20:41 +0000 (20:20 -0400)]
Fixed the Howcast downloads.
Modified the Howcast class to parse an XML file containing the real video URL.
Added a test for the new method.

12 years agoFixed the KCODE is NONE warning.
Michael Orlitzky [Sun, 27 Sep 2009 00:19:40 +0000 (20:19 -0400)]
Fixed the KCODE is NONE warning.

12 years agoMerged upstream branch (master).
Michael Orlitzky [Fri, 2 Oct 2009 02:45:37 +0000 (22:45 -0400)]
Merged upstream branch (master).

12 years agoAdded support for a second filename pattern to the Efukt class.
Michael Orlitzky [Sun, 30 Aug 2009 02:47:10 +0000 (22:47 -0400)]
Added support for a second filename pattern to the Efukt class.
Created a fixture and a test case for the new pattern.

12 years agoFixed a typo in the Efukt class.
Michael Orlitzky [Sun, 30 Aug 2009 02:21:06 +0000 (22:21 -0400)]
Fixed a typo in the Efukt class.

12 years agoAdded the net/http requirement to the Website class (which now needs it).
Michael Orlitzky [Wed, 1 Apr 2009 06:49:37 +0000 (02:49 -0400)]
Added the net/http requirement to the Website class (which now needs it).
Removed some redundant requires from the website subclasses.

12 years agoAdded the beginnings of Megaporn support. There's still something missing, but the...
Michael Orlitzky [Sat, 21 Mar 2009 04:37:32 +0000 (00:37 -0400)]
Added the beginnings of Megaporn support. There's still something missing, but the decryption routine is (probably) implemented correctly.

12 years agoSilly whitespace changes.
Michael Orlitzky [Sat, 21 Mar 2009 04:36:36 +0000 (00:36 -0400)]
Silly whitespace changes.

12 years agoFactored out the Youtube implementation of get_page_data into the Website superclass.
Michael Orlitzky [Sat, 21 Mar 2009 04:35:54 +0000 (00:35 -0400)]
Factored out the Youtube implementation of get_page_data into the Website superclass.

12 years agoAdded the ability to download FuckedTube (http://www.fuckedtube.com/) videos.
Michael Orlitzky [Tue, 17 Mar 2009 23:09:13 +0000 (19:09 -0400)]
Added the ability to download FuckedTube (fuckedtube.com/) videos.

12 years agoUpdated the Youtube URL regex to allow any hostname.youtube.com pattern.
Michael Orlitzky [Mon, 2 Mar 2009 00:14:09 +0000 (19:14 -0500)]
Updated the Youtube URL regex to allow any hostname.youtube.com pattern.
Added a test to ensure that uk.youtube.com URLs are handled properly.

12 years agoModified the Youtube class to accept in.youtube.com URLs.
Michael Orlitzky [Mon, 12 Jan 2009 00:46:40 +0000 (19:46 -0500)]
Modified the Youtube class to accept in.youtube.com URLs.
Added a test for the new behavior.

12 years agoI take that last commit back. Now the relative include path issue is fixed. The previ...
Michael Orlitzky [Fri, 21 Nov 2008 22:01:32 +0000 (17:01 -0500)]
I take that last commit back. Now the relative include path issue is fixed. The previous commit fails to include all of the website classes since the Dir.glob method doesn't necessarily (usually) look in the correct place.

12 years agoFixed the relative path require issue. Now we should be able to symlink the main...
Michael Orlitzky [Sat, 15 Nov 2008 23:46:54 +0000 (18:46 -0500)]
Fixed the relative path require issue. Now we should be able to symlink the main executable and run it from wherever.

12 years agoAdded the ability to download videos from http://www.efukt.com/.
Michael Orlitzky [Tue, 11 Nov 2008 01:34:43 +0000 (20:34 -0500)]
Added the ability to download videos from efukt.com/.

12 years agoAdded the ability to download videos from http://www.yikers.com/.
mjo [Fri, 31 Oct 2008 17:09:08 +0000 (13:09 -0400)]
Added the ability to download videos from yikers.com/.
Created tests for the new Yikers class.
Added a method to the Website class returning the host portion of its URL.

13 years agoMade the output filename the responsibility of the website subclass.
Michael Orlitzky [Sun, 7 Sep 2008 05:51:52 +0000 (01:51 -0400)]
Made the output filename the responsibility of the website subclass.

Added a factory method to the website class which creates the appropriate subclass based on the URL given to it.
Added a get_video_filename method to the website class.
Made two Website methods abstract via NotImplementedError, get_video_url and owns_url?.
Created a default implementation of get_video_filename in the Website class.
Made the site URL member data of the Website class.
Fixed a bug in the URL handling for Youtube.
Added output stating the filename for the download.
Replaced all code in the classes/tests to accommodate the other changes.