]>
gitweb.michael.orlitzky.com - dead/whatever-dl.git/log
Michael Orlitzky [Mon, 9 Dec 2013 16:22:36 +0000 (11:22 -0500)]
Add a license to the gemspec.
Michael Orlitzky [Tue, 19 Nov 2013 15:48:02 +0000 (10:48 -0500)]
Fix filenames for Pornhd videos.
Michael Orlitzky [Tue, 19 Nov 2013 15:41:46 +0000 (10:41 -0500)]
New website: http://www.pornhd.com/.
Michael Orlitzky [Sun, 14 Oct 2012 21:57:26 +0000 (17:57 -0400)]
Fix the motherless video URL regex.
Michael Orlitzky [Wed, 13 Jun 2012 03:33:36 +0000 (23:33 -0400)]
Add a gemspec file, completing(?) the move to a sane package layout.
Michael Orlitzky [Wed, 13 Jun 2012 03:27:32 +0000 (23:27 -0400)]
Fix the progressbar require path in uri_utilities.rb.
Replace the makefile with a Rakefile.
Update all of the test code to run under `rake test`.
Add a short README.
Michael Orlitzky [Wed, 13 Jun 2012 02:52:57 +0000 (22:52 -0400)]
Eliminate the redundand 'vendor' directory.
Remove the remote tests, mosts of which fail now.
Michael Orlitzky [Wed, 13 Jun 2012 02:03:06 +0000 (22:03 -0400)]
Update the makefile to build/install a gem.
Michael Orlitzky [Wed, 13 Jun 2012 02:02:40 +0000 (22:02 -0400)]
Use strings instead of symbols for the downloader type.
Michael Orlitzky [Wed, 13 Jun 2012 01:58:38 +0000 (21:58 -0400)]
Fix website require paths.
Michael Orlitzky [Wed, 13 Jun 2012 01:56:51 +0000 (21:56 -0400)]
Make the Configuration module a class.
Michael Orlitzky [Wed, 13 Jun 2012 01:51:41 +0000 (21:51 -0400)]
Fix a missing slash.
Michael Orlitzky [Wed, 13 Jun 2012 01:44:21 +0000 (21:44 -0400)]
Use the logger class to log warnings and errors.
Run the main script whether or not it was invoked directly.
Move the exit codes into their own module.
Michael Orlitzky [Mon, 11 Jun 2012 01:34:47 +0000 (21:34 -0400)]
Fix a few require paths.
Michael Orlitzky [Mon, 11 Jun 2012 01:24:13 +0000 (21:24 -0400)]
Update bin/whatever-dl and the configuration class for the other changes.
Michael Orlitzky [Mon, 11 Jun 2012 01:23:45 +0000 (21:23 -0400)]
Add the base 'rb' file which includes all of the other requirements.
Michael Orlitzky [Mon, 11 Jun 2012 01:23:28 +0000 (21:23 -0400)]
Add an example config file.
Michael Orlitzky [Mon, 11 Jun 2012 01:22:45 +0000 (21:22 -0400)]
Move all of the 'src' code under the more-standard 'lib'.
Create a yaml-based configuration class.
Michael Orlitzky [Mon, 11 Jun 2012 00:23:39 +0000 (20:23 -0400)]
Fix all Ruby 1.9 errors and warnings.
Michael Orlitzky [Mon, 11 Jun 2012 00:22:52 +0000 (20:22 -0400)]
Update the makefile and test code so that the tests run with Ruby 1.9 and pass generally.
Michael Orlitzky [Mon, 11 Jun 2012 00:15:16 +0000 (20:15 -0400)]
Remove a number of fixtures whose tests no longer pass.
Michael Orlitzky [Wed, 11 Jan 2012 01:18:39 +0000 (20:18 -0500)]
Rewrite most of Bliptv to work with their new scheme.
Michael Orlitzky [Fri, 18 Nov 2011 23:35:28 +0000 (18:35 -0500)]
Remove 'www' from the Vimeo details URL.
Michael Orlitzky [Thu, 3 Nov 2011 14:17:27 +0000 (10:17 -0400)]
Add "?start=0" to the end of motherless URLs.
Whitespace cleanup in motherless.rb.
Michael Orlitzky [Sat, 15 Oct 2011 13:24:43 +0000 (09:24 -0400)]
Re-fix the Youtube itag parameter. It works in both duplicated and non-duplicated cases now.
Michael Orlitzky [Fri, 14 Oct 2011 20:10:24 +0000 (16:10 -0400)]
Add a fix for Youtube's itag parameter.
Make the fmt_stream_url selection smarter.
Michael Orlitzky [Sat, 6 Aug 2011 16:55:20 +0000 (12:55 -0400)]
Use single quotes around the URL in our 'wget' command.
Add a fallback method for parsing Youtube video URLs.
Michael Orlitzky [Sun, 24 Jul 2011 06:03:47 +0000 (02:03 -0400)]
Add HTML5 source element src parsing to the Redtube class.
Prefer the HTML5 videos over Flash ones where applicable.
Michael Orlitzky [Sat, 4 Jun 2011 01:05:35 +0000 (21:05 -0400)]
Update the Motherless class for their new Flash variable scheme.
Michael Orlitzky [Sat, 4 Jun 2011 00:52:22 +0000 (20:52 -0400)]
Update the generic URL parser to avoid matching single and double quotes in URLs.
Michael Orlitzky [Thu, 2 Jun 2011 17:04:01 +0000 (13:04 -0400)]
Fix the Vimeo class for their new scheme.
Michael Orlitzky [Fri, 11 Mar 2011 02:53:05 +0000 (21:53 -0500)]
Add a generic parser that will hopefully supplant some site-specific subclasses.
Michael Orlitzky [Thu, 10 Feb 2011 03:49:13 +0000 (22:49 -0500)]
Add support for xnxx.com.
Michael Orlitzky [Wed, 9 Feb 2011 03:16:04 +0000 (22:16 -0500)]
Move the TODO I just wrote into the todo.txt document.
Michael Orlitzky [Wed, 9 Feb 2011 03:12:59 +0000 (22:12 -0500)]
Add support for www.mentalzero.com.
Michael Orlitzky [Tue, 25 Jan 2011 03:27:06 +0000 (22:27 -0500)]
Add support for xxxbunker.com.
Michael Orlitzky [Tue, 25 Jan 2011 02:17:05 +0000 (21:17 -0500)]
Clean up the code for UriUtilities.
Michael Orlitzky [Tue, 25 Jan 2011 02:07:08 +0000 (21:07 -0500)]
Allow the downloaders to take advantage of the websites' headers.
Michael Orlitzky [Tue, 25 Jan 2011 01:56:34 +0000 (20:56 -0500)]
Whitespace cleanup.
Michael Orlitzky [Tue, 25 Jan 2011 01:49:17 +0000 (20:49 -0500)]
Make headers a property of the website class rather than passing them to get_page_data.
Define a USER_AGENT in the configuration file.
Michael Orlitzky [Tue, 25 Jan 2011 00:45:58 +0000 (19:45 -0500)]
Add support for xvideos.com.
Michael Orlitzky [Sun, 16 Jan 2011 21:18:54 +0000 (16:18 -0500)]
Fix the hashlink parsing for Redtube.
Michael Orlitzky [Sun, 9 Jan 2011 20:16:13 +0000 (15:16 -0500)]
Fix the Efukt video url regex.
Michael Orlitzky [Wed, 5 Jan 2011 02:22:00 +0000 (21:22 -0500)]
Add support for deviantclip.com.
Michael Orlitzky [Wed, 5 Jan 2011 02:20:55 +0000 (21:20 -0500)]
Add support for ehow.com.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:25 +0000 (20:15 -0500)]
Add support for liveleak.com.
Michael Orlitzky [Sun, 5 Dec 2010 01:15:07 +0000 (20:15 -0500)]
Fix an off-by-one error in veoh.rb.
Michael Orlitzky [Mon, 18 Oct 2010 03:28:20 +0000 (23:28 -0400)]
Add a missing character to VALID_BLIPTV_REDIR_URL_REGEX.
Unescape the blip.tv redirect URL.
Michael Orlitzky [Mon, 18 Oct 2010 03:19:47 +0000 (23:19 -0400)]
Add blip.tv support for URLs of the form http://blip.tv/play/<foo>.
Michael Orlitzky [Fri, 23 Jul 2010 22:37:42 +0000 (18:37 -0400)]
Remove the Youtube fixtures and format parsing tests until they can be updated.
Michael Orlitzky [Fri, 23 Jul 2010 22:34:08 +0000 (18:34 -0400)]
Remove t_parameter tests for the Youtube class.
Michael Orlitzky [Fri, 23 Jul 2010 22:31:40 +0000 (18:31 -0400)]
Fix the Youtube class for the latest update to the site.
Remove the t_parameter code, replacing it with fmt_url_map parsing.
Michael Orlitzky [Sat, 17 Apr 2010 19:31:09 +0000 (15:31 -0400)]
Add support for dailymotion.com, with tests.
Michael Orlitzky [Sat, 17 Apr 2010 19:28:17 +0000 (15:28 -0400)]
Allow passing headers (default: {}) to the Website get_page_data method.
Michael Orlitzky [Wed, 7 Apr 2010 16:09:14 +0000 (12:09 -0400)]
Added tests/fixtures for the most recent Youtube changes.
Michael Orlitzky [Wed, 7 Apr 2010 15:58:55 +0000 (11:58 -0400)]
Add Youtube support for the "fmt_list" and "t" variables stored as URL parameters.
Michael Orlitzky [Mon, 5 Apr 2010 06:20:26 +0000 (02:20 -0400)]
Removed an old (completed) todo item, and added a new one in its place.
Michael Orlitzky [Thu, 1 Apr 2010 22:55:12 +0000 (18:55 -0400)]
Removed string.rb since the old Redtube class was its only customer.
Michael Orlitzky [Thu, 1 Apr 2010 22:54:51 +0000 (18:54 -0400)]
Update all of the Redtube tests for the new class.
Michael Orlitzky [Thu, 1 Apr 2010 22:53:27 +0000 (18:53 -0400)]
Update the Redtube class. It is no longer necessary to perform magic rituals prior to calculating the video URL.
Michael Orlitzky [Thu, 1 Apr 2010 22:29:57 +0000 (18:29 -0400)]
Modified the default get_video_filename() so that it removes URL parameters.
Michael Orlitzky [Thu, 1 Apr 2010 04:45:21 +0000 (00:45 -0400)]
Added new tests for (yet another) Veoh URL format.
Generalized the Veoh URL regex to accept anything ending in what looks like a video id.
Michael Orlitzky [Thu, 1 Apr 2010 04:37:11 +0000 (00:37 -0400)]
Added tests for the new Veoh URL formats.
Michael Orlitzky [Thu, 1 Apr 2010 04:36:43 +0000 (00:36 -0400)]
Added URL/parse support for two new Veoh formats.
Michael Orlitzky [Wed, 31 Mar 2010 18:57:08 +0000 (14:57 -0400)]
Raise errors if the Youtube class can't parse either the video id or the format list.
Add video id parsing for the new URL format.
Michael Orlitzky [Wed, 31 Mar 2010 18:56:21 +0000 (14:56 -0400)]
Added a new URL format for the Youtube class.
Created a test for the new URL format.
Michael Orlitzky [Thu, 18 Mar 2010 19:04:41 +0000 (15:04 -0400)]
Updated the BlipTV regular expressions to support the "ogv" extension.
Michael Orlitzky [Thu, 14 Jan 2010 04:14:14 +0000 (23:14 -0500)]
Added the fixture used in the new Youtube tests.
Michael Orlitzky [Thu, 14 Jan 2010 04:13:43 +0000 (23:13 -0500)]
Added two new Youtube tests for the available/desired video formats.
Michael Orlitzky [Thu, 14 Jan 2010 04:12:50 +0000 (23:12 -0500)]
Added high-definition video support to the Youtube class.
Michael Orlitzky [Mon, 7 Dec 2009 17:46:04 +0000 (12:46 -0500)]
Added the OGG/Vorbis format parsing to Bliptv.
Created a test case for the OGG/Vorbis parsing.
Renamed an existing Bliptv test which was copied incorrectly.
Michael Orlitzky [Tue, 24 Nov 2009 02:07:14 +0000 (21:07 -0500)]
Added support for motherless.com.
Michael Orlitzky [Thu, 29 Oct 2009 14:47:47 +0000 (10:47 -0400)]
Added GetOpt option parsing.
Take a '--continue' option, passed on to the downloader, which determines whether or not we attempt to continue a previous download.
Modified the downloaders to throw an IOError if the output file already exists and we're not continuing a previous download.
Print the external command used to execute Wget.
Michael Orlitzky [Fri, 2 Oct 2009 19:28:39 +0000 (15:28 -0400)]
Updated Redtube to work with the site's new algorithm.
Made one local Redtube test a remote test.
Updated the remote test suite to include the Redtube remote tests.
Added a local fixture for Redtube tests.
Added one local test utilizing the new fixture.
Michael Orlitzky [Fri, 2 Oct 2009 02:16:02 +0000 (22:16 -0400)]
Added support for blip.tv.
Created the Bliptv class.
Added several tests, along with fixtures, for the new class.
Added the Bliptv tests to the test suite.
Michael Orlitzky [Fri, 2 Oct 2009 02:09:06 +0000 (22:09 -0400)]
Removed whitespace.
Michael Orlitzky [Sun, 27 Sep 2009 04:52:46 +0000 (00:52 -0400)]
Added configurable downloaders.
Created three new classes: Downloader, OpenUriDownloader, and WgetDownloader.
Created a configuration file.
Modified whatever-dl to use the configuration information.
Michael Orlitzky [Sun, 27 Sep 2009 00:46:50 +0000 (20:46 -0400)]
Fixed brain error re: symbols/methods.
Michael Orlitzky [Sun, 27 Sep 2009 00:46:01 +0000 (20:46 -0400)]
Replaced the Yikers algorithm with a simpler one (that actually works).
Removed the obsolete Yikers tests and fixtures.
Michael Orlitzky [Sun, 27 Sep 2009 00:25:48 +0000 (20:25 -0400)]
Removed the redundant get_page_data method from the Yikers class.
Michael Orlitzky [Sun, 27 Sep 2009 00:20:41 +0000 (20:20 -0400)]
Fixed the Howcast downloads.
Modified the Howcast class to parse an XML file containing the real video URL.
Added a test for the new method.
Michael Orlitzky [Sun, 27 Sep 2009 00:19:40 +0000 (20:19 -0400)]
Fixed the KCODE is NONE warning.
Michael Orlitzky [Fri, 2 Oct 2009 02:45:37 +0000 (22:45 -0400)]
Merged upstream branch (master).
Michael Orlitzky [Sun, 30 Aug 2009 02:47:10 +0000 (22:47 -0400)]
Added support for a second filename pattern to the Efukt class.
Created a fixture and a test case for the new pattern.
Michael Orlitzky [Sun, 30 Aug 2009 02:21:06 +0000 (22:21 -0400)]
Fixed a typo in the Efukt class.
Michael Orlitzky [Wed, 1 Apr 2009 06:49:37 +0000 (02:49 -0400)]
Added the net/http requirement to the Website class (which now needs it).
Removed some redundant requires from the website subclasses.
Michael Orlitzky [Sat, 21 Mar 2009 04:37:32 +0000 (00:37 -0400)]
Added the beginnings of Megaporn support. There's still something missing, but the decryption routine is (probably) implemented correctly.
Michael Orlitzky [Sat, 21 Mar 2009 04:36:36 +0000 (00:36 -0400)]
Silly whitespace changes.
Michael Orlitzky [Sat, 21 Mar 2009 04:35:54 +0000 (00:35 -0400)]
Factored out the Youtube implementation of get_page_data into the Website superclass.
Michael Orlitzky [Tue, 17 Mar 2009 23:09:13 +0000 (19:09 -0400)]
Added the ability to download FuckedTube (http://www.fuckedtube.com/) videos.
Michael Orlitzky [Mon, 2 Mar 2009 00:14:09 +0000 (19:14 -0500)]
Updated the Youtube URL regex to allow any hostname.youtube.com pattern.
Added a test to ensure that uk.youtube.com URLs are handled properly.
Michael Orlitzky [Mon, 12 Jan 2009 00:46:40 +0000 (19:46 -0500)]
Modified the Youtube class to accept in.youtube.com URLs.
Added a test for the new behavior.
Michael Orlitzky [Fri, 21 Nov 2008 22:01:32 +0000 (17:01 -0500)]
I take that last commit back. Now the relative include path issue is fixed. The previous commit fails to include all of the website classes since the Dir.glob method doesn't necessarily (usually) look in the correct place.
Michael Orlitzky [Sat, 15 Nov 2008 23:46:54 +0000 (18:46 -0500)]
Fixed the relative path require issue. Now we should be able to symlink the main executable and run it from wherever.
Michael Orlitzky [Tue, 11 Nov 2008 01:34:43 +0000 (20:34 -0500)]
Added the ability to download videos from http://www.efukt.com/.
mjo [Fri, 31 Oct 2008 17:09:08 +0000 (13:09 -0400)]
Added the ability to download videos from http://www.yikers.com/.
Created tests for the new Yikers class.
Added a method to the Website class returning the host portion of its URL.
Michael Orlitzky [Sun, 7 Sep 2008 05:51:52 +0000 (01:51 -0400)]
Made the output filename the responsibility of the website subclass.
Added a factory method to the website class which creates the appropriate subclass based on the URL given to it.
Added a get_video_filename method to the website class.
Made two Website methods abstract via NotImplementedError, get_video_url and owns_url?.
Created a default implementation of get_video_filename in the Website class.
Made the site URL member data of the Website class.
Fixed a bug in the URL handling for Youtube.
Added output stating the filename for the download.
Replaced all code in the classes/tests to accommodate the other changes.
Michael Orlitzky [Sat, 6 Sep 2008 03:44:59 +0000 (23:44 -0400)]
Fixed a bug in the Youtube class' parsing of the "t" parameter.
Modified the "t" parsing regex to catch non-alphanumeric characters, which from experience I now know are possible.
Added a test/fixture to expose the bug.
The whatever-dl executable now outputs "Fetching #{video_url}" before actually fetching the file.
mjo [Tue, 2 Sep 2008 22:17:12 +0000 (18:17 -0400)]
Added a documentation directory with a short todo list.
mjo [Tue, 2 Sep 2008 22:13:40 +0000 (18:13 -0400)]
Added the ability to download Youtube videos.
Fixed a typo in the main executable which was causing a crash.
Added the progress bar tests back to the suite.
Added a Youtube class and the accompanying unit tests/fixtures.