Commit Graph

12 Commits (c68a24193ccd970a36f816ebb0890ae56c263f73)

Author SHA1 Message Date
Icedream bd63c975b8
parsers/web: Remove unused import "log". 2016-08-09 00:15:51 +02:00
Icedream 3faff8264f
Add filename to image information.
This fixes #6.
2016-08-08 14:05:55 +02:00
Icedream 1e3af32706
parsers/web: Use unique user agent to get around HTTP error 429 on Reddit.
This fixes #12.
2016-08-08 13:53:44 +02:00
Icedream b37a15ac1f
Introduce "--images" flag to enable image link parsing and disable image link parsing by default. 2016-07-26 20:36:36 +02:00
Icedream d6a32315f6 parsers/web: Remove extra logging. 2016-06-20 02:45:29 +02:00
Icedream dc5597c054 parsers/web: Remove hash reference when parsing URL.
Fixes #8.
2016-06-20 02:43:30 +02:00
Icedream 2163bfc99f parsers/web: Remove extra logging lines. 2016-06-20 02:30:10 +02:00
Icedream ae1dce4bce New-line fix caused extra spaces between each character. 2016-06-19 23:34:57 +02:00
Icedream 8696313f8e Move "(no title)" text to its own constant noTitleStr.
Main purpose is for making integration testing easier later.
2016-06-19 23:32:27 +02:00
Icedream ec899f0ddf Replace new-line characters in HTML title with space.
Targets #2.
2016-06-19 23:31:57 +02:00
Icedream 6775fe5100 parsers/web: Limit HTML parsing to first 8 kB and use Content-Length header.
Targets #2.
2016-06-19 23:09:22 +02:00
Icedream 4a60f6142a Initial commit.
Source code not properly documented yet and barely any testing but this is the code as running on the server at the moment.
2016-06-11 16:08:13 +02:00