- Using
curlinstead ofwget - Fix #36 (unable to read cookie file)
- Fix #34 (
413 Request Entity Too Large)
- Loop detection: #24.
- Add test cases.
- Update documentation (Cookie issue.)
- Minor code improvements.
- Group with category support (#28, Thanks @LeeKevin)
- Fix bugs: #6 (compatibility issue), #13 (so large group), #16 (email exporting and third-party license issue)
- Fix script shebang.
- Google organization support.
- Ensure group name is in lowercase.
- Minor scripting improvements.
- Drop the use of
lynxprogram.wgethandles all download now. - Accept
_WGET_OPTIONSenvironment to controlwgetcommands. - Can work with private groups thanks to
_WGET_OPTIONSenvironment. - Rename script (
craw.shbecomescrawler.sh.) - Output important variables to the output script.
- Update documentation (
README.md.)
- Provide fancy agent to
wgetandlynxcommand. - Fix wrong URL of
rssfeed. - Use
set -uto avoid unbound variable. - Fix display charset of
lynxprogram. See #3.
- The first public version.