1.4 released

[Sebastian Nagel]

Hi,

we are pleased to announce the 1.4 release of Crawler-Commons.

For the list of changes and new features see

https://github.com/crawler-commons/crawler-commons/releases/tag/crawler-commons-1.4

Important changes:
- Java 11 is required to run or build crawler-commons
- the robots.txt parser (SimpleRobotRulesParser) is compliant with RFC 9309

See also:

https://github.com/crawler-commons/crawler-commons#18th-july-2023----crawler-commons-14-released

The dependencies should be available on Maven central shortly.

Thanks to all contributors!

Best,
Sebastian