Releasing 1.3 ?

2 views
Skip to first unread message

Richard Zowalla

unread,
Jul 7, 2022, 4:07:31 AM7/7/22
to crawler-commons
Hi, 

We have only a few issues marked for 1.3 and quite a few dependency updates 

Shall we release 1.3 soon? Anything you'd like to see included which is not already tagged for that release? Any volunteers to work on the issues already planned?

Have a nice day 

Richard

Sebastian Nagel

unread,
Jul 7, 2022, 10:42:29 AM7/7/22
to crawler...@googlegroups.com
Hi,

> We have only a few issues marked for 1.3
> <https://github.com/crawler-commons/crawler-commons/milestone/9> and quite a
> few dependency updates

I've added all open dependency upgrades to the 1.3 milestone:
now there are six open issues or PRs. Or four if we delay #351 and #375
until a later release.


> Shall we release 1.3 soon?

+1


What about delaying the following issues / PRs?

#375 - it's still not August 2022 and (following the discussion in the issue)
would require to implement first a validating mode of the sitemap parser.

#351 - yes, this PR is approved by me. However, since it's a significant change
how robots.txt rules are handled, we may move this to a 1.4 release
and have "IETF RFC draft compliance" as a major feature. This should
include at least: #192, #351, #360, #362

As of today, the draft reached version 12 [1], so it may change in minor
details. Nevertheless, #192 and #351 would make the crawler-commons
robots.txt parser behave more similar to how major search engines
handle the robots.txt rules.

Any thoughts? I plan to spend some time during summer to bring this
feature forward.

Best,
Sebastian


[1] https://datatracker.ietf.org/doc/draft-koster-rep/history/


On 7/7/22 10:07, Richard Zowalla wrote:
> Hi, 
>
> We have only a few issues marked for 1.3
> <https://github.com/crawler-commons/crawler-commons/milestone/9> and quite a

Richard Zowalla

unread,
Jul 7, 2022, 11:31:57 AM7/7/22
to crawler...@googlegroups.com
I am +1 for delaying #375 + #351 and would like to see our robots.txt parser evolve ;)

Gruß
Richard



--
You received this message because you are subscribed to the Google Groups "crawler-commons" group.
To unsubscribe from this group and stop receiving emails from it, send an email to crawler-commo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/crawler-commons/1d909fb2-7ae2-f78a-d8b3-492085c279e3%40googlemail.com.
Reply all
Reply to author
Forward
0 new messages