crawler-commons

Hi, we are pleased to announce the 1.4 release of Crawler-Commons. For the list of changes and new

Thanks for the release and all your hard work Sebastian. On Tue, 18 Jul 2023 at 11:38, 'Sebastian

Thank you so much Sebastian! On Wed, Jul 12, 2023 at 6:23 PM 'Sebastian Nagel' via crawler-

There is a related PR available -> should we move forward and just switch? Java 21 (LTS) is

That's great! Thanks Sebastian On Thu, 28 Jul 2022 at 12:27, 'Sebastian Nagel' via

Hi Richard, thanks. > Don't think that many users will > use the extracted javadoc locally.

I am +1 for delaying #375 + #351 and would like to see our robots.txt parser evolve ;) Gruß Richard

Thanks for the update Julien. Have fun. All the best. I wish I was going to Berlin 😀 On Thu, Jun 9,

Brilliant and inspiring Thank you Julien, I really hope you will get another round of funding, this

Thanks for the release Sebastian! On Thu, 14 Oct 2021 at 15:59, 'Sebastian Nagel' via crawler

Thanks for the votes! I'll continue with the release... +1 from Aécio Avi Julien Sebastian On 10/

done! On Thu, 7 Oct 2021 at 20:32, 'Sebastian Nagel' via crawler-commons <crawler-commons@

Congratulations Julien. Thanks for opening this up and sharing. Lewis On Fri, Sep 10, 2021 at 07:44

In the past there was talk about having our project an official Apache project, what are your

Hi, I am pleased to announce that URL Frontier 0.2 has just been released. It includes changes and

Sounds great !! I love the idea. Will be happy to follow Avi. On Tue, Dec 8, 2020 at 11:28 AM Julien

Nice Julien and team. Great work! On Mon, Jun 29, 2020 at 10:16 Julien Nioche <lists.digitalpebble

Thanks Julien +1 On Thu, Jun 25, 2020, 12:42 'Sebastian Nagel' via crawler-commons <

+1 And I will go for #270 I will appreciate feedback on that one though On Thu, Jun 18, 2020 at 5:10

thanks Sebastian On Mon, 25 Mar 2019 at 09:33, 'Sebastian Nagel' via crawler-commons <

Hi We are glad to announce the 0.10 release of Crawler-Commons. See the CHANGES.txt file included

Hi Laurence, If the result of fetching robots.txt is a failure, then we don't know whether or not

Happy Halloween! We are glad to announce the 0.9 release of Crawler-Commons. See the CHANGES.txt file

+1 On 10/27/2017 12:24 PM, Julien Nioche wrote: > Hi > > I have pushed a RC for 0.9 >

Hi, Thanks for voting. Option B got 2 votes so we'll go for that. I'll merge #181 and will

Great job! From: Julien Nioche <lists.dig...@gmail.com> Reply-To: "d...@nutch.apache

Hi Ken This was done in the previous release and documented in the announcement at the time =>

Hi Julien, I've included all of the CHANGES for current development under the 0.8 milestone.

> Is this where you ran across the issue of the SAX parser generating invalid URLs from broken XML

Sounds good Ken. Small components like this are good. I've not tried anything yet... but will