Abot support for .NET Core

225 views
Skip to first unread message

sjdirect

unread,
Oct 14, 2016, 3:11:23 PM10/14/16
to Abot Web Crawler
All,

I have created the abot-dotnet-core repository and started the process of upgrading to .net core. I do not have time to work on this project. I'm looking for someone who can lead the porting efforts including documentation, setting up the build, nuget package creation, and issue management. I will give that person access as a contributor (and possible transfer of ownership) after a few pull requests demonstrate they are committed to making a great product.

Thanks!!!

kem...@gmail.com

unread,
Oct 23, 2016, 5:47:08 PM10/23/16
to Abot Web Crawler
Hello there,

i've successfully made abot dotnet core compatible. The code and the commits are not very clear right now but you can find it in my repo. All your tests were passed but i faced some problems so i don't consider it done.

Right now i port your two other libraries (Commoner and NRobots). I made a small pull request for the Commoner. And right now i am working on two other pull request for NRobot. I am trying to squash my commits so it is more readable. And i will do these pull requests soon.

I am really glad to contribute on this project and try to finalize my code so i can share it with the community.

Attila

kem...@gmail.com

unread,
Nov 5, 2016, 6:42:13 PM11/5/16
to Abot Web Crawler, kem...@gmail.com
Hi Steven,

i am the contributor in the abot-dotnet-core project. I don't know what is your preferred channel to discuss some questions about to dotnet core port.
I need some help regarding the tests. Most of the test run successfully.
Non utf8 tests are failing: GetContent_NonUtf8, GetContent_MetaSingleQuotes_NonUtf8, GetContent_MetaDoubleQuotesAndClose_NonUtf8,
GetContent_MetaSingleQuotesAndClose_NonUtf8: i don't really understand how should that tests work. They try to connect non existent websites: aaa.jp, aaa2.jp, etc. How should these tests work?

The other test is an integration test. In the CrawlWvtesting2 class there is a lot of address and response to test. If i see it correctly some of these addresses are outdated now so the test found discrepancies. Can you review these addresses?

Thanks:
Attila

sjdi...@gmail.com

unread,
Nov 7, 2016, 12:45:47 PM11/7/16
to kem...@gmail.com, Abot Web Crawler
Hey,

All Abot unit and integration tests first pragmatically fire up fiddler and load auto responses from the TestResponses.saz file. The aaa.jp and aaa2.jp responses are in that file and when fiddler has that .saz loaded it will respond with those recorded responses. This is done in the Abot.Tests.Unit.AssemblySetup.cs file. I also believe all the other responses that you are having trouble with are in the .saz as well. 

Hope that helps.



--
You received this message because you are subscribed to the Google Groups "Abot Web Crawler" group.
To unsubscribe from this group and stop receiving emails from it, send an email to abot-web-crawler+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

alok jain

unread,
Apr 29, 2024, 3:39:03 AM4/29/24
to Abot Web Crawler
Please share me .net core repo.

Thanks & Regards
Alok

Reply all
Reply to author
Forward
0 new messages