New library for HTTP Request making released for Robot Framework to Maven Central

[Hi-Fi]

There has been couple possibilities to test HTTP requests using Python based libraries (e.g. Requests and HttpLibrary). 

To make testing of HTTP requests easier also in Java environment and with Gradle/Maven, there's new library which utilizes Apache HTTPclient and is available at Maven Central.

Source code of the library at: https://github.com/Hi-Fi/robotframework-httprequestlibrary

Binaries at Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ca%3A%22robotframework-httprequestlibrary%22 (current release 0.0.2.).

In keyword sense library is almost same than Requests, so change of library would be quite easy if that's needed.

Current documentation about keywords can be found at: https://repo1.maven.org/maven2/com/github/hi-fi/robotframework-httprequestlibrary/0.0.2/robotframework-httprequestlibrary-0.0.2.html

Release 1.x.x is pending for Proxy support, timeout setting and also some testing in real projects to see if there's glitches.

[David]

I think you should mention the maven link on the GH readme, maybe even embed (into the readme) the mvn details to add to pom.xml so that those who don't want to clone and compile manually can just add to their mvn project, or directly download the binaries.

[Hi-Fi]

Will do that, thank you for comment.

[Marat Kalibekov]

--


You received this message because you are subscribed to the Google Groups "robotframework-users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to robotframework-u...@googlegroups.com.


To post to this group, send email to robotframe...@googlegroups.com.


Visit this group at https://groups.google.com/group/robotframework-users.


For more options, visit https://groups.google.com/d/optout.

[toukopouko]

Hi,

Tried to take this library in to use. Added it to pom.xml but when defining the library like:

Library HttpRequestLibrary

I'm getting error:

Getting keyword names from library 'HttpRequestLibrary' failed: Calling dynamic method 'getKeywordNames' failed: NoClassDefFoundError: com/google/gson/JsonSyntaxException

Any idea whats wrong?

[Hi-Fi]

Hi,

Which version you used, and did you had something else in pom.xml, too?

[toukopouko]

On Wednesday, 27 September 2017 07:23:18 UTC+3, Hi-Fi wrote:

Hi,

Which version you used, and did you had something else in pom.xml, too?

Returned back to this and tried this again, this time there was no such problem and could not reproduce the problem. However, I encountered an new problem. If a post request contains  any special characters like "ä" in data part, they will not be encoded properly. They will go to the webservice as � -characters.

This character problem did not occur with python based requests library (https://github.com/bulkan/robotframework-requests) which was used before switching to this.

Any ideas?

[Hi-Fi]

I have to check this, currently tests have included only 'boring' ASCII characters. Although I thought it would be UTF8 through the codebase.

Some things that come to mind (just guesses without code check):
- test case file encoding
- server side encoding (If not told explicitly in headers)

[toukopouko]

Re-tested that with old python library there is no problem, only with this new library. Another post request with json format data which has "ä' letter is getting response:

JBWEB000065: HTTP Status 400 - org.codehaus.jackson.JsonParseException: Invalid UTF-8 middle byte 0x6b

[Hi-Fi]

Issue at Github: https://github.com/Hi-Fi/robotframework-httprequestlibrary/issues/35

Normal post at least goes as should, and following test case passes:
Post Requests
    Create Session  httpbin  http://httpbin.org
    &{data}=  Create Dictionary  name=bulkan  surname=evcimen    utf-text=ääkköstesti
    &{headers}=  Create Dictionary  Content-Type=application/x-www-form-urlencoded
    ${resp}=  Post Request  httpbin  /post  data=${data}  headers=${headers}
    Log  ${resp.json}
    Dictionary Should Contain Value  ${resp.json['form']}  bulkan
    Dictionary Should Contain Value  ${resp.json['form']}  evcimen
    Dictionary Should Contain Value  ${resp.json['form']}  ääkköstesti

Can you share the test case/similar test case that shows the error? It might be, that Apache HTTPclient doesn't add by default e.g. some encoding header, which is added by Python's requests -library.

Br,

Juho 

[Hi-Fi]

By default headers seems to be (relevant part):

Accept-Encoding	gzip,deflate
User-Agent	Apache-HttpClient/4.5.2 (Java/1.8.0_144)
Content-Type	text/plain; charset=ISO-8859-1
Connection	Keep-Alive

With Python requests library:

Accept-Encoding	gzip, deflate
User-Agent	python-requests/2.18.4
Connection	keep-alive
Accept	*/*

 Still both show the scandic letters correctly in the SoapUI mock. Maybe server you're using get's confused with that default content type setting? 

Br,
Juho

[toukopouko]

Hi,

In my cases I have a textfile with a string in json format in it and pass that text into ${data}, no the data part is not a dictionary. But for example, I think the fault can be seen with a case like this.

    Create Session  httpbin  http://httpbin.org

    ${data}=  Set Variable  ääkköstekstiä on tässä

    &{headers}=  Create Dictionary Content-Type=application/json

    ${resp}=  Post Request  httpbin  /post  data=${data}  headers=${headers}

    Log ${resp.json}

    Log ${resp.content}

[toukopouko]

When the same case is ran with python library, the message is unicode encoded:

KEYWORD ${resp} = RequestsLibrary . Post Request httpbin, /post, data=${data}, headers=${headers}

Documentation:	Send a POST request on the session object found using the
Start / End / Elapsed:	20171030 14:42:27.319 / 20171030 14:42:28.971 / 00:00:01.652

14:42:27.379

INFO

Starting new HTTP connection (1): httpbin.org

14:42:28.935

DEBUG

"POST /post HTTP/1.1" 200 512

14:42:28.962

DEBUG

post response: { "args": {}, "data": "\"\\u00e4\\u00e4kk\\u00f6steksti\\u00e4 on t\\u00e4ss\\u00e4\"", "files": {}, "form": {}, "headers": { "Accept": "*/*", "Accept-Encoding": "gzip, deflate", "Connection": "close", "Content-Length": "54", "Content-Type": "application/json", "Host": "httpbin.org", "User-Agent": "python-requests/2.10.0" }, "json": "\u00e4\u00e4kk\u00f6steksti\u00e4 on t\u00e4ss\u00e4", "origin": "131.207.242.5", "url": "http://httpbin.org/post" }

14:42:28.965

INFO

Post Request using : alias=httpbin, uri=/post, data="\u00e4\u00e4kk\u00f6steksti\u00e4 on t\u00e4ss\u00e4", headers={u'Content-Type': u'application/json'}, files=None, allow_redirects=True

[Hi-Fi]

Thank you, I encoded only FormEntity (Dictionary data) but not StringEntity ("raw" data) to UTF8. This is now fixed, and new version 0.0.9 will be released as soon as httpclient new version (0.0.4) is available at Maven central.

Br,
Juho

[toukopouko]

Excellent, thanks!

[toukopouko]

We are using this library and getting a lot of following logs to console:

...

*DEBUG* Connection manager is shutting down

*DEBUG* Connection manager shut down

*DEBUG* Connection manager is shutting down

*DEBUG* Connection manager shut down

*DEBUG* Connection manager is shutting down

...

How can we disable these logs?

[Hi-Fi]

Currently I think only way is not to use DEBUG logging, as that logging goes also to httpclient (which creates those lines).

Main issue is, that those connection managers messages bypass somehow the normal way to log to Robot's own log file, and lets those pass to STDOUT instead. 

[toukopouko]

Hi,

We are using rf maven plugin 1.4.7 and it does NOT have any effect if I define the logLevel to INFO or anything else in pom.xml, we still get those lines to console.

[Hi-Fi]

RF maven plugin doesn't affect here. 

Have you created the session with debug enabled in script? As (I think) only way to get that logging is to create session with debug enabled (code: https://github.com/Hi-Fi/robotframework-httprequestlibrary/blob/master/src/main/java/com/github/hi_fi/httprequestlibrary/keywords/Session.java#L44) which then will create the actual logger at client (code: https://github.com/Hi-Fi/httpclient/blob/master/src/main/java/com/github/hi_fi/httpclient/RestClient.java#L96).

Also, if there's issues with library, please create issue to Github. This is not the issue tracker and especially this thread started from first version of the library is not suitable for Q&A.