Failed to publish commerce data for course to LMS

[Mark Davies Tan]

Hi all,

I recently got the ecommerce setup and I tried changing a course to paid just to test things out but when I tried to save it gave me this error

Failed to publish commerce data for course-v1:Ministry+MLDCNTDYMT+2018_Q3 to LMS.

Does it have anything to do with the COURSE_CATALOG_API_URL in /edx/etc/ecommerce.yml? Or does it have something to do with discovery_api_url when I run the create_or_update_site?

Thanks.

[Trinh Nguyen]

Hi,

It's nothing to do with e-commerce publish data to LMS. It just means that there's something wrong with the communication pipe between the two.

What do the logs say?

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

--
You received this message because you are subscribed to the Google Groups "General Open edX discussion" group.
To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/95169020-f81a-4049-acc8-a7151373e168%40googlegroups.com.

[Mark Davies Tan]

Hi Trinh,

I checked the ecommerce log and saw this:

• Course seat product with certificate type [] for [course-v1:Ministry+MLDCNTDYMT+2018_Q3] does not exist. Instantiated a new instance.
  
• Course seat product stock record with certificate type [] for [course-v1:Ministry+MLDCNTDYMT+2018_Q3] does not exist. Instantiated a new instance.
  
• Course seat product with certificate type [verified] for [course-v1:Ministry+MLDCNTDYMT+2018_Q3] does not exist. Instantiated a new instance.
  
• Failed to retrieve course catalogs data from the Discovery Service API.
  
• Internal Server Error: /api/v2/enterprise/customers
  

• Failed to publish commerce data for [course-v1:Ministry+MLDCNTDYMT+2018_Q3] to LMS.
  

• Failed to save and publish [course-v1:Ministry+MLDCNTDYMT+2018_Q3]: [Failed to publish commerce data for course-v1:Ministry+MLDCNTDYMT+2018_Q3 to LMS.]
  

Also I noticed when I ran supervisorclt status that I dont have ecomworker. Is it because of that?

[Trinh Nguyen]

Must be some misconfiguration of enterprise customer or something because " Internal Server Error: /api/v2/enterprise/customers"

"Failed to retrieve course catalogs data from the Discovery Service API." => this is just used for querying some course info in ecommerce checkout page.

I'm running e-commerce without worker and can create the course in e-commerce.

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/de2534e3-5a6d-43ca-a654-9f9fe6f585a4%40googlegroups.com.

[Mark Davies Tan]

Ok, that's good to know about the ecomworker not being required. 

So it's also not the discovery service api then. 

I checked the lms logs and saw this 

• Internal Server Error: /oauth2/access_token
  
• ValueError: Cannot assign None: "AccessToken.user" does not allow null values.
  

[Trinh Nguyen]

Ok, you need to attach a staff user to your e-commerce oauth2 client even though the documentation says to leave that field blank.

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/5bfafd7a-71a5-4df3-8870-bea7fe645f65%40googlegroups.com.

[Mark Davies Tan]

Ok, set a staff user to the oauth2 client. 
Gave it another try and now I got this 

Error! Failed to publish commerce data for course-v1:Ministry+MLDCNTDYMT+2018_Q3 to LMS. Authentication credentials were not provided.

[Trinh Nguyen]

I encountered this issue before. If you run the Microsoft folk of Open edX, you need to folk e-commerce around the same time of your Open edX branch.

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/3ba99179-db47-4189-a4db-a7f5abdfcebb%40googlegroups.com.

[Mark Davies Tan]

Hmm, I actually ran the ecommerce that was in the configuration fork of MS's open edx the same time we got the fork of MS open edx so I think the fork should be fine?

[Trinh Nguyen]

I'm not sure. Do you have any more logs?

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/c5a50500-eee2-4716-8141-76161ae30053%40googlegroups.com.

[Mark Davies Tan]

so far I tried a different course so for ecommerce log:

• Not Found: /api/v2/courses/course-v1:Education+DAT203.1x+2018_T1/
  
• Not Found: /api/commerce/v1/courses/course-v1:Education+DAT203.1x+2018_T1/
  

[Trinh Nguyen]

The correct course ID is: course-v1:Education+DAT203.1x+2018_T1

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/3f374034-bbdd-426f-86d7-d7083299d017%40googlegroups.com.

[Mark Davies Tan]

Yeah that's what I tried

[Trinh Nguyen]

I don't understand where did you try that? Did you mean you can enter the E-commerce Course Administrator page? At which step you got that error? Please help me to understand.

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/e8f94da4-dbd8-4773-b737-b4b0573519a0%40googlegroups.com.

[Mark Davies Tan]

Yes i can enter the Ecommerce Course Administration page and there I click Add New Course, place the course ID and course name there and chose Free as course type with no honor seat.

I didnt change any ecommerce related things in cms.env.json so I noticed that the ECOMMERCE_API_URL and ECOMMERCE_PUBLIC_URL_ROOT are still set to the default which was http://localhost:8002/api/v2 and http://localhost:8002 respectively.

Do I need to change them for cms.env.json?

[Trinh Nguyen]

Try that.

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/129cb3f6-43ff-4538-ba6d-8c10b86e9727%40googlegroups.com.

[Mark Davies Tan]

Tried changing ECOMMERCE_API_URL and ECOMMERCE_PUBLIC_URL_ROOT in cms.env.json and still the same issue. 

[Trinh Nguyen]

Did you check all of the key and credentials especially EDX_API_KEY in lms.auth.json and ecommerce.yml should be the same?

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/c6822841-131a-4d07-898c-437ae764591e%40googlegroups.com.

[Mark Davies Tan]

Been double checking them and they all seem to be right.

Like I didnt change EDX_API_KEY so it's still the default PUT_YOUR_API_KEY_HERE but it's also the same on the other file.

Just a thought, what I did to be able to access the ecommerce side is to use the IP of the traffic manager/load balancer from azure, so something like IP address:18130. 

However my lms url is let's say https://myurl.com. I wasnt able to allow access to myurl.com:18130 coz azure's vmss doesnt support NAT rules at the moment it seems.

Do you think using IP:18130 is causing the problem? I can login to the admin side of ecommerce though.

[Trinh Nguyen]

So, try to use a sub domain for your e-commerce, something like https://ecom.myurl.com (need to configure nginx to run ecommerce at port 443)

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/ebb6364b-e01a-4b5d-b1c3-ca0f70cdd0eb%40googlegroups.com.

[Mark Davies Tan]

So I tried giving my ecommerce a subdomain and it's still giving me the authentication credentials were not provided error.
Let's say my LMS url is https://lms-master.company.com, the ecommerce url is https://ecom-lms.company.com. Nothing wrong with that right?

[Trinh Nguyen]

Can you give me all the logs and your configuration file?

Trinh Nguyen | Founder

E: dangt...@gmail.com | W: www.edlab.xyz

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/02a2d452-6caf-49a6-8d8e-10b7deffde32%40googlegroups.com.

[Mark Davies Tan]

Hmm I'm wondering if all the courses being in child sites have anything to do with the issue? 

I got a 404 on this https://ecom-myurl.com/api/v2/courses/course-v1:Business+BLDENLDGLD+2018_Q3

[Mark Davies Tan]

I tried creating 2 courses in the Course Administration Tool.

Ecommerce log:

Jul  2 21:10:55 EPTECLAASvmss000000 [service_variant=ecommerce][ecommerce.courses.publishers] ERROR [EPTECLAASvmss000000  50415] [/edx/app/ecommerce/ecommerce/ecommerce/courses/publishers.py:112] - Failed to publish commerce data for [course-v1:Business+BLDENLDGLD+2018_Q3] to LMS.

Traceback (most recent call last):

  File "/edx/app/ecommerce/ecommerce/ecommerce/courses/publishers.py", line 101, in publish

    commerce_api_client.courses(course_id).put(data=data)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/slumber/__init__.py", line 175, in put

    resp = self._request("PUT", data=data, files=files, params=kwargs)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/slumber/__init__.py", line 97, in _request

    resp = self._store["session"].request(method, url, data=data, params=params, files=files, headers=headers)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/requests/sessions.py", line 502, in request

    resp = self.send(prep, **send_kwargs)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/requests/sessions.py", line 612, in send

    r = adapter.send(request, **kwargs)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/requests/adapters.py", line 490, in send

    raise ConnectionError(err, request=request)

ConnectionError: ('Connection aborted.', error("(110, 'ETIMEDOUT')",))

Jul  2 21:10:55 EPTECLAASvmss000000 [service_variant=ecommerce][ecommerce.extensions.api.serializers] ERROR [EPTECLAASvmss000000  50415] [/edx/app/ecommerce/ecommerce/ecommerce/extensions/api/serializers.py:497] - Failed to save and publish [course-v1:Business+BLDENLDGLD+2018_Q3]: [Failed to publish commerce data for course-v1:Business+BLDENLDGLD+2018_Q3 to LMS.]

Traceback (most recent call last):

  File "/edx/app/ecommerce/ecommerce/ecommerce/extensions/api/serializers.py", line 494, in save

    raise Exception(resp_message)

Exception: Failed to publish commerce data for course-v1:Business+BLDENLDGLD+2018_Q3 to LMS.

Jul  2 21:55:21 EPTECLAASvmss000000 [service_variant=ecommerce][ecommerce.courses.publishers] ERROR [EPTECLAASvmss000000  50416] [/edx/app/ecommerce/ecommerce/ecommerce/courses/publishers.py:108] - Failed to publish commerce data for [course-v1:Ministry+MLDCNTDYMT+2018_Q3] to LMS. Status was [401]. Body was [{"detail":"Authentication credentials were not provided."}].

Traceback (most recent call last):

  File "/edx/app/ecommerce/ecommerce/ecommerce/courses/publishers.py", line 101, in publish

    commerce_api_client.courses(course_id).put(data=data)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/slumber/__init__.py", line 175, in put

    resp = self._request("PUT", data=data, files=files, params=kwargs)

  File "/edx/app/ecommerce/venvs/ecommerce/local/lib/python2.7/site-packages/slumber/__init__.py", line 101, in _request

    raise exception_class("Client Error %s: %s" % (resp.status_code, url), response=resp, content=resp.content)

HttpClientError: Client Error 401: https://epacademy-master.cloudswyft.com/api/commerce/v1/courses/course-v1:Ministry+MLDCNTDYMT+2018_Q3/

Jul  2 21:55:21 EPTECLAASvmss000000 [service_variant=ecommerce][ecommerce.extensions.api.serializers] ERROR [EPTECLAASvmss000000  50416] [/edx/app/ecommerce/ecommerce/ecommerce/extensions/api/serializers.py:497] - Failed to save and publish [course-v1:Ministry+MLDCNTDYMT+2018_Q3]: [Failed to publish commerce data for course-v1:Ministry+MLDCNTDYMT+2018_Q3 to LMS. Authentication credentials were not provided.]

Traceback (most recent call last):

  File "/edx/app/ecommerce/ecommerce/ecommerce/extensions/api/serializers.py", line 494, in save

    raise Exception(resp_message)

Exception: Failed to publish commerce data for course-v1:Ministry+MLDCNTDYMT+2018_Q3 to LMS. Authentication credentials were not provided.

[Mark Davies Tan]

I also checked the last commits of the openedx and ecommerce that i'm using.

Seems to be the openedx is around Nov 30 2017 meanwhile the ecommerce is from June 14, 2016.