Error importing item data

66 views
Skip to first unread message

Vivek

unread,
Sep 2, 2014, 7:15:50 AM9/2/14
to erpnext-dev...@googlegroups.com
Hi ,

     I have imported around 20,000 items into the system. Now when I try to import more, it just shows uploading and sort of hangs over there. I waited maybe upto 20mins without any response. I was wondering what could be the issue. I run this on a 512 MB ram droplet on digital ocean . does it have anyhting to do with that ?


Rushabh Mehta

unread,
Sep 2, 2014, 8:51:08 AM9/2/14
to erpnext-dev...@googlegroups.com
On 02-Sep-2014, at 4:45 pm, Vivek <v2g...@gmail.com> wrote:

Hi ,

     I have imported around 20,000 items into the system. Now when I try to import more, it just shows uploading and sort of hangs over there. I waited maybe upto 20mins without any response. I was wondering what could be the issue. I run this on a 512 MB ram droplet on digital ocean . does it have anyhting to do with that ?


Try importing fewer items in one sheet. Also check your JS console for any error trace.


--
Note:
 
If you are posting an issue,
 
1. ERPNext is a free and open source software and support is given on this forum by a team (https://frappe.io/webnotes). So please consider donating if you find this forum useful (https://frappe.io/buy). Even a small amount would be helpful.
2. We should be able to replicate it at our end. So please give us as much information as you can. Please see it from the point of view of the person receiving the communication.
3. Paste your code at http://pastebin.com or http://gist.github.com and send only the URL via email
4. For sending images, use http://imgur.com or other similar services. Do not send images as attachments. Links are good. Same goes for any file you are going to send.
 
End of Note
---
You received this message because you are subscribed to the Google Groups "ERPNext Developer Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/52b49a92-ed59-4e66-9d63-cbd4bf4b8d4b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Vivek

unread,
Sep 3, 2014, 7:51:44 AM9/3/14
to erpnext-dev...@googlegroups.com
Hi,

     As of now sets of 20 are working. Anything more shows a JSON.parse error on the console





On Tuesday, September 2, 2014 4:51:08 PM UTC+4, rushabh wrote:
On 02-Sep-2014, at 4:45 pm, Vivek <v2g...@gmail.com> wrote:

Hi ,

     I have imported around 20,000 items into the system. Now when I try to import more, it just shows uploading and sort of hangs over there. I waited maybe upto 20mins without any response. I was wondering what could be the issue. I run this on a 512 MB ram droplet on digital ocean . does it have anyhting to do with that ?


Try importing fewer items in one sheet. Also check your JS console for any error trace.


--
Note:
 
If you are posting an issue,
 
1. ERPNext is a free and open source software and support is given on this forum by a team (https://frappe.io/webnotes). So please consider donating if you find this forum useful (https://frappe.io/buy). Even a small amount would be helpful.
2. We should be able to replicate it at our end. So please give us as much information as you can. Please see it from the point of view of the person receiving the communication.
3. Paste your code at http://pastebin.com or http://gist.github.com and send only the URL via email
4. For sending images, use http://imgur.com or other similar services. Do not send images as attachments. Links are good. Same goes for any file you are going to send.
 
End of Note
---
You received this message because you are subscribed to the Google Groups "ERPNext Developer Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer-forum+unsub...@googlegroups.com.
Message has been deleted

Vivek

unread,
Sep 3, 2014, 8:10:26 AM9/3/14
to erpnext-dev...@googlegroups.com
Failed to load resource: the server responded with a status of 504 (Gateway Time-out) http://salehalsouqi.com/
  1. Uncaught SyntaxError: Unexpected token < frappe.min.js:300
    1. (anonymous function)frappe.min.js:300
    2. k.fireWithjquery.min.js:2
    3. (anonymous function)

Rushabh Mehta

unread,
Sep 3, 2014, 9:02:12 AM9/3/14
to erpnext-dev...@googlegroups.com
Check your server stats, when importing. 

Specially - mysql, run "show processlist" when your import seems stuck.

Difficult to guess why this happens. I don't think it has to do with the Item import.


To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/c321f756-dc3f-4b0a-90ff-b6d6092f7453%40googlegroups.com.

Vivek

unread,
Sep 3, 2014, 9:19:07 AM9/3/14
to erpnext-dev...@googlegroups.com

   As I keep adding more items , the number of items I can import seems to be reducing. I had tried using a larger droplet with 2 CPUs and 2GB ram. Let me try again.

Anand Doshi

unread,
Sep 3, 2014, 10:51:53 AM9/3/14
to ERPNext Developer's Forum
Vivek,

You should also check the output of the "Response" part of request via the network tab of developer console.

-Anand.


To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/dacbb16a-b918-4191-bab6-75de95861208%40googlegroups.com.

Rushabh Mehta

unread,
Sep 3, 2014, 1:02:07 PM9/3/14
to erpnext-dev...@googlegroups.com
On 03-Sep-2014, at 6:49 pm, Vivek <v2g...@gmail.com> wrote:


   As I keep adding more items , the number of items I can import seems to be reducing. I had tried using a larger droplet with 2 CPUs and 2GB ram. Let me try again.


this does not seem to be a scale / size issue. There is something else hurting. Did you check your mysql process list?


To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/dacbb16a-b918-4191-bab6-75de95861208%40googlegroups.com.

Vivek

unread,
Sep 4, 2014, 2:40:35 AM9/4/14
to erpnext-dev...@googlegroups.com

Hi ,

      The network tab of the browser console shows  a 504 gatway error of type text

I am uncertain how to access the mysql console at the terminal because when I hit mysql it takes my to MariaDB console, so havent checked the mysql processlist. How do I get to the mysql console?
To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer-forum+unsub...@googlegroups.com.

Rushabh Mehta

unread,
Sep 4, 2014, 3:01:09 AM9/4/14
to erpnext-dev...@googlegroups.com
On 04-Sep-2014, at 12:10 pm, Vivek <v2g...@gmail.com> wrote:


Hi ,

      The network tab of the browser console shows  a 504 gatway error of type text

I am uncertain how to access the mysql console at the terminal because when I hit mysql it takes my to MariaDB console, so havent checked the mysql processlist. How do I get to the mysql console?

mariadb is a drop in replacement for mysql - so all commands are the same! just run

"show processlist" when this comes up.

To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/eef784f3-625d-4d4f-bfa7-edfb9aaedf2f%40googlegroups.com.

Vivek

unread,
Sep 4, 2014, 3:12:52 AM9/4/14
to erpnext-dev...@googlegroups.com

It returns an empty list , accept for the the query SHOW PROCESSLIST, it returns empty.

Before I started import there was one more line in the table , with the user for the DB and state Sleep

Ones I started import it goes off and just returns SHOW PROCESSLIST as the only query running
To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer-forum+unsub...@googlegroups.com.

Vivek

unread,
Sep 4, 2014, 3:32:47 AM9/4/14
to erpnext-dev...@googlegroups.com

  I have attached a screenshot
Screenshot from 2014-09-04 11:30:50.png

Rushabh Mehta

unread,
Sep 4, 2014, 5:07:45 AM9/4/14
to erpnext-dev...@googlegroups.com
Difficult to guess what is going wrong - if your mysql isn't clogged up, there is something else.

Are you sure your internet connection works. Also try and restart your machine and see if it works.

Can't guess why this might be happening.


To unsubscribe from this group and stop receiving emails from it, send an email to erpnext-developer...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/erpnext-developer-forum/e1b79412-13c0-4e43-aece-d45f2e4e27e9%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.
<Screenshot from 2014-09-04 11:30:50.png>

Pratik Vyas

unread,
Sep 4, 2014, 6:13:24 AM9/4/14
to erpnext-dev...@googlegroups.com
On Thu, Sep 4, 2014 at 12:42 PM, Vivek <v2g...@gmail.com> wrote:
>
> It returns an empty list , accept for the the query SHOW PROCESSLIST, it
> returns empty.
>
> Before I started import there was one more line in the table , with the user
> for the DB and state Sleep
>
> Ones I started import it goes off and just returns SHOW PROCESSLIST as the
> only query running
>
>

Hi Vivek,

Looks like the http request is timing out.

Try the following,
```
bench update --bench
bench config http_timeout 600
bench setup nginx
bench setup supervisor
sudo supervisorctl reload
sudo service nginx restart
```

Thanks,
--
Pratik
ERPNext

Vivek

unread,
Sep 5, 2014, 6:25:14 AM9/5/14
to erpnext-dev...@googlegroups.com

Hi,

     This seemed to have helped a bit. Now I think I am pretty convinced its got something to do with the network. I am going to try this on another droplet in a different region. Doubt it could be something to do with my internal home / office network
Reply all
Reply to author
Forward
0 new messages