django-excel

11 views
Skip to first unread message

Keyton Weissinger

unread,
Jun 28, 2009, 8:04:47 PM6/28/09
to django-batchimport-users
Hello all....

I wanted to reach out to all five (!!) of you. ;-) Richard and I have
been working on a total overhaul of django-batchimport called,
cleverly enough, django-excel. It has all the same features as django-
batchimport but is (1) faster (by a lot), (2) easier to use, (3) less
invasive to your code and (4) allows a full cycle of pulling data out
as excel, manipulating it in excel, and then reimporting it into
django (as uploaded excel file).

I'm just about ready to release some code. Anyone interested in doing
some testing let me know.

Thanks.
Keyton

Michael Koiter

unread,
Jun 29, 2009, 4:38:13 AM6/29/09
to django-batch...@googlegroups.com
Hi Keyton,

I have spent some time in Django (still not an expert by far....) and
currently studying on Python (starting tutorial - think like a computer
scientist..). I succeeded in running batchimport on a local ubuntu laptop
with django 1.xx, apache and postgres. I am interested in testing, however I
don't know if I can be of any assistance (because lack of programming
skills). I don't know if it's possible but it would be great if the program
also could also import CSV files....

Best regards,

Michael.

Folderplaats.nl BV
www.folderplaats.nl - gemakkelijk winkelaanbiedingen bekijken
www.folderinfo.nl - ontwikkelen van online folders en meer

tel: 0318 - 437475
http://www.linkedin.com/in/folderplaats
skype: michael.koiter.folderplaats

-----Oorspronkelijk bericht-----
Van: django-batch...@googlegroups.com
[mailto:django-batch...@googlegroups.com] Namens Keyton Weissinger
Verzonden: maandag 29 juni 2009 2:05
Aan: django-batchimport-users
Onderwerp: django-excel

Keyton Weissinger

unread,
Jul 2, 2009, 9:43:28 AM7/2/09
to django-batch...@googlegroups.com
Hi Michael,

Sorry it took a bit to get back to you. I agree with you re: CSV. The problem is that it's a completely different technology/library on the back end. I've been looking at it a little but so far it's usually easier to write a python script custom to your data. Still thinking on it though.

What kind of data and what kinds of volumes are you using in importing data into django? What does your company do?

Keyton

Michael Koiter

unread,
Jul 2, 2009, 3:30:15 PM7/2/09
to django-batch...@googlegroups.com

Hi Keyton,

 

No problem. I own a small internet company Holland.

 

1.       We are developing internet solutions for the retailbranche (focus on online catalogues).

2.       We own a site called folderplaats.nl – on this site we present the online catalogue / special offers of well known dutch retailers. Consumers can look into it.

(it’s just a simple site developed in Django with links to retail sites)

3.       We want to develop a shopping site. On this site we want to publish the assortments of the bigger retailers/webshops in Holland. People can look, add products to a favorite list and order directly if they want to. We want to load the productfeeds into our Postgres database. Several retailers can deliver the Excel format but the most are only able to deliver CSV / XML. Productrange is from 100 to 50.000 products (average is 1.000 or 2.000). I have setup a testsite local on my laptop with your batch import. I prefer to start with CSV / XML import as well, so I am studying on Python so I understand the code and maybe write my own program.

 

Best regards,

 

Michael.

 

Folderplaats.nl BV

www.folderplaats.nl - gemakkelijk winkelaanbiedingen bekijken

www.folderinfo.nl - ontwikkelen van online folders en meer

 

tel: 0318 - 437475

http://www.linkedin.com/in/folderplaats

skype: michael.koiter.folderplaats

 

Richard House

unread,
Jul 2, 2009, 4:25:22 PM7/2/09
to django-batch...@googlegroups.com
Hi Michael,
With one of my business apps, I am importing ~100,000 rows of CSV data
into a Django reporting tool every two weeks. It has been through
several iterations to cope with variable field ordering and unicode. I
am working with Keyton on the excel side of things, but I think it
would be possible to include CSV as an import option without too much
difficulty, though it would take some time as Python coding is not my
day job.

Regards,
Richard

Michael Koiter

unread,
Jul 6, 2009, 4:04:08 PM7/6/09
to django-batch...@googlegroups.com
Hi Richard,

Sorry for the late response but that sounds just great. I cannot be of any
assistance at the moment because I am studying Python at the moment. May be
in the future.... But It would be great if you guys could combine Excel and
CSV in one batch import program (or offer a CSV batchimport in a separate
program).

Best regards,

Michael.

Folderplaats.nl BV
www.folderplaats.nl - gemakkelijk winkelaanbiedingen bekijken
www.folderinfo.nl - ontwikkelen van online folders en meer

tel: 0318 - 437475
http://www.linkedin.com/in/folderplaats
skype: michael.koiter.folderplaats


-----Oorspronkelijk bericht-----
Van: django-batch...@googlegroups.com
[mailto:django-batch...@googlegroups.com] Namens Richard House
Verzonden: donderdag 2 juli 2009 22:25
Aan: django-batch...@googlegroups.com
Onderwerp: Re: django-excel


Hi Michael,
With one of my business apps, I am importing ~100,000 rows of CSV data
into a Django reporting tool every two weeks. It has been through
several iterations to cope with variable field ordering and unicode. I
am working with Keyton on the excel side of things, but I think it
would be possible to include CSV as an import option without too much
difficulty, though it would take some time as Python coding is not my
day job.

Regards,
Richard

On 2 Jul 09, at 20:30, Michael Koiter wrote:

> Hi Keyton,
>
> No problem. I own a small internet company Holland.
>
> 1. We are developing internet solutions for the retailbranche
> (focus on online catalogues).
> 2. We own a site called folderplaats.nl - on this site we
Reply all
Reply to author
Forward
0 new messages