Importing data: I'm not typing in more than 4 observations and 3 variables... (12 numbers)

14 views
Skip to first unread message

A.J. Rossini

unread,
Oct 28, 2012, 3:29:55 AM10/28/12
to lisp...@googlegroups.com
Dear all -

Importing data is IMPORTANT.

In response to Fare's prodding on my gplus post, I'm going to take a slight detour this week on CSV and DSV file imports, basically to (1 or more) CL arrays (we should be able to get data from CL arrays to any other structure, so it's a start.

Comments, links to systems or blog posts, welcome here.  I'll slowly dump them into an appropriate place in the CLS documentation, but this is an appropriate storage place.

best,
-tony

David Hodge

unread,
Oct 28, 2012, 8:25:41 AM10/28/12
to lisp...@googlegroups.com
I absolutely agree.

And its not just CSV, but also record structured data with funny legacy formats 

This is a big problem everyone and not something we can hope to solve comprehensively, but we can at least provide some basic tools in a decent framework.

I've used Alain Picards CSV parser in the past and found it useful for CSV, but I think there are quite a few of those around.

Whats equally as interesting is the record structured data - which for me is where I seem to spend more time than i like in doing what should be simple things.

And, of course, SQL. But that can be far off into the future I think - but is an important thing to consider for a generic framework.





--
You received this message because you are subscribed to the Google Groups "Common Lisp Statistics" group.
To post to this group, send email to lisp...@googlegroups.com.
To unsubscribe from this group, send email to lisp-stat+...@googlegroups.com.
Visit this group at http://groups.google.com/group/lisp-stat?hl=en.
 
 

Mirko Vukovic

unread,
Oct 28, 2012, 1:09:18 PM10/28/12
to lisp...@googlegroups.com

You can see my stab at reading files (including CSV) here: https://github.com/mirkov/mv-grid-utils/blob/master/grid-io/grid-io.lisp.  You will note that I tried to follow CL's eof-error-p, eof-value convention, but I had to specify them as keywords.
 

This may give you ideas for what to do and not to do.

I use picard's csv parser.  This was a while ago, but I think I may have modified it slightly.

Mirko
Reply all
Reply to author
Forward
0 new messages