Data Profiling

[Adrian Mowat]

Hi,

I have about 2.5 Gb of web transaction data (values submitted to forms etc) held as CSV files that my fairly non-technical users want to analyse.  I want to make it easy for them to run basic analytics - averages, distribution of values, percentage nil etc - across all or a subset of the files.  I've seen commercial data profilers do this kind of thing and I think I could knock up something fairly quickly using incanter.  However, I can't help but feel it's a solved problem and I was wondering if anyone here knows of any github projects I could use to get me started? 

Many Thanks

Adrian

[Alex Baranosky]

You could possibly batch import it all into MySQL, and let people SQL query over it.

--
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clo...@googlegroups.com
Note that posts from new members are moderated - please be patient with your first post.
To unsubscribe from this group, send email to
clojure+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups "Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clojure+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Ignacio Thayer]

Doesn't exactly fit the bill, but for doing this type of stuff at the repl, we use babbage.

ignacio

cto/co-founder ReadyForZero.com

[Adrian Mowat]

Hi Alex,

I think I'll do that as a starter for 10, but most of my users don't know SQL so it's only going to get us so far

Cheers

Adrian

You received this message because you are subscribed to a topic in the Google Groups "Clojure" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/clojure/Rygnv5BmEgk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to clojure+u...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 

Adrian Mowat

Tweet: @mowat27

Am I being a bit short?  Here's why: http://emailcharter.org/, http://inboxzero.com/

[Adrian Mowat]

Looks like a great tool.  Thanks for the link

--
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clo...@googlegroups.com
Note that posts from new members are moderated - please be patient with your first post.
To unsubscribe from this group, send email to
clojure+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "Clojure" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/clojure/Rygnv5BmEgk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to clojure+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.