Reminder: Utah Python March 2015 Meeting TOMORROW @ 7pm!

19 views
Skip to first unread message

Clint Savage

unread,
Mar 11, 2015, 2:11:25 PM3/11/15
to Utah Python List
See you all tomorrow! Come along and enjoy the ride!

On Thu, Mar 5, 2015 at 10:23 AM, Clint Savage <her...@gmail.com> wrote:
The March 2015 Utah Python Meeting is next Thursday, March 12, 2015!

We're solving a problem again!

Robert Stewart emailed back to my request and suggested some tools around ETL (Extract, Transform and Load). Below, we are presenting a possible problem and are looking for solutions around this concept.

Data and Python
=====================

A small training program wants to improve its curriculum. It supplies
comma separated value [csv] dumps from the spreadsheets it currently
uses to track its program. The task?

1. Get the data in these csv files into a relational database.
2. Automate the process.
3. Update the process as the source and target schema change.
4. Update the process without causing the automated piece to malfunction.

Questions to discuss:

- What's the best way to manage schema changes?
- How should inserts and updates be handled?
- How should the loading process be automated and monitored for errors?
- How should the data be normalized?
- What tool set is best for handling this kind of problem?

What's your solution?

Although the focus is on Python I'm open to good solutions from any
technology.

-- Where --

Needle.com
14864 S. Pony Express Road
Bluffdale, Utah 84065
Map: http://goo.gl/maps/EEhw9

-- When --

Thursday, March 12, 2014 @ 7pm

Cheers,

herlo

Reply all
Reply to author
Forward
0 new messages