[Darwin-Core-Engine] GitHub push

[GitHub]

The following commits were just pushed:

Fixes #1 by adding source_id command line option
https://github.com/VertNet/Darwin-Core-Engine/commit/65e3a77472699fde5cfe9121092379515c604b8e
Aaron Steele (author)
2011-08-26T11:43:57-07:00

[GitHub]

The following commits were just pushed:

Add support for reading unicode CSV files
https://github.com/VertNet/Darwin-Core-Engine/commit/69618fbe7a36875cb09cb2ad158c8c0b376b0ab3
Aaron Steele (author)
2011-08-26T13:43:23-07:00

[GitHub]

The following commits were just pushed:

Fixes #47 (unicode support for report.csv)
https://github.com/VertNet/Darwin-Core-Engine/commit/9f230232f853405a8fe2290c3b4b4036edebfdf1
Aaron Steele (author)
2011-08-26T19:28:16-07:00

[GitHub]

The following commits were just pushed:

Unicode hackfest
https://github.com/VertNet/Darwin-Core-Engine/commit/b5619e8545adfb0ef23be1ef072cecc7f41dec26
Aaron Steele (author)
2011-08-26T22:30:00-07:00

Bug fix (encode rechash as unicode)
https://github.com/VertNet/Darwin-Core-Engine/commit/313322827ffd8a4752085081a9aee8d491f15505
Aaron Steele (author)
2011-08-26T22:46:03-07:00

[GitHub]

The following commits were just pushed:

Adding useful test csv data files to demonstrate different types of changes.
https://github.com/VertNet/Darwin-Core-Engine/commit/aa894f728038342da9470467e5d2cdf265e3ba32
John Wieczorek (author)
2011-08-27T16:43:06-07:00

[GitHub]

The following commits were just pushed:

Fixed bug where exceptions were swallowed.
https://github.com/VertNet/Darwin-Core-Engine/commit/27f8b0fcd449bc619fd4d6d78b58214eb7b7045d
Aaron Steele (author)
2011-08-29T10:53:25-07:00

Merge branch 'master' of github.com:VertNet/Darwin-Core-Engine
https://github.com/VertNet/Darwin-Core-Engine/commit/f023f49de4896aae5c2fc43219dfdb9f80505893
Aaron Steele (author)
2011-08-29T10:53:30-07:00

[GitHub]

The following commits were just pushed:

Cleanup and better exception handling
https://github.com/VertNet/Darwin-Core-Engine/commit/30791cc3735d0ffd7dcc160da90cea03d0abc4d4
Aaron Steele (author)
2011-08-29T13:32:19-07:00

[GitHub]

The following commits were just pushed:

Modularize dce.py
https://github.com/VertNet/Darwin-Core-Engine/commit/dfaa4adde216cbcb654b6aad30ef35256a5ac04c
Aaron Steele (author)
2011-08-29T19:34:12-07:00

[GitHub]

The following commits were just pushed:

Fixes #46 (published state for records)

Setting record state (cache.recstate) to published in the sqlite3 database
required looking at the progress sqlite3 databases generated by the App
Engine bulkloader tool for both the Record and RecordIndex. These databases
have a state column that equals 2 if the row in the CSV file was bulkloaded
successfully.

The magic happens in bulkload.py where a generator steps through each
line in report.csv, grabs the corresponding rows from the progress
databases,
then yields the (reckey, state) 2-tuples. State is set to published but is
changed to error if state column in the progress database rows are not both
equal to 2. The generator is executed with a cache update query to update
recstate for the given reckey.
https://github.com/VertNet/Darwin-Core-Engine/commit/c9549afc4a8d24cf6ca6b8b5ee15e3d92da8d38f
Aaron Steele (author)
2011-08-29T21:20:50-07:00

[GitHub]

The following commits were just pushed:

Code reorg
https://github.com/VertNet/Darwin-Core-Engine/commit/c1ebd7b6189b127872da9974ac072f9cdb334f53
Aaron Steele (author)
2011-09-02T10:04:23-07:00

symlink to ndb
https://github.com/VertNet/Darwin-Core-Engine/commit/6598a571d49c05720786edeb8d562112d26a935d
Aaron Steele (author)
2011-09-02T10:05:05-07:00

[GitHub]

The following commits were just pushed:

Remove test data
https://github.com/VertNet/Darwin-Core-Engine/commit/7b27df5b8e746e89ceab80c4d3e8283f2ad76477
Aaron Steele (author)
2011-09-02T10:32:50-07:00

[GitHub]

The following commits were just pushed:

Fold common code into dce module
https://github.com/VertNet/Darwin-Core-Engine/commit/95e772e64f96014465b5f6410eb48faa6a59101b
Aaron Steele (author)
2011-09-02T11:11:56-07:00

Symlink to mapreduce
https://github.com/VertNet/Darwin-Core-Engine/commit/cf82c8985bd7569279ed282d68d2c5eca0e4a9a7
Aaron Steele (author)
2011-09-02T11:12:26-07:00

[GitHub]

The following commits were just pushed:

Fixes #23 (API caching)
https://github.com/VertNet/Darwin-Core-Engine/commit/a9e5ca60f9cb2de66efe9b515f2349ffc1990da0
Aaron Steele (author)
2011-09-02T16:17:54-07:00

[GitHub]

The following commits were just pushed:

csv file for DwC term data types.
https://github.com/VertNet/Darwin-Core-Engine/commit/67bb76588a2c3594d44527c71eebfa7b567eddef
John Wieczorek (author)
2011-09-02T18:33:31-07:00

[GitHub]

The following commits were just pushed:

Terms lower-cased.
https://github.com/VertNet/Darwin-Core-Engine/commit/5ee44877dd4b16b0b1104dedcdd74db2ea6c85c0
John Wieczorek (author)
2011-09-02T18:45:03-07:00