Google Groups

What's new in edge: mysql streaming mode

Thibaut Barrère Mar 13, 2012 1:13 PM
Posted in group: ActiveWarehouse Discuss

if some of you are using a database source with mysql, be sure to read about ":mysqlstream => true" in the doc:

The mysql streamer uses "mysql --quick" command line to handle large datasets in streaming mode (ie: not holding all rows in RAM but yielding them each after another).

This was first contributed 3 months ago by Philip Dodds (thanks!), and Sinisa Grgic and myself added some fixes and tests this week too.

If you use this, let me know how it works for you!

-- Thibaut