ActiveWarehouse Discuss - Google Groups

1–30 of 139

ActiveWarehouse discussion group - see http://www.activewarehouse.info for latest releases.

How to get started:

- read the manual (albeit it's not up to date - patches welcome!)

- read the rdoc (especially processor/transform - patches welcome too!)

- clone, run and dive into the activewarehouse-etl-sample

- read the source code (this is where you'll learn the most)

- leave questions here when you're stuck! (please do - we love to know when something is broken or not obvious)

Recommended books:

- aw-etl is based on the principles described in the Datawarehouse ETL Toolkit

- if you want to create a datawarehouse, read the Datawarehouse Toolkit

0 selected

Thibaut Barrère, … stellard15

06/04/2012

Brainstorming: documentation, getting started more easily etc

Hi Scott! > Just saw this the other day and thought it might intrest you > https://github.com/

unread,

Brainstorming: documentation, getting started more easily etc

Hi Scott! > Just saw this the other day and thought it might intrest you > https://github.com/

06/04/2012

Thibaut Barrère, … Chris Roberts7

01/04/2012

Call for contributions: what do you want in the guides?

Hi folks, quick reply before going to bed: first thanks for your replies :) Giovanni: my first idea

unread,

Call for contributions: what do you want in the guides?

Hi folks, quick reply before going to bed: first thanks for your replies :) Giovanni: my first idea

01/04/2012

amit kolariya

20/04/2015

resolve_hash_connection': database configuration does not specify adapter (ActiveRecord::AdapterNotSpecified)

When i am trying to run the activewarehouse-etl and i am getting the error bundle exec etl etl/

unread,

resolve_hash_connection': database configuration does not specify adapter (ActiveRecord::AdapterNotSpecified)

When i am trying to run the activewarehouse-etl and i am getting the error bundle exec etl etl/

20/04/2015

amit kolariya

20/04/2015

`resolve_hash_connection': database configuration does not specify adapter (ActiveRecord::AdapterNotSpecified)

Hi, I am using gem 'activewarehouse-etl', '1.0.0' gem , but on running .ctl file the

unread,

`resolve_hash_connection': database configuration does not specify adapter (ActiveRecord::AdapterNotSpecified)

Hi, I am using gem 'activewarehouse-etl', '1.0.0' gem , but on running .ctl file the

20/04/2015

Thibaut Barrère, Fabio Mendes4

14/08/2014

Maintainer wanted for ActiveWarehouse-ETL!

I would like to contribute to this project. I like where you guys are going with it. However, from

unread,

Maintainer wanted for ActiveWarehouse-ETL!

I would like to contribute to this project. I like where you guys are going with it. However, from

14/08/2014

Yves-Eric Martin, Thibaut Barrère7

10/07/2014

Timezone for :new_records_only

Thank you :-) -- Thibaut

unread,

Timezone for :new_records_only

Thank you :-) -- Thibaut

10/07/2014

Alejandro Carmona

03/04/2014

RDoc is not working at this moment.

I was trying to check the RDoc for the activewarehouse-etl but at this moment is not available. Last

unread,

RDoc is not working at this moment.

I was trying to check the RDoc for the activewarehouse-etl but at this moment is not available. Last

03/04/2014

Paul nop

04/10/2013

undefined_method 'postgresql_connection'

Hi. I`m trying to run activewarehouse-etl and i`m getting error: Starting ETL process initializing

unread,

undefined_method 'postgresql_connection'

Hi. I`m trying to run activewarehouse-etl and i`m getting error: Starting ETL process initializing

04/10/2013

Oren Mazor, … Oren Mazor3

13/04/2013

multithread ETL

Hey Raimonds, Small world! we used your mondrian-olap library for a while, but then had to step away

unread,

multithread ETL

Hey Raimonds, Small world! we used your mondrian-olap library for a while, but then had to step away

13/04/2013

Justin MacCarthy, Thibaut Barrère2

12/04/2013

Using Activewarehouse-etl on a rails 2 project

Hello Justin! based on what is seen here: - https://rubygems.org/gems/activewarehouse-etl - https://

unread,

Using Activewarehouse-etl on a rails 2 project

Hello Justin! based on what is seen here: - https://rubygems.org/gems/activewarehouse-etl - https://

12/04/2013

Anthony Eden

28/03/2013

Fwd: Mysql2 pull request for rails_sql_views

All, I received this yesterday. Useful? If so then could someone merge it into activewarehouse/

unread,

Fwd: Mysql2 pull request for rails_sql_views

All, I received this yesterday. Useful? If so then could someone merge it into activewarehouse/

28/03/2013

sk, … Thibaut Barrère16

06/02/2013

how to use etl in delayed_job

Hi Oren! thanks for sharing! On threading: I didn't check, but thread-safety is very unlikely;

unread,

how to use etl in delayed_job

Hi Oren! thanks for sharing! On threading: I didn't check, but thread-safety is very unlikely;

06/02/2013

Oren Mazor, Thibaut Barrère3

16/01/2013

testing ETL tasks

Hey Thibaut, I've set up some simple rspec tests that go something like: - load known fixtures

unread,

testing ETL tasks

Hey Thibaut, I've set up some simple rspec tests that go something like: - load known fixtures

16/01/2013

Chris Roberts, … Thibaut Barrère6

09/01/2013

Re: Rails 3 NameError (uninitialized constant ETL::Engine)

> Although I'm not sure yet if i get the full use of the rails environment in my control files

unread,

Re: Rails 3 NameError (uninitialized constant ETL::Engine)

> Although I'm not sure yet if i get the full use of the rails environment in my control files

09/01/2013

Henry Molina, Thibaut Barrère2

21/12/2012

Destination file name based in field content

Hello Henry, Is there a way to set the destination "variable"? destination :out, { :file =

unread,

Destination file name based in field content

Hello Henry, Is there a way to set the destination "variable"? destination :out, { :file =

21/12/2012

Oren Mazor

07/12/2012

multi-tenancy with ETL

hey all, I've gotten my data importing quite nicely now and its working great. I'd like to

unread,

multi-tenancy with ETL

hey all, I've gotten my data importing quite nicely now and its working great. I'd like to

07/12/2012

Thibaut Barrère, Andrew Kuklewicz3

04/12/2012

Considering deprecations: what do you think?

Hi Andrew! I'll start with "mysql2" and AR 3+ then, to wait a bit for 1.9.3 :-) Thanks

unread,

Considering deprecations: what do you think?

Hi Andrew! I'll start with "mysql2" and AR 3+ then, to wait a bit for 1.9.3 :-) Thanks

04/12/2012

Eric Budd, Thibaut Barrère2

29/11/2012

Merging multiple data sources

Hello Eric! Welcome onboard :-) > In my ctl file, I've tried adding two sources. This works,

unread,

Merging multiple data sources

Hello Eric! Welcome onboard :-) > In my ctl file, I've tried adding two sources. This works,

29/11/2012

Emmanuel, Thibaut Barrère7

26/10/2012

Question around SCD

More things to watch out for. If you put a field from the input that is not coming from the database

unread,

Question around SCD

More things to watch out for. If you put a field from the input that is not coming from the database

26/10/2012

Emmanuel, Thibaut Barrère6

18/10/2012

Job dependencies

or Redis Mutex :) But for now same machine. Multiple if perf will struggle on the future ;) On

unread,

Job dependencies

or Redis Mutex :) But for now same machine. Multiple if perf will struggle on the future ;) On

18/10/2012

Emmanuel, … Andrew Kuklewicz13

18/10/2012

Insert/Updates only

I do bulk updates from files -> mysql, and use the insert or replace capability in mysql. http://

unread,

Insert/Updates only

I do bulk updates from files -> mysql, and use the insert or replace capability in mysql. http://

18/10/2012

Henry Molina, Andrew Kuklewicz2

17/10/2012

Problem with ibm db

Can you provide the connection info for the db source that uses the ibm_db in the .ctl file that is

unread,

Problem with ibm db

Can you provide the connection info for the db source that uses the ibm_db in the .ctl file that is

17/10/2012

stellard, Thibaut Barrère4

10/10/2012

Add Single Row to Beginning of pipeline.

> This is perfect. I did not realise you could have multiple sources per control file. Thanks

unread,

Add Single Row to Beginning of pipeline.

> This is perfect. I did not realise you could have multiple sources per control file. Thanks

10/10/2012

Emmanuel, Thibaut Barrère2

08/10/2012

Beginner questions !

Hello Emmanuel, here is what I can say - this is a bit of braindump so beware! 1) does bulk import

unread,

Beginner questions !

Hello Emmanuel, here is what I can say - this is a bit of braindump so beware! 1) does bulk import

08/10/2012

Giovanni Messina, … Thibaut Barrère15

08/10/2012

trouble with bulk_import and postgresql sequences

Hello Jamie, > Could you give me an example of how you did that temp_table manually? > I know

unread,

trouble with bulk_import and postgresql sequences

Hello Jamie, > Could you give me an example of how you did that temp_table manually? > I know

08/10/2012

Jamie van Dyke, Thibaut Barrère4

08/10/2012

Documentation looks stalled

> No problem, you've done a great job with the code, loved your Rulu talk too and that's

unread,

Documentation looks stalled

> No problem, you've done a great job with the code, loved your Rulu talk too and that's

08/10/2012

Jayaram Sudheer, Thibaut Barrère4

02/10/2012

can we write model validations for the data in etl process

yeah if that validation fails then it should raise an error and the process should stopped completely

unread,

can we write model validations for the data in etl process

yeah if that validation fails then it should raise an error and the process should stopped completely

02/10/2012

sk, Thibaut Barrère2

27/09/2012

ETL process file upload

Looks like this one was double-posted. Please see my other answer - and please try not to double post

unread,

ETL process file upload

Looks like this one was double-posted. Please see my other answer - and please try not to double post

27/09/2012

sk, Thibaut Barrère2

27/09/2012

Can anyone help me...

Hello mysterious visitor, But my requirement is to create a view page in that if any user uploading

unread,

Can anyone help me...

Hello mysterious visitor, But my requirement is to create a view page in that if any user uploading

27/09/2012

Jayaram Sudheer, Thibaut Barrère2

27/09/2012

i got the following error when dumping data from database to a file

Hello, the answer is in the guide: search for ":order": https://github.com/gmgp/

unread,

i got the following error when dumping data from database to a file

Hello, the answer is in the guide: search for ":order": https://github.com/gmgp/

27/09/2012

Jayaram Sudheer, Thibaut Barrère4

27/09/2012

encryption of password using tranformations

Hi, Thanks but is n't work for me my code is like this, my field name is password, and the

unread,

encryption of password using tranformations

Hi, Thanks but is n't work for me my code is like this, my field name is password, and the

27/09/2012

Jayaram Sudheer, Thibaut Barrère2

24/09/2012

etl process from the front end

Hello, quick reply from phone: unless your system has very few users/requests or the etl is very

unread,

etl process from the front end

Hello, quick reply from phone: unless your system has very few users/requests or the etl is very

24/09/2012