Re: Data SYNC between SQL Server and Mongo DB

[Moacy Barros]

Hello madhu,

there is no built-in component to do that, but you can follow check some migration experiences: http://www.10gen.com/presentations/mongosf2011/craigslist

Even your scenario being related to synchronization, the advises listed there are applicable. To keep they synchronized I believe the best option is a ETL script, some of them has mongodb specific tasks, there are some good option, free and paid. If synchronization logic is very complex you can create a batch job to run a home made migration application.

Regards,

Moacy

On Tuesday, February 5, 2013 7:04:57 AM UTC-2, madhu sudan wrote:

Hello Forum ,

Our application has SQL Server as data base and has huge amount of data. We decided to set up Mongo DB for search lookup and repoting purposes. So Mongo DB will have subset of data from SQL server DB. And there should be a synchronization process between Mongo DB and SQL DB. The syncronization process will run daily. 

In this context i'm looking for best practices (if any)  for approaching above requirement.

Is there any built-in component for data transfer between Mongo DB and SQL.

Appreciate for any inputs.

Thanks

[saul mayorquin]

I think you need something like domain events on your application or CQRS pattern to do all stuff for your reports and search models

[Ashish Gandhi]

Try looking on Apache SOLR or Elastic Search for your purpose. It would be a best option for you.

[Ashish Gandhi]

Try looking on Apache SOLR or Elastic Search, it would be a best option for this scenario.

[sunny Rakesh]

Hi Madhusudan/moacy,

Our application has Oracle as data base and has huge amount of data. We decided to set up MongoDB for search lookup and reporting purposes. So MongoDB will have subset of data from Oracle DB. And there should be a synchronization process between MongoDB and Oracle DB. The synchronization process will run daily. 

In this context i'm looking for best practices (if any)  for approaching above requirement.

Is there any built-in component for data transfer between MongoDB and Oracle.

Hi Madhu, I guess we are working together now.

Thanks,

Rakesh Kosana

[Wan Bachtiar]

Hi Rakesh,

Instead of replying to an old thread, please start a new discussion topic for your question. The original discussion is about a built-in component for data transfer between MongoDB and SQL Server instead of Oracle.

FYI, You can checkout a tool listed under MongoDB third-party commercial tools: MongoDBPumper for Oracle. MongoDBPumper facilitates data transfer between Oracle and MongoDB databases.

Alternatively, you could develop your own data transfer application/script using one of MongoDB supported drivers.

Also, there are a couple of white papers that you may find useful:

• RDBMS to MongoDB migration guide.
• Migrating from Oracle - How Apollo group evaluated MongoDB.

If you have any further questions, please start a new discussion thread detailing your specific use case.

Kind regards,

Wan.

​