Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Merge Replication Initialization-Too many generation batches

426 views
Skip to first unread message

John Luo

unread,
Jun 28, 2007, 3:42:06 PM6/28/07
to
I have a SQL 2005-2005 Express Merge replication. Articles with FKs.
Added a new subscriber, when I initialize it, some tables are updated more
190 times. For example, customer table has 100 records, however the
initialization inserts 100 and update 19000 rows. It makes the initialization
too long.
Is this has someting to do the some old snapshot not cleanup or Child and
Parent Generations in Separate Generation Batches?
Any help would be greatly appreciated.

John
Here are some logs:
Enumerating inserts and updates in article 'LogCustomerHeader' (generation
batch 1891)
Downloaded 100 change(s) in 'CustomerList' (100 updates): 253849 total
Enumerating inserts and updates in article 'LogCustomerDetail' (generation
batch 1891)
Downloaded 100 change(s) in 'CustomerList' (100 updates): 253949 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254049 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254149 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254249 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254349 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254449 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254549 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254649 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254749 total
Enumerating deletes in all articles (generation batch 1901)
Enumerating inserts and updates in article 'LogPosition' (generation batch
1901)
Enumerating inserts and updates in article 'LogPositionOff' (generation
batch 1901)
Enumerating inserts and updates in article 'Email' (generation batch 1901)
Enumerating inserts and updates in article 'User' (generation batch 1901)
Enumerating inserts and updates in article 'CustomerGroup' (generation batch
1901)
Enumerating inserts and updates in article 'CustomerList' (generation batch
1901)
Downloaded 15 change(s) in 'User' (15 updates): 2865 total
Downloaded 46 change(s) in 'CustomerGroup' (46 updates): 8786 total
Downloaded 41 change(s) in 'CustomerList' (41 updates): 254790 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254890 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 254990 total
Enumerating inserts and updates in article 'LogCustomerHeader' (generation
batch 1901)
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255090 total
Enumerating inserts and updates in article 'LogCustomerDetail' (generation
batch 1901)
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255190 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255290 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255390 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255490 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255590 total
Downloaded 100 change(s) in 'CustomerList' (100 updates): 255690 total

Charles Wang[MSFT]

unread,
Jun 29, 2007, 2:39:52 AM6/29/07
to
Hi John,
I understand that when you added a new subscriber to your current SQL
Server 2005-2005 Express merge replication, you found that the
initialization process was too long.
If I have misunderstood, please let me know.

To let me better understand your issue, I would like to know the following
qeustions:
1. How many articles published in your publication database?
2. How much space that the replicated tables have?
3. How many subscribers in your merge replication?
4. How long did the initialize process finish?
5. Could you please mail me (changliw_at_microsoft_dot_com) the replication
logs for further research?

Look forward to your response.

Best regards,
Charles Wang
Microsoft Online Community Support
=====================================================
Get notification to my posts through email? Please refer to:
http://msdn.microsoft.com/subscriptions/managednewsgroups/default.aspx#notif
ications

If you are using Outlook Express, please make sure you clear the check box
"Tools/Options/Read: Get 300 headers at a time" to see your reply promptly.


Note: The MSDN Managed Newsgroup support offering is for non-urgent issues
where an initial response from the community or a Microsoft Support
Engineer within 1 business day is acceptable. Please note that each follow
up response may take approximately 2 business days as the support
professional working with you may need further investigation to reach the
most efficient resolution. The offering is not appropriate for situations
that require urgent, real-time or phone-based interactions or complex
project analysis and dump analysis issues. Issues of this nature are best
handled working with a dedicated Microsoft Support Engineer by contacting
Microsoft Customer Support Services (CSS) at
http://msdn.microsoft.com/subscriptions/support/default.aspx.
======================================================
When responding to posts, please "Reply to Group" via
your newsreader so that others may learn and benefit
from this issue.
======================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
======================================================

John Luo

unread,
Jun 29, 2007, 11:32:00 PM6/29/07
to
Thanks Charles,

> 1. How many articles published in your publication database?
8
> 2. How much space that the replicated tables have?
~<5 M , totally about 5000 rows

> 3. How many subscribers in your merge replication?

8


> 4. How long did the initialize process finish?

~25 minutees. Sync in LAN

> 5. Could you please mail me (changliw_at_microsoft_dot_com) the replication
> logs for further research?

Will do.
Thanks,
John

Charles Wang[MSFT]

unread,
Jul 2, 2007, 7:23:05 AM7/2/07
to
Hi John,
Thanks for your response.

I have checked the logs. The initialization seemed no problem. For why the
initialization causes so many updates, I need to consult the product team
on this issue since the initialization process is undocumented and I could
not assume anything. I will let you know the response as soon as possible
when I get their responses. However the process may need a long time and
sometimes may not get responses.

I appreciate your patience, but if I could not get their response within 2
days. Effectively and immediately I recommend that you contact Microsoft
Customer Support Services (CSS) via telephone so that a dedicated Support
Professional can assist you in a more efficient manner. Please be advised
that contacting phone support will be a charged call.

To obtain the phone numbers for specific technology request please take a
look at the web site listed below.
http://support.microsoft.com/default.aspx?scid=fh;EN-US;PHONENUMBERS

If you are outside the US please see http://support.microsoft.com for
regional support phone numbers.

John Luo

unread,
Jul 5, 2007, 10:02:01 PM7/5/07
to
Charles,
I was wondering if this has something to do with the fact that I added some
columns to 2 published tables. This made the replication articles merge by
columns ( sp_mergearticlecolumn)
Thanks,
John

Charles Wang[MSFT]

unread,
Jul 6, 2007, 2:36:13 AM7/6/07
to
Hi John,
Adding columns may cause SQL Server Merge replication reinitialization
which may need a long time. I recommend that you refer to "Adding Columns"
section in this article to see if your steps would cause the
reinitialization:
Schema Changes on Publication Databases
http://technet.microsoft.com/en-us/library/aa237127(sql.80).aspx

Please feel free to let me know if you have any questions or concerns.

Charles Wang[MSFT]

unread,
Aug 22, 2007, 3:30:14 AM8/22/07
to
Hi John,
I am trying to consult the product team on this issue. However the process
may need a long time. I strongly recommend that you can leave me
(changliw_at_microsoft_dot_com) an email response so that I can timely
update you when I get a response.

If you have any questions or concerns, please feel free to let me know. It
is my pleasure to be of assistance.

Best regards,
Charles Wang
Microsoft Online Community Support
=====================================================

Charles Wang[MSFT]

unread,
Aug 22, 2007, 3:33:58 AM8/22/07
to
Also I would like to let you know that since the process may need a long
time, if this issue is urgent to your business, immediately and effectively
I recommend that you contact CSS via telephone for the best support.

Best regards,
Charles Wang
Microsoft Online Community Support
=====================================================

samuelsurya

unread,
Nov 25, 2009, 4:00:48 AM11/25/09
to
Dear All,

I have this experience and solved the problem.

1. Please check if you use filter rows.
2. Make sure your table is only filtered once. It seems that SQL confuse about filtering child table that applied from two parents.

I hope this tips can help you.

changli wrote:

Also I would like to let you know that since the process may need a long time,

22-Aug-07

Previous Posts In This Thread:

On Thursday, June 28, 2007 3:42 PM
luo wrote:

Merge Replication Initialization-Too many generation batches

On Friday, June 29, 2007 2:39 AM
changli wrote:

Hi John,I understand that when you added a new subscriber to your current SQL


Hi John,
I understand that when you added a new subscriber to your current SQL
Server 2005-2005 Express merge replication, you found that the
initialization process was too long.
If I have misunderstood, please let me know.

To let me better understand your issue, I would like to know the following
qeustions:
1. How many articles published in your publication database?
2. How much space that the replicated tables have?
3. How many subscribers in your merge replication?
4. How long did the initialize process finish?
5. Could you please mail me (changliw_at_microsoft_dot_com) the replication
logs for further research?

Look forward to your response.

Best regards,


Charles Wang
Microsoft Online Community Support
=====================================================

Get notification to my posts through email? Please refer to:
http://msdn.microsoft.com/subscriptions/managednewsgroups/default.aspx#notif
ications

If you are using Outlook Express, please make sure you clear the check box
"Tools/Options/Read: Get 300 headers at a time" to see your reply promptly.


Note: The MSDN Managed Newsgroup support offering is for non-urgent issues
where an initial response from the community or a Microsoft Support
Engineer within 1 business day is acceptable. Please note that each follow
up response may take approximately 2 business days as the support
professional working with you may need further investigation to reach the
most efficient resolution. The offering is not appropriate for situations
that require urgent, real-time or phone-based interactions or complex
project analysis and dump analysis issues. Issues of this nature are best
handled working with a dedicated Microsoft Support Engineer by contacting
Microsoft Customer Support Services (CSS) at
http://msdn.microsoft.com/subscriptions/support/default.aspx.
======================================================

When responding to posts, please "Reply to Group" via
your newsreader so that others may learn and benefit
from this issue.
======================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
======================================================

On Friday, June 29, 2007 11:32 PM
luo wrote:

Thanks Charles,8 ~<5 M , totally about 5000 rows8~25 minutees.
Thanks Charles,
8


~<5 M , totally about 5000 rows

8


~25 minutees. Sync in LAN

Will do.
Thanks,
John

"Charles Wang[MSFT]" wrote:

On Monday, July 02, 2007 7:23 AM
changli wrote:

Hi John,Thanks for your response.I have checked the logs.


Hi John,
Thanks for your response.

I have checked the logs. The initialization seemed no problem. For why the
initialization causes so many updates, I need to consult the product team
on this issue since the initialization process is undocumented and I could
not assume anything. I will let you know the response as soon as possible
when I get their responses. However the process may need a long time and
sometimes may not get responses.

I appreciate your patience, but if I could not get their response within 2
days. Effectively and immediately I recommend that you contact Microsoft
Customer Support Services (CSS) via telephone so that a dedicated Support
Professional can assist you in a more efficient manner. Please be advised
that contacting phone support will be a charged call.

To obtain the phone numbers for specific technology request please take a
look at the web site listed below.
http://support.microsoft.com/default.aspx?scid=fh;EN-US;PHONENUMBERS

If you are outside the US please see http://support.microsoft.com for
regional support phone numbers.

Best regards,
Charles Wang
Microsoft Online Community Support
=====================================================

Get notification to my posts through email? Please refer to:
http://msdn.microsoft.com/subscriptions/managednewsgroups/default.aspx#notif
ications

If you are using Outlook Express, please make sure you clear the check box
"Tools/Options/Read: Get 300 headers at a time" to see your reply promptly.


Note: The MSDN Managed Newsgroup support offering is for non-urgent issues
where an initial response from the community or a Microsoft Support
Engineer within 1 business day is acceptable. Please note that each follow
up response may take approximately 2 business days as the support
professional working with you may need further investigation to reach the
most efficient resolution. The offering is not appropriate for situations
that require urgent, real-time or phone-based interactions or complex
project analysis and dump analysis issues. Issues of this nature are best
handled working with a dedicated Microsoft Support Engineer by contacting
Microsoft Customer Support Services (CSS) at
http://msdn.microsoft.com/subscriptions/support/default.aspx.
======================================================

When responding to posts, please "Reply to Group" via
your newsreader so that others may learn and benefit
from this issue.
======================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
======================================================

On Thursday, July 05, 2007 10:02 PM
luo wrote:

Charles,I was wondering if this has something to do with the fact that I added


Charles,
I was wondering if this has something to do with the fact that I added some
columns to 2 published tables. This made the replication articles merge by
columns ( sp_mergearticlecolumn)
Thanks,
John

"Charles Wang[MSFT]" wrote:

On Friday, July 06, 2007 2:36 AM
changli wrote:

Hi John, Adding columns may cause SQL Server Merge replication
Hi John,
Adding columns may cause SQL Server Merge replication reinitialization
which may need a long time. I recommend that you refer to "Adding Columns"
section in this article to see if your steps would cause the
reinitialization:
Schema Changes on Publication Databases
http://technet.microsoft.com/en-us/library/aa237127(sql.80).aspx

Please feel free to let me know if you have any questions or concerns.

Best regards,
Charles Wang
Microsoft Online Community Support
=====================================================

Get notification to my posts through email? Please refer to:
http://msdn.microsoft.com/subscriptions/managednewsgroups/default.aspx#notif
ications

If you are using Outlook Express, please make sure you clear the check box
"Tools/Options/Read: Get 300 headers at a time" to see your reply promptly.


Note: The MSDN Managed Newsgroup support offering is for non-urgent issues
where an initial response from the community or a Microsoft Support
Engineer within 1 business day is acceptable. Please note that each follow
up response may take approximately 2 business days as the support
professional working with you may need further investigation to reach the
most efficient resolution. The offering is not appropriate for situations
that require urgent, real-time or phone-based interactions or complex
project analysis and dump analysis issues. Issues of this nature are best
handled working with a dedicated Microsoft Support Engineer by contacting
Microsoft Customer Support Services (CSS) at
http://msdn.microsoft.com/subscriptions/support/default.aspx.
======================================================

When responding to posts, please "Reply to Group" via
your newsreader so that others may learn and benefit
from this issue.
======================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
======================================================

On Monday, August 20, 2007 11:38 AM
luo wrote:

I deleted the publication and subscribtion, Re-create them.
I deleted the publication and subscribtion, Re-create them. However after
running a couple weeks, the problem still there. When do I reinitialize a
subscriber and there are more than 100 generation batches (Enumerating
inserts and updates in article (generation batch 114)
How can I avoid this?

Thanks,
John

"Charles Wang[MSFT]" wrote:

On Wednesday, August 22, 2007 3:30 AM
changli wrote:

Hi John,I am trying to consult the product team on this issue.


Hi John,
I am trying to consult the product team on this issue. However the process
may need a long time. I strongly recommend that you can leave me
(changliw_at_microsoft_dot_com) an email response so that I can timely
update you when I get a response.

If you have any questions or concerns, please feel free to let me know. It
is my pleasure to be of assistance.

Best regards,


Charles Wang
Microsoft Online Community Support
=====================================================
When responding to posts, please "Reply to Group" via
your newsreader so that others may learn and benefit
from this issue.
======================================================
This posting is provided "AS IS" with no warranties, and confers no rights.
======================================================

On Wednesday, August 22, 2007 3:33 AM
changli wrote:

EggHeadCafe - Software Developer Portal of Choice
Dynamic HTTP Compression with IIS 5.0
http://www.eggheadcafe.com/tutorials/aspnet/ff6a260c-3f9d-4c6d-86c3-512799fc857e/dynamic-http-compression.aspx

Paul Ibison

unread,
Nov 25, 2009, 2:17:44 PM11/25/09
to
Please can you post up the schema of the tables and explain how the filters
were set up - I'd like to repro.
Thanks,
Paul

Samuel

unread,
Dec 2, 2009, 2:29:08 AM12/2/09
to
Dear Paul,

I have many tables in my database, so I give you some tables only for
example how the filter can make conflict.

My filter some thing like this:
+coACCT
+ coACCTFILT
+coACCTAGEN
+ moCUST
+
moCUSTACCT
+ moCUST
+ etc...

If you here, moCUST has two parent, first is coACCTAGEN and second
coACCTFILT
in my case, coACCTAGEN has no data and the other hand coACCTFILT has
some data, so moCUST actually confusing which rules should be
followed.

After clean up the unappropiate filter, my sync work normal.

Please advise.

Samuel Surya

Paul Ibison

unread,
Dec 2, 2009, 5:20:56 PM12/2/09
to
I'd really like to repro this but think this is not enough info. Ideally I
need the schema of the tables, the definitions of the filters - script them
out with the publication will be fine - I'll find them. Then a clear
explanation of which tables have data eg does moCUSTACCT have data - not
included in your desc. if you want you can mail this to
paul....@replicationanswers.com and I'll test it and post back (or mail
back if this is NDA). I just need to try to get a solid repro.
Thanks,
Paul

0 new messages