Ok, this approach didn't fully satisfy all cases sadly, in CONNECT mode, there are situations that the connection offsets the geos. If I break the connection and reset transformations for that objects to 0, it snaps back in place with correct animation. I haven't figured out yet, in what situation this offset occurs. A simple import does not cause this and at the same time enforces connection on all geos which is expected, but the fact that CONNECT and CREATE work differently in this case, i don't get it!
Other than that, it seems like enforcing all these connections make the scene heavier to evaluate... The other option I'm trying to figure out is how I can rebuild xform connections if I repath the alembicNode path. I've already made changes that takes care of the repathing for the most parts, but in situations that there is no connection between alembicNode and transformations, repathing offsets the geo too unless I can make it re-read the xform values from the new path (I think this happens if there is only vertex animations/transformation in the cache). This would also allow not having to create all those connections with previous method.
Does any have an idea for this case?