name overlap

[Hongyan He]

hi， when the  legacy data which have the same name of the database in different clusters, now i installed waggle-dancle to unified the view on hive, i know i can add prefix to avoid name conflict, but for the old running sql,  i  don‘t want to  change the old sql, are  there some solutions? thank you

[Mass Dosage]

Hey there,

I'm afraid you don't have any options other than rewriting the old SQL to prefix the database names. If there is a name clash then it's impossible for Waggle Dance to tell which database to route the queries to and this is what it uses the prefix for.

Thanks,

Adrian

On Tue, 17 Aug 2021 at 15:19, Hongyan He <katty...@gmail.com> wrote:

hi， when the  legacy data which have the same name of the database in different clusters, now i installed waggle-dancle to unified the view on hive, i know i can add prefix to avoid name conflict, but for the old running sql,  i  don‘t want to  change the old sql, are  there some solutions? thank you

--
You received this message because you are subscribed to the Google Groups "Waggle Dance User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to waggle-dance-u...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/waggle-dance-user/c4b4f7c1-7577-4dc4-9f6b-02dabac8ad5bn%40googlegroups.com.

[Patrick Duin]

(Forgot to reply all)

But potentially you have some options (might not be worth it though and just changing your queries is probably a lot easier.

What we usually do is setup multiple instance:

You can setup WD for  a cluster 1 (primary no prefix) federating to cluster 2 (with prefix) for main cluster 1 users

Then the reverse for the cluster 2 users. WD with cluster 2 (primary no prefix) federating to cluster 1 (with prefix).

An alternative is to setup WD to MANUAL database resolution: https://github.com/ExpediaGroup/waggle-dance/blob/main/README.md#database-resolution

That does not use a prefix but it requires the database to be manually mapped to avoid conflicts.

Patrick

Op wo 18 aug. 2021 om 11:17 schreef Mass Dosage <massd...@gmail.com>:

To view this discussion on the web, visit https://groups.google.com/d/msgid/waggle-dance-user/CAE0Ohd4%3DX38M46iZBtWAdEQ%2BR%3DGGSMLWVLvdcj31hju0hxQh9g%40mail.gmail.com.