Requirement of CLIAuditLogHook

[pgo...@uber.com]

I am working on incremental replication and have some queries related to this. I see that there are two hooks which can be plugged into Hive.

a. MetastoreAuditLogListener (Metastore events)
b. CliAuditLogHook (All queries)

As I understand, In addition to MetaStoreAuditLogListener, CLIAuditLogHook will get triggered on all possible queries (including read queries) and would update mapred stats as well.

But other than this if *only* replication is concerned everything can be achieved by MetastoreAuditLogListener.

Can you guys let me know if this is correct or are there any specific events which a metastore won't receive.

Thanks,
Prashant

[Paul Yang]

With the version of Hive that we're using (0.13), the listener hook in Hive doesn't have a call for the exchange partition event. Consequently, exchange partition events won't be replicated correctly if you just use the MetastoreAuditLogListener. 

--
You received this message because you are subscribed to the Google Groups "reair" group.
To unsubscribe from this group and stop receiving emails from it, send an email to airbnb-reair+unsubscribe@googlegroups.com.
To post to this group, send email to airbnb...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/airbnb-reair/967b3b7f-fc10-4065-9c40-e3ff152a52f8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Prashant Golash]

Thanks a lot Paul for this information!!!