Debezium postgres connector...

[Mahesh Vedantam]

Hi Team,

I'm trying to connect Kafka-Connect with the azure event hub using the Postgres database. 

I am encountering issues while connecting with Postgres database:-

Error Snapshotting to <schema>.<table_name> Perm denied

Snapshotting to.<table_name> Perm denied

Not sure what perms are required for the schema and the table.

Also, the publication which was created manually isn't working.

Connector configuration:-

publication.name = <<>>

publication.autocreate.mode = disabled

Replication perm given,

Create perm  given,

select perm given.

Please advise on the publication permissions also

But it is still adding all the tables in the database.

I specified one table in table.include.list and schema in the schema.include.list.

Not sure why it is taking all the tables.

Can some one take look and let me know what caused the error.

Any pointers are appreciated.

Thanks,

Regards,

Umamahesh V.

[Chris Cranford]

Hi -

Can you please share the full connector log bits where this error occurred.  In the meantime you can also read the documentation about permissions [1]. 

Thanks,
Chris

[1]: https://debezium.io/documentation/reference/2.7/connectors/postgresql.html#postgresql-permissions

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/264c7ae5-a71c-4b50-a8a7-5b5ac7b657a4n%40googlegroups.com.

[Mahesh Vedantam]

Hi Chris,

Postgres connector Configuration is as follows:-

name=<<connector<<

connector.class: io.debezium.connector.postgresql.PostgresConnector",

plugin.name=pgoutput

publication.name=<<>>

publication.autoCreate.mode=disabled

snapshot.mode=when_needed

...

Postgres configuration

...

table.include.list=

schema.include.list=

transformations...

Please let me know why I see the below errors:-

Snapshotting of database schema - perm denied

Snapshotting of database table - perm denied.

thanks,

regards,

Umamahesh V.

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/1db9f72b-fe19-45cb-b624-1e8abb2074dd%40gmail.com.

[Chris Cranford]

Hi -

Well, without the connector logs I'm afraid there is little we can do other than speculate.  I guess is your user doesn't have grants to select or to perform an exported snapshot on the table.  If you want a more concrete answer to what you observe a permission denied error, then we need the connector logs to know what part of the code is generating the issue, which includes the Java error stack trace.

Thanks,
Chris

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/CAFxchOrWf9Z%3Dc5egn8ArsTqNucuFTE36tR3RH6gzB5%2B71MAW_g%40mail.gmail.com.

[Mahesh Vedantam]

Hi Chris,

Please advise if we need to have the create perms on the database when using publications.

For example:-

publication.name: <<name>>

publication.autoCreate.mode: disabled.

Also, which snapshot is the most desirable snapshot mode?

snapshot.mode: when_needed or increment.

Please respond.

Regards,

Mahesh

On Sat, Jun 8, 2024 at 3:17 AM Chris Cranford <cran...@gmail.com> wrote:

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/1db9f72b-fe19-45cb-b624-1e8abb2074dd%40gmail.com.