Debezium connector not connecting to oracle xstream

734 views
Skip to first unread message

sithu...@yomabank.com

unread,
Aug 31, 2018, 6:47:10 AM8/31/18
to debezium
I'm trying to setup oracle->debezium->kafka.
I've done setting up xstream log mod according to https://docs.oracle.com/cd/E11882_01/server.112/e16545/xstrm_config.htm#XSTRM1563 docs .
My database is oracle 12.0.1.2 (12c) running in non-cdb mode.
SQL> SELECT CDB FROM V$DATABASE;
CDB
---NO

When I check xstream_out status in sqlplus
SELECT SERVER_NAME,
       
CONNECT_USER,
       
CAPTURE_USER,
       
CAPTURE_NAME,
       
SOURCE_DATABASE,
       
QUEUE_OWNER,
       
QUEUE_NAME,
       
STATUS
  FROM DBA_XSTREAM_OUTBOUND;

Outbound                         Capture
Server     Connect    Capture    Process     Source      Queue      Queue
Name       User       User       Name        Database    Owner      Name       Status
---------- ---------- ---------- ----------- ----------- ---------- ---------- --------
DBZXOUT    CXSTRM     XSTRMADMIN CAP$_DBZXOU DEVDB    SYS        Q$_DBZXOUT DETACHED
                                 T_53                               _54



status is detached.

Debezium task is running.

curl http://confluent-cp-kafka-connect:8083/connectors/txn-connector/tasks/0/status
{"state":"RUNNING","id":0,"worker_id":"confluent-cp-kafka-connect-qwhqr:8083"}


I can't see any error logs on both side.

this is my connector config

{
    "name": "txn-connector",
    "config": {
        "connector.class" : "io.debezium.connector.oracle.OracleConnector",
        "tasks.max" : "1",
        "database.server.name" : "server1",
        "database.hostname" : "192.168.12.21",
        "database.port" : "1521",
        "database.user" : "xstrm",
        "database.password" : "password",
        "database.dbname" : "ORACLE_SID",
        "database.pdb.name": "ORACLE_SID",
        "database.out.server.name" : "dbzxout",
        "database.history.kafka.bootstrap.servers" : "confluent-cp-kafka-headless:9092",
        "database.history.kafka.topic": "txn-history"
    }
}


I would like to know how to troubleshoot this.

Gunnar Morling

unread,
Sep 4, 2018, 1:31:06 AM9/4/18
to debezium
Hi,

Thanks a lot for giving the Oracle connector a test drive!

Can you try the steps for trouble shooting XStream described here:


?

--Gunnar

sithu...@yomabank.com

unread,
Sep 7, 2018, 4:27:42 AM9/7/18
to debezium
Hi Gunnar,
Thanks for reply.
Here is output from oracle sql.

COLUMN CAPTURE_NAME HEADING 'Capture|Name' FORMAT A15
COLUMN CREATE_MESSAGE HEADING
'Last LCR|Create Time'
COLUMN ENQUEUE_MESSAGE HEADING
'Last|Enqueue Time'

SELECT CAPTURE_NAME
,
       TO_CHAR
(CAPTURE_MESSAGE_CREATE_TIME, 'HH24:MI:SS MM/DD/YY') CREATE_MESSAGE,
       TO_CHAR
(ENQUEUE_MESSAGE_CREATE_TIME, 'HH24:MI:SS MM/DD/YY') ENQUEUE_MESSAGE
  FROM V$STREAMS_CAPTURE
;

no rows selected



SQL> COLUMN CAPTURE_NAME HEADING 'Capture Process' FORMAT A30
COLUMN ATTRIBUTE_NAME HEADING 'Attribute Name' FORMAT A30
 
SELECT CAPTURE_NAME, ATTRIBUTE_NAME
  FROM DBA_CAPTURE_EXTRA_ATTRIBUTES
  WHERE INCLUDE = 'YES'
  ORDER BY CAPTURE_NAME;SQL> SQL> SQL>   2    3    4  

no rows selected


SQL> SELECT STATE FROM V$PROPAGATION_RECEIVER;

no rows selected
SQL> SELECT TOTAL_MEMORY_ALLOCATED/CURRENT_SIZE FROM V$STREAMS_POOL_STATISTICS;

TOTAL_MEMORY_ALLOCATED/CURRENT_SIZE
-----------------------------------
                         .008696179

SQL> SELECT STATE FROM V$STREAMS_CAPTURE;

no rows selected



SQL> SELECT APPLY_NAME SUBSCRIBER, QUEUE_NAME FROM DBA_APPLY UNION
  SELECT PROPAGATION_NAME, SOURCE_QUEUE_NAME
  FROM DBA_PROPAGATION
  ORDER BY QUEUE_NAME;  2    3    4  

SUBSCRIBER                     QUEUE_NAME
------------------------------ ------------------------------
DBZXOUT                        Q$_DBZXOUT_54



DBA CAPTURE STATUS

SQL> SELECT CAPTURE_NAME, RULE_SET_NAME, RULE_SET_OWNER,ERROR_MESSAGE, STATUS, CLIENT_STATUS,CLIENT_NAME FROM DBA_CAPTURE;

Capture
Name            RULE_SET_NAME   RULE_ ERROR_MESSAGE                            STATUS     CLIENT_STATUS   CLIENT_NAME
--------------- --------------- ----- ---------------------------------------- ---------- --------------- ---------------
CAP$_DBZXOUT_53 RULESET$_61     SYS                                            ENABLED    DETACHED        DBZXOUT





chengtao pan

unread,
May 20, 2020, 4:37:43 AM5/20/20
to debezium
did you solve the problem? i also get into trouble

在 2018年9月7日星期五 UTC+8下午4:27:42,sithu...@yomabank.com写道:

Matthew Tice

unread,
May 20, 2020, 12:32:29 PM5/20/20
to debe...@googlegroups.com
According to the documentation:

DETACHED - For XStream Out if the outbound server is running, but the XStream client application is not attached to it; For GoldenGate if the capture process is running, but the extract process is not attached to it

So what happens if you restart the connector?

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/54144238-33f1-4dd8-a645-550174e87d47%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages