Issue 1099 in tungsten-replicator: Oracle extractor problem

[tungsten-...@googlecode.com]

Status: New
Owner: ----
Labels: Type-Defect Priority-Medium FoundIn

New issue 1099 by estebanf...@gmail.com: Oracle extractor problem
https://code.google.com/p/tungsten-replicator/issues/detail?id=1099

What steps will reproduce the problem?

1. ./setupCDC.sh with the following config file

service=SCHEMAAPP
sys_user=sys
sys_pass="syspwd2015"
enable_archivelog=0
source_user=W_SRC_SCHEMAAPP
pub_tablespace=0
pub_user=W_PUB_SCHEMAAPP
pub_password=shouldrandom
tungsten_user=W_USR_SCHEMAAPP
tungsten_pwd=shouldrandom
delete_publisher=1
delete_subscriber=1
cdc_type=HOTLOG_SOURCE
specific_tables=0
specific_path=


2. tpm install SCHEMAAPP \
--datasource-oracle-service="SRCDB" \
--datasource-type=oracle \
--master=172.16.1.3 \
--members=172.16.1.3 \

--property=replicator.extractor.dbms.transaction_frag_size=10 \

--property=replicator.global.extract.db.password=shouldrandom \

--property=replicator.global.extract.db.user=W_USR_SCHEMAAPP \
--replication-host=172.16.1.3 \
--replication-password=shouldrandom \
--replication-port=1521 \
--replication-user=W_PUB_SCHEMAAPP \
--role=master \
--start-and-report=true \
--svc-table-engine=CDCASYNC \
--rmi-port=10000 \
--thl-port=2112 \
--install-directory=/opt/continuent/master/SRCDB/SCHEMAAPP

Which gives me the following output

NOTE >> Data service(s) schemaapp updated in
/opt/continuent/tungsten-replicator-3.0.0-524/deploy.cfg
............................
WARN >> 172_16_1_3 >> Linux swappiness is currently set to 60, on restart
it will be 60, consider setting this to 10 or under to avoid swapping. (
SwappinessCheck)
........................................................
Getting replication status on 172.16.1.3
.......
ERROR >> 172_16_1_3 >> Failed:
/opt/continuent/master/srcdb/SCHEMAAPP/releases/tungsten-replicator-3.0.0-524_pid44584/tungsten-replicator/bin/trepc
tl -port 10000 services, RC: 1, Result: ..........Operation failed: null,
No STDERR
#####################################################################
# Commitment failed
#####################################################################
#####################################################################
# Errors for 172_16_1_3
#####################################################################
ERROR >> 172_16_1_3 >> Failed:
/opt/continuent/master/srcdb/SCHEMAAPP/releases/tungsten-replicator-3.0.0-524_pid44584/tungsten-replicator/bin/trepc
tl -port 10000 services, RC: 1, Result: ..........Operation failed: null,
No STDERR

NOTE >> Check the status of all hosts before taking action
.....

Expected output
Run the replicators without any issue

...

Actual output:

com.continuent.tungsten.replicator.ReplicatorException: Failed to execute
query BEGIN DBMS_CDC_SUBSCRIBE.CREATE_SUBSCRIPTION(change_set_name
=> 'TUNGSTEN_CS_SCHEMAAPP', description => 'Change data used by Tungsten',
subscription_name => 'TUNGSTEN_SUB_SCHEMAAPP');end;
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.extractor.oracle.OracleCDCReaderThread.executeQuery(OracleCDCReaderThread.java:379)
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.extractor.oracle.OracleCDCReaderThread.executeQuery(OracleCDCReaderThread.java:413)
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.extractor.oracle.OracleCDCReaderThread.prepare(OracleCDCReaderThread.java:316)
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.extractor.oracle.OracleCDCReaderExtractor.prepare(OracleCDCReaderExtractor.java:181)
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.extractor.ExtractorWrapper.prepare(ExtractorWrapper.java:283)
INFO | jvm 1 | 2015/02/27 13:02:27 | at
com.continuent.tungsten.replicator.conf.ReplicatorRuntime.preparePlugin(ReplicatorRuntime.java:1301)
INFO | jvm 1 | 2015/02/27 13:02:27 | ... 14 more
INFO | jvm 1 | 2015/02/27 13:02:27 | Caused by: java.sql.SQLException:
SQL string is not Query

Im attaching the trepsvc.log

...

Version

Tungsten 3.0.0-524

1* select * from v$version

BANNER
CON_ID
--------------------------------------------------------------------------------
----------
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit
Production 0
PL/SQL Release 12.1.0.2.0 -
Production 0
CORE 12.1.0.2.0
Production 0
TNS for Linux: Version 12.1.0.2.0 -
Production 0
NLSRTL Version 12.1.0.2.0 -
Production 0




...

On what operating system?

cat /etc/centos-release
CentOS release 6.6 (Final)
...
Thank you!

Attachments:
trepsvc.log 31.8 KB

--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

[tungsten-...@googlecode.com]

Comment #1 on issue 1099 by robert.h...@continuent.com: Oracle extractor
problem
https://code.google.com/p/tungsten-replicator/issues/detail?id=1099

The problem seems to be that you are using Oracle 12G, which does not
support the CDC mechanism Tungsten uses to extract data from Oracle. At
this point there is not an easy fix. Either you revert to 11G or there
needs to be a new extractor.

[tungsten-...@googlecode.com]

Comment #2 on issue 1099 by estebanf...@gmail.com: Oracle extractor problem
https://code.google.com/p/tungsten-replicator/issues/detail?id=1099

Thank you for your support,

It seems that the same Issue replicates on Oracle 11g

SQL> select * from
v$version;
│3_pid32643/tungsten-r

│eplicator/bin/trepctl
BANNER
│
-port 10000 services
--------------------------------------------------------------------------------
│,
RC: 256, Result: ..
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit
Production
│........Operation fai
PL/SQL Release 11.2.0.4.0 -
Production
│led: null, Errors:
CORE 11.2.0.4.0
Production
│
TNS for Linux: Version 11.2.0.4.0 -
Production
│NOTE >> Check the st
NLSRTL Version 11.2.0.4.0 - Production

I'm attaching the files:
setupCDC_SCOTT.log execution results from setupCDC.sh
install_master_SCOTT.log, results of the tpm install command


One thing that I can notice is that in the trepsvc.log file line 133 I see
a "java.sql.SQLException: SQL string is not Query" error, which triggers
the whole error, I've tried to manually subscribe the tungsten user to the
CDC subscription, but tpm also tries to do it itself.

Best Regards!

Attachments:
setupCDC_SCOTT.log 727 bytes
trepsvc.log 25.2 KB
install_master_SCOTT.log 1.2 KB

[tungsten-...@googlecode.com]

Comment #3 on issue 1099 by estebanf...@gmail.com: Oracle extractor problem
https://code.google.com/p/tungsten-replicator/issues/detail?id=1099

Sorry, the v$version output is:

SQL> select * from v$version;

BANNER
--------------------------------------------------------------------------------

Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production

PL/SQL Release 11.2.0.4.0 - Production

CORE 11.2.0.4.0 Production
TNS for Linux: Version 11.2.0.4.0 - Production

NLSRTL Version 11.2.0.4.0 - Production