Issue 1101 in tungsten-replicator: Deploy Mysql to MongoDB failed

[tungsten-...@googlecode.com]

Status: New
Owner: ----
Labels: Type-Defect Priority-Medium FoundIn

New issue 1101 by zhaozhim...@gmail.com: Deploy Mysql to MongoDB failed
https://code.google.com/p/tungsten-replicator/issues/detail?id=1101

What steps will reproduce the problem?

1.shell> ./tools/tpm install alpha \ --datasource-type=mongodb \
--install-directory=/opt/continuent \ --master=host1 \
--enable-heterogenous-slave=true \ --topology=master-slave \ --start=true
2.
3.

What is the expected output?

...

What do you see instead?

#####################################################################
# There are errors with the values provided in the configuration file
#####################################################################
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Temporary Directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --temp-directory
ERROR >> > Prompt Class: TempDirectoryPrompt
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Ports opened on this server for connector
communications
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: HostPortsForConnectors
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Ports opened on this server for manager
communications
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: HostPortsForManagers
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Temporary backup storage
directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-dump-directory
ERROR >> > Prompt Class: BackupStorageTempDirectory
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Number of backups to retain
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-retention
ERROR >> > Prompt Class: BackupStorageRetention
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: What is the path to the
backup script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-script
ERROR >> > Prompt Class: BackupScriptPathConfigurePrompt
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Use sudo when running the
backup script?
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-command-prefix
ERROR >> > Prompt Class: BackupScriptCommandPrefixConfigurePrompt
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Does the backup script
support backing up a datasource while it is ONLINE
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-online
ERROR >> > Prompt Class: BackupScriptOnlineConfigurePrompt
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: MySQL server ID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --mysql-server-id
ERROR >> > Prompt Class: MySQLServerID
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Postgres Replication method
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-method
ERROR >> > Prompt Class: PostgresStreamingReplication
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Timeout for sending unfilled
WAL buffers (data loss window)
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-archive-timeout
ERROR >> > Prompt Class: PostgresArchiveTimeout
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Use PG streaming replication
(true|false)
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresUseStreaming
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Role for PG WAL shipping
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresWALRole
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_standby script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-standby
ERROR >> > Prompt Class: PostgresStandbyPath
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_ctl script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-ctl
ERROR >> > Prompt Class: PostgresControlPath
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Path to the trigger file for
pg_standby
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresStandbyTriggerPath
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_archivecleanup
script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresArchiveCleanupPath
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to
replicate
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-dbname
ERROR >> > Prompt Class: PostgreSQLDatabaseName
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Path to the slonik executable
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-slonik
ERROR >> > Prompt Class: PostgreSQLSlonikPath
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Tables to replicate in form:
schema1.table1,schema2.table2,...
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-tables
ERROR >> > Prompt Class: PostgreSQLTables
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Enable MySQL -> PostgreSQL
DDL dialect converting filter placeholder
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-enable-mysql2pgddl
ERROR >> > Prompt Class: PostgreSQLDDL
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to
replicate into
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --redshift-dbname
ERROR >> > Prompt Class: RedshiftDatabaseName
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to
replicate into
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --vertica-dbname
ERROR >> > Prompt Class: VerticaDatabaseName
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL InnoDB log directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-iblog-directory
ERROR >> > Prompt Class: MySQLInnoDBLogDirectory
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL SSL CA file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-ca
ERROR >> > Prompt Class: MySQLSSLCAFile
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL SSL certificate file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-cert
ERROR >> > Prompt Class: MySQLSSLCertificateFile
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL SSL key file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-key
ERROR >> > Prompt Class: MySQLSSLKeyFile
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL command
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-command
ERROR >> > Prompt Class: MySQLCommand
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: MySQL config file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-conf
ERROR >> > Prompt Class: MySQLConfFile
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle Service
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-service
ERROR >> > Prompt Class: OracleService
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle SID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-sid
ERROR >> > Prompt Class: OracleSID
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle SCAN
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-scan
ERROR >> > Prompt Class: OracleSCAN
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle Service
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-service
ERROR >> > Prompt Class: OracleExtractorService
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle SID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-sid
ERROR >> > Prompt Class: OracleExtractorSID
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Oracle SCAN
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-scan
ERROR >> > Prompt Class: OracleExtractorSCAN
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Root directory for postgresql installation
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-root
ERROR >> > Prompt Class: PostgresRootDirectory
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: PostgreSQL data directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-home
ERROR >> > Prompt Class: PostgresDataDirectory
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: PostgreSQL archive location
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-archive
ERROR >> > Prompt Class: PostgresArchiveDirectory
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Host mongodb: Location of postgresql.conf
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-conf
ERROR >> > Prompt Class: PostgresConfFile
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Unknown configuration key
ERROR >> > Message: This is an unknown configuration key
ERROR >> > Argument: --repl-services.alpha-mongodb.deployment-dataservice
ERROR >> > Current Value: alpha
ERROR >> > Prompt Class: ConfigurePrompt
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR >> Unknown configuration key
ERROR >> > Message: This is an unknown configuration key
ERROR >> > Argument: --repl-services.alpha-mongodb.deployment-host
ERROR >> > Current Value: mongodb
ERROR >> > Prompt Class: ConfigurePrompt

What version of the product are you using?

3.0.0-524

On what operating system?

ubuntu 14.04 64bit

Please provide any additional information below.

Notes:

...


--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

[tungsten-...@googlecode.com]

Comment #1 on issue 1101 by eric.har...@continuent.com: Deploy Mysql to
MongoDB failed
https://code.google.com/p/tungsten-replicator/issues/detail?id=1101

Hello,
Can I suggest you install using the ini file method instead, I think it is
much clearer for heterogenous installs. For this method you install the
hosts individually and you need to have the software unpacked on each host.
If either the master or slave got installed, uninstall first.
To do that: cd to the directory you unpacked the software to and
run ./tools/tpm uninstall --i-am-sure.
Then remove any existing tungsten.cfg (default location would be
/opt/continuent/software/conf.replicator).
Create a tungsten.ini in /etc/tungsten, make sure your tungsten user has
permissions on it.
For the master the contents will be (put your password in):
[defaults]
install-directory=/opt/continuent
user=tungsten
replication-password=xxxxx
replication-user=tungsten
start-and-report=true

[alpha]
master=host1
enable-heterogeneous-master
property=replicator.filter.pkey.addColumnsToDeletes=true
property=replicator.filter.pkey.addPkeyToInserts=true

For the slave:
[defaults]
user=tungsten
home-directory=/opt/continuent
replicatione-user=tungsten
replication-password=secret
start-and-report=true

[alpha]
datasource-type=mongodb
enable-heterogeneous-slave=true
master=host1
slaves=host2
topology=master-slave

Then you can cd into the directory containing the unpacked software and
run ./tools/tpm install on the master then the slave.

Please try it that way and let us know how you get on.

Eric

[tungsten-...@googlecode.com]

Comment #2 on issue 1101 by eric.har...@continuent.com: Deploy Mysql to
MongoDB failed
https://code.google.com/p/tungsten-replicator/issues/detail?id=1101

Just noticed a typo in the above example

enable-heterogeneous-master

Should be

enable-heterogeneous-master=true