[JIRA] (CDAP-17842) Document CDAP-17720 as known issue.

[Sagar Kapare (Jira)]

Sagar Kapare created an issue

CDAP / CDAP-17842 Document CDAP-17720 as known issue. Issue Type: Bug Affects Versions: 6.3.0 Assignee: Trishka Fernandes Components: Replicator Created: 23/Mar/21 2:55 PM Fix Versions: 6.4.0 Priority: Critical Reporter: Sagar Kapare We do not support normalizing of the source database table names as described by https://cdap.atlassian.net/browse/CDAP-17720. We should document it as known issue. "Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long." is the requirement on the field names. Only solution to not make pipeline fail is to deselect such column while replicating. Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100156-sha1:fdbe273)

[Robin Rielley (Jira)]

Robin Rielley commented on CDAP-17842

Re: Document CDAP-17720 as known issue. Sagar Kapare Sean Zhou How’s this: CDAP-17720: When you run a Replication job, if a source table has a column name that does not conform to BigQuery conventions, the job fails with an error similar to the following: com.google.cloud.bigquery.BigQueryException: Invalid field name "SYS_NC00012$". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long. Note: In BigQuery, column names must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.  Workaround: Remove columns from the Replication job that do not conform to the BigQuery naming conventions.

Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100156-sha1:fdbe273)

[Robin Rielley (Jira)]

Robin Rielley edited a comment on CDAP-17842

Re: Document CDAP-17720 as known issue.

[~accountid:5cfea7b1b674950c52db4e94] [~accountid:5f2858118fd8ab001bfd9dfa] How’s this: [+CDAP-17720:+|https://cdap.atlassian.net/browse/CDAP-17720] When you run a Replication job, if a source table has a column name that does not conform to BigQuery naming conventions, the job fails with an error similar to the following: _com.google.cloud.bigquery.BigQueryException: Invalid field name "SYS_NC00012$". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long._ *Note:* In BigQuery, column names must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.  *Workaround:* Remove columns from the Replication job that do not conform to the BigQuery naming conventions.

Add Comment

Get Jira notifications on your phone! Download the Jira Cloud app for Android or iOS

This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100156-sha1:4b33a37)