Array<Struct> support/issue in KSQL

131 views
Skip to first unread message

Ravi Paramasivam

unread,
Jan 20, 2019, 10:56:53 PM1/20/19
to Confluent Platform
Hi,
 I am trying to create the following stream in KSQL using json value format. But it fails with some exception. As per the KSQL documentation it has the support of Array and Struct. But does it support Array<Struct>?

ksql> CREATE STREAM subscriber_json_input_stream(IMSI STRING,IMEI STRING,MSISDN STRING,CUSTOMER_SEGMENTATION STRING,CUST_SUBCATEGORY STRING,SUBS_TYPE STRING,SUBSCRIPTION_PLAN STRING,GROUP_ID BIGINT,PARENT_GROUP_ID BIGINT,ASSOCIATION_ID BIGINT,GROUP_NAME STRING,PARENT_GROUP_NAME STRING,ASSOCIATION_NAME STRING,CUST_FIRST_NM STRING,CUST_LAST_NM STRING,CUST_GENDER STRING,CUST_AGE BIGINT,SUBSCRIBER_ACCOUNT_ID STRING,CUST_LT_VAL DOUBLE,CUST_ANNUAL_INCOME_LVL DOUBLE,SUBSCRIPTION_DETAILS ARRAY<STRUCT<SUBSCRIPTION_ID:STRING,CONTRACT_ID:STRING,CONTRACT_START_DATE:BIGINT,CONTRACT_END_DATE:BIGINT,CONTRACT_CATEGORY:STRING,CONTRACT_SUBCATEGORY:STRING,SUBS_START_TIME:BIGINT,SUBS_END_TIME:BIGINT,SUBS_ACTIVATION_TIME:STRING,SUBS_LT_REVENUE:DOUBLE>>,SERVICE_DETAILS ARRAY<STRUCT<SUBSCRIPTION_ID:STRING,SERVICE_ID:STRING,SERVICE_NAME:STRING,SERVICE_CATEGORY:STRING,RATE_TYPE:STRING,RATE_AMOUNT:DOUBLE>>,SPARE_SUB_1 STRING,SPARE_SUB_2 STRING,SPARE_SUB_3 STRING,SPARE_SUB_4 STRING,HVC_FLAG BIGINT,THROTTLING_FLAG BIGINT,SUBSCRIPTION_PLANB_DETAILS ARRAY<BIGINT>,SUBS_END_TIME BIGINT) WITH(KAFKA_TOPIC = 'subscriber_denorm_json_input_topic',VALUE_FORMAT='JSON', KEY='IMSI');
line 1:518: extraneous input ':' expecting {'NO', 'INTEGER', 'DATE', 'TIME', 'TIMESTAMP', 'INTERVAL', 'YEAR', 'MONTH', 'DAY', 'HOUR', 'MINUTE', 'SECOND', 'ZONE', 'PARTITION', 'STRUCT', 'REPLACE', 'EXPLAIN', 'ANALYZE', 'FORMAT', 'TYPE', 'TEXT', 'SHOW', 'TABLES', 'SCHEMAS', 'COLUMNS', 'COLUMN', 'PARTITIONS', 'FUNCTIONS', 'FUNCTION', 'ARRAY', 'MAP', 'SET', 'RESET', 'SESSION', 'DATA', 'IF', IDENTIFIER, DIGIT_IDENTIFIER, QUOTED_IDENTIFIER, BACKQUOTED_IDENTIFIER}

Regards
Ravi,P

Ravi Paramasivam

unread,
Jan 20, 2019, 11:05:06 PM1/20/19
to Confluent Platform
Kindly ignore. By mistake i added : in between the variable and type after replacing : with space it worked. However there was no example in the confluent documents with Array<Struct>
Reply all
Reply to author
Forward
0 new messages