Clickhouse Copier error: table xxxxxxx_piece_0 doesn't exist

[ervin...@gmail.com]

I'm trying to copy table from one cluster to another, but got stuck on this error:

Attempt number 7 to process partition 202012 piece number 0 on shard number 1 with index 0

Code: 60, e.displayText() = DB::Exception: Received from 67.227.167.195:30904. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))

Code: 60, e.displayText() = DB::Exception: Received from 67.227.166.238:30903. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))

Code: 60, e.displayText() = DB::Exception: Received from 67.227.166.161:30905. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))

There was an error while executing ALTER on each node. Query was executed on 0 nodes. But had to be executed on 140721519518467

DROP PARTITION was successfully executed on 0 nodes of a cluster.

Partition 202012 piece 0 was dropped on cluster target_cluster

Partition 202012 piece 0 is safe for work now.

Not sure why copier is trying to create a table on target cluster because target database and tables have already been created and are the same as the source cluster.

Task definition:

<yandex>

<remote_servers>

    <source_cluster>

            <shard>

                <replica>

                    <host>clickhouse-server-serv1</host>

                    <port>9000</port>

                </replica>

                <replica>

                    <host>clickhouse-server-serv2</host>

                    <port>9000</port>

                </replica>

            </shard>

    </source_cluster>

    <target_cluster>

            <shard>

                <replica>

                    <host>67.227.166.200</host>

                    <port>30903</port>

                    <user>username</user>

                    <password>password</password>

                </replica>

                <replica>

                    <host>67.227.167.201</host>

                    <port>30904</port>

                    <user>username</user>

                    <password>password</password>

                </replica>

                <replica>

                    <host>67.227.166.202</host>

                    <port>30905</port>

                    <user>username</user>

                    <password>password</password>

                </replica>

            </shard>

    </target_cluster>

</remote_servers>

<max_workers>1</max_workers>

    <!-- Setting used to fetch (pull) data from source cluster tables -->

    <settings_pull>

        <readonly>1</readonly>

    </settings_pull>

    <!-- Setting used to insert (push) data to destination cluster tables -->

    <settings_push>

        <readonly>0</readonly>

    </settings_push>

<tables>

    <table_replacingitem>

        <cluster_pull>source_cluster</cluster_pull>

        <database_pull>optimizer_mobile</database_pull>

        <table_pull>replacingitem</table_pull>

        <cluster_push>target_cluster</cluster_push>

        <database_push>optimizer_mobile</database_push>

        <table_push>replacingitem</table_push>

        <engine>

            engine = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/optimizer_mobile.replacingitem', '{replica}',

             datetime)

        PARTITION BY toYYYYMM(datetime)

        ORDER BY (platform, type, user_id, traffic_source_account_id, item_id, toStartOfHour(datetime), md5_id)

        TTL datetime + toIntervalDay(60)

        SETTINGS index_granularity = 8192

        </engine>

        <sharding_key>01</sharding_key>

    

    </table_replacingitem>

</tables>

</yandex>

Have not been able to find anything on this so any help is appreciated.

[杜斌]

same issue, can anyone can take a look

[Gene Zhang]

Some error messages are misleading and copying may be successful anyways. Check the result to see.

Here is a request for improvement:

https://github.com/ClickHouse/ClickHouse/issues/20955

--
You received this message because you are subscribed to the Google Groups "ClickHouse" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clickhouse+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clickhouse/74773238-d4c3-4e2b-b1d8-99f1f0a25aa4n%40googlegroups.com.

--

Best regards,

Gene