Clickhouse Copier error: table xxxxxxx_piece_0 doesn't exist

57 views
Skip to first unread message

ervin...@gmail.com

unread,
Dec 27, 2020, 3:45:49 AM12/27/20
to ClickHouse
I'm trying to copy table from one cluster to another, but got stuck on this error:

Attempt number 7 to process partition 202012 piece number 0 on shard number 1 with index 0
Code: 60, e.displayText() = DB::Exception: Received from 67.227.167.195:30904. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))
Code: 60, e.displayText() = DB::Exception: Received from 67.227.166.238:30903. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))
Code: 60, e.displayText() = DB::Exception: Received from 67.227.166.161:30905. DB::Exception: Table optimizer_mobile.replacingitem_piece_0 doesn't exist.. (version 20.4.8.99 (official build))
There was an error while executing ALTER on each node. Query was executed on 0 nodes. But had to be executed on 140721519518467
DROP PARTITION was successfully executed on 0 nodes of a cluster.
Partition 202012 piece 0 was dropped on cluster target_cluster
Partition 202012 piece 0 is safe for work now.

Not sure why copier is trying to create a table on target cluster because target database and tables have already been created and are the same as the source cluster.

Task definition:

<yandex>
<remote_servers>
    <source_cluster>

            <shard>
                <replica>
                    <host>clickhouse-server-serv1</host>
                    <port>9000</port>
                </replica>
                <replica>
                    <host>clickhouse-server-serv2</host>
                    <port>9000</port>
                </replica>

            </shard>

    </source_cluster>

    <target_cluster>
            <shard>
                <replica>
                    <host>67.227.166.200</host>
                    <port>30903</port>

                    <user>username</user>
                    <password>password</password>

                </replica>
                <replica>
                    <host>67.227.167.201</host>
                    <port>30904</port>

                    <user>username</user>
                    <password>password</password>
                </replica>
                <replica>
                    <host>67.227.166.202</host>
                    <port>30905</port>

                    <user>username</user>
                    <password>password</password>
                </replica>

            </shard>
    </target_cluster>
</remote_servers>

<max_workers>1</max_workers>

    <!-- Setting used to fetch (pull) data from source cluster tables -->
    <settings_pull>
        <readonly>1</readonly>
    </settings_pull>

    <!-- Setting used to insert (push) data to destination cluster tables -->
    <settings_push>
        <readonly>0</readonly>
    </settings_push>

<tables>
    <table_replacingitem>

        <cluster_pull>source_cluster</cluster_pull>
        <database_pull>optimizer_mobile</database_pull>
        <table_pull>replacingitem</table_pull>



        <cluster_push>target_cluster</cluster_push>
        <database_push>optimizer_mobile</database_push>
        <table_push>replacingitem</table_push>
        <engine>
            engine = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/optimizer_mobile.replacingitem', '{replica}',
             datetime)
        PARTITION BY toYYYYMM(datetime)
        ORDER BY (platform, type, user_id, traffic_source_account_id, item_id, toStartOfHour(datetime), md5_id)
        TTL datetime + toIntervalDay(60)
        SETTINGS index_granularity = 8192
        </engine>

        <sharding_key>01</sharding_key>
    
    </table_replacingitem>
</tables>
</yandex>

Have not been able to find anything on this so any help is appreciated.

杜斌

unread,
Mar 30, 2021, 2:18:10 AMMar 30
to ClickHouse
same issue, can anyone can take a look

Gene Zhang

unread,
Mar 30, 2021, 12:44:47 PMMar 30
to ClickHouse
Some error messages are misleading and copying may be successful anyways. Check the result to see.

--
You received this message because you are subscribed to the Google Groups "ClickHouse" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clickhouse+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clickhouse/74773238-d4c3-4e2b-b1d8-99f1f0a25aa4n%40googlegroups.com.


--
Best regards,
Gene
Reply all
Reply to author
Forward
0 new messages