MariaDb Columnstore becomes unresponsive
23 views
Skip to first unread message
pantonis
Sep 19, 2023, 8:32:07 AM9/19/23
to MariaDB ColumnStore
I am using latest 11.1.2-MariaDB-1:11.1.2+maria~ubu2004 and after some minutes of inserting data I start getting errors and can't insert more data
Internal error: load failed. The detailed error information is listed in err.log.
then this becomes
Got error -1 "Internal error < 0 (Not system error)" from storage engine ColumnStore
Got error -1 "Internal error < 0 (Not system error)" from storage engine ColumnStore
and when I check err.log I see
Sep 19 13:14:44 vm5102 writeengine[5664]: 44.206440 |0|0|0| E 19 CAL0001: SplitterReadThread::operator: Broken Pipe
Sep 19 13:15:19 vm5102 writeenginesplit[23675]: 19.531100 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:15:19 vm5102 writeenginesplit[23675]: 19.532097 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:15:55 vm5102 writeenginesplit[23717]: 55.845658 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:15:55 vm5102 writeenginesplit[23717]: 55.846078 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:16:36 vm5102 writeenginesplit[23761]: 36.824605 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:16:36 vm5102 writeenginesplit[23761]: 36.825169 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:17:36 vm5102 writeenginesplit[23807]: 36.168545 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:17:36 vm5102 writeenginesplit[23807]: 36.168970 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:18:37 vm5102 writeenginesplit[23851]: 37.257099 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:18:37 vm5102 writeenginesplit[23851]: 37.257528 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:19:35 vm5102 writeenginesplit[23893]: 35.357305 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:19:35 vm5102 writeenginesplit[23893]: 35.357686 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:20:39 vm5102 writeenginesplit[23937]: 39.326250 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:20:39 vm5102 writeenginesplit[23937]: 39.326945 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:21:36 vm5102 writeenginesplit[24039]: 36.473114 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:21:36 vm5102 writeenginesplit[24039]: 36.473587 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:22:35 vm5102 writeenginesplit[24082]: 35.924550 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:22:35 vm5102 writeenginesplit[24082]: 35.924966 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:23:38 vm5102 writeenginesplit[24124]: 38.877338 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:23:38 vm5102 writeenginesplit[24124]: 38.877803 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:24:42 vm5102 writeenginesplit[24210]: 42.177560 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:24:42 vm5102 writeenginesplit[24210]: 42.177985 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:25:34 vm5102 writeenginesplit[24251]: 34.646891 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:25:34 vm5102 writeenginesplit[24251]: 34.647284 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:26:35 vm5102 writeenginesplit[24309]: 35.492300 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:26:35 vm5102 writeenginesplit[24309]: 35.492815 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:27:35 vm5102 writeenginesplit[24359]: 35.159184 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:27:35 vm5102 writeenginesplit[24359]: 35.159547 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:28:37 vm5102 writeenginesplit[24402]: 37.671752 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:28:37 vm5102 writeenginesplit[24402]: 37.672158 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:29:34 vm5102 writeenginesplit[24446]: 34.701102 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:29:34 vm5102 writeenginesplit[24446]: 34.701480 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:30:37 vm5102 writeenginesplit[24491]: 37.045784 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:30:37 vm5102 writeenginesplit[24491]: 37.046173 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Any idea why it gets stuck?
Sep 19 13:15:19 vm5102 writeenginesplit[23675]: 19.531100 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:15:19 vm5102 writeenginesplit[23675]: 19.532097 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:15:55 vm5102 writeenginesplit[23717]: 55.845658 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:15:55 vm5102 writeenginesplit[23717]: 55.846078 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:16:36 vm5102 writeenginesplit[23761]: 36.824605 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:16:36 vm5102 writeenginesplit[23761]: 36.825169 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:17:36 vm5102 writeenginesplit[23807]: 36.168545 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:17:36 vm5102 writeenginesplit[23807]: 36.168970 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:18:37 vm5102 writeenginesplit[23851]: 37.257099 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:18:37 vm5102 writeenginesplit[23851]: 37.257528 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:19:35 vm5102 writeenginesplit[23893]: 35.357305 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:19:35 vm5102 writeenginesplit[23893]: 35.357686 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:20:39 vm5102 writeenginesplit[23937]: 39.326250 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:20:39 vm5102 writeenginesplit[23937]: 39.326945 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:21:36 vm5102 writeenginesplit[24039]: 36.473114 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:21:36 vm5102 writeenginesplit[24039]: 36.473587 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:22:35 vm5102 writeenginesplit[24082]: 35.924550 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:22:35 vm5102 writeenginesplit[24082]: 35.924966 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:23:38 vm5102 writeenginesplit[24124]: 38.877338 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:23:38 vm5102 writeenginesplit[24124]: 38.877803 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:24:42 vm5102 writeenginesplit[24210]: 42.177560 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:24:42 vm5102 writeenginesplit[24210]: 42.177985 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:25:34 vm5102 writeenginesplit[24251]: 34.646891 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:25:34 vm5102 writeenginesplit[24251]: 34.647284 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:26:35 vm5102 writeenginesplit[24309]: 35.492300 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:26:35 vm5102 writeenginesplit[24309]: 35.492815 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:27:35 vm5102 writeenginesplit[24359]: 35.159184 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:27:35 vm5102 writeenginesplit[24359]: 35.159547 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:28:37 vm5102 writeenginesplit[24402]: 37.671752 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:28:37 vm5102 writeenginesplit[24402]: 37.672158 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:29:34 vm5102 writeenginesplit[24446]: 34.701102 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:29:34 vm5102 writeenginesplit[24446]: 34.701480 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Sep 19 13:30:37 vm5102 writeenginesplit[24491]: 37.045784 |0|0|0| E 33 CAL0000: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1 %%10%%
Sep 19 13:30:37 vm5102 writeenginesplit[24491]: 37.046173 |0|0|0| E 33 CAL0087: BulkLoad Error: Failed to acquire Table Lock of MyDataWareHouse.OrdersFact; Table currently locked by process-cpimport; pid-23440; session--1; txn--1
Any idea why it gets stuck?
drrtuy
Sep 22, 2023, 5:44:50 AM9/22/23
to MariaDB ColumnStore
Hi,
As the logs say the table is locked by another cpimport. Do you see any cpimport process stuck for a long time in the process list of OS? You can run `ps -auxfw | grep cpimport` to search for such cpimports.
When you find one you can search for the corresponding cpimport log to see when and why cpimport stuck. There might be a network connection issue or OOM that killed cpimport or something else. If there is no problematic cpimport you can try to clear the lock manually but if there is cpimport and you do so it might end up with locking table again.
When you find one you can search for the corresponding cpimport log to see when and why cpimport stuck. There might be a network connection issue or OOM that killed cpimport or something else. If there is no problematic cpimport you can try to clear the lock manually but if there is cpimport and you do so it might end up with locking table again.
Regards,
Roman
вторник, 19 сентября 2023 г. в 15:32:07 UTC+3, pantonis:
Antonis Panagi
Sep 22, 2023, 5:56:34 AM9/22/23
to drrtuy, MariaDB ColumnStore
Ok Will check but long tkme cpimports should not stay there forever.
--
You received this message because you are subscribed to the Google Groups "MariaDB ColumnStore" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mariadb-columns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mariadb-columnstore/f94f98b2-2b56-48e3-a4b5-a574c42f3136n%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages