Вопросы по индексированию новых ссылко

34 views
Skip to first unread message

alex.s...@gmail.com

unread,
Aug 26, 2021, 4:02:00 AM8/26/21
to DataparkSearch Engine
Здравствуйте Максим.
Вопрос по индексированию
Например я запуская индексер вечером, за ночь он индексирует сайт, утром выходят новые страницы на сайте, но индексер их не видит, я заново запускаю индексацию, но мне выводит это:

root@apsny:/usr/local/dpsearch/sbin# ./indexer -N 3
indexer[28692]: {00} indexer from dpsearch-4.54-2017-09-05-mysql started with '/      usr/local/dpsearch/etc/indexer.conf'
indexer[28692]: {01} Done (3 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28692]: {02} Done (3 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28692]: {00} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28692]: {00} Total 5 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec,  0      .00 sec/doc, 0 bytes/doc.
indexer[28692]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 sec/      doc,  0.00 pas/doc.
indexer[28692]: {00} Thu 26 10:59:21 [28692] Flushing all buffers...
indexer[28692]: {00} Done
free(): invalid size
Aborted
root@apsny:/usr/local/dpsearch/sbin# ./indexer -N 10
indexer[28697]: {00} indexer from dpsearch-4.54-2017-09-05-mysql started with '/      usr/local/dpsearch/etc/indexer.conf'
indexer[28697]: {01} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {02} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {03} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {04} Done (5 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {05} Done (6 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {06} Done (6 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {07} Done (7 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {08} Done (8 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {09} Done (8 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {00} Done (9 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[28697]: {00} Total 10 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec,        0.00 sec/doc, 0 bytes/doc.
indexer[28697]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 sec/      doc,  0.00 pas/doc.
indexer[28697]: {00} Thu 26 10:59:35 [28697] Flushing all buffers...
indexer[28697]: {00} Done
double free or corruption (out)
Aborted
root@apsny:/usr/local/dpsearch/sbin#

alex.s...@gmail.com

unread,
Aug 27, 2021, 12:04:49 PM8/27/21
to DataparkSearch Engine
Уже второй день индексер не запускает индексацию 
 0.00 pas/doc.
indexer[30501]: {00} Fri 27 09:50:33 [30501] Flushing all buffers...
indexer[30501]: {00} Done
double free or corruption (out)
Aborted
root@apsny:/usr/local/dpsearch/sbin# ./indexer -N 5
indexer[2140]: {00} indexer from dpsearch-4.54-2017-09-05-mysql started with '/usr/local/dpsearch/etc/indexer.conf'
indexer[2140]: {01} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[2140]: {02} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[2140]: {03} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[2140]: {04} Done (5 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[2140]: {00} Done (6 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[2140]: {00} Total 7 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec,  0.00 sec/doc, 0 bytes/doc.
indexer[2140]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 sec/doc,  0.00 pas/doc.
indexer[2140]: {00} Fri 27 10:59:19 [2140] Flushing all buffers...
indexer[2140]: {00} Done
Segmentation fault
root@apsny:/usr/local/dpsearch/sbin# ./indexer -N 5
indexer[23235]: {00} indexer from dpsearch-4.54-2017-09-05-mysql started with '/usr/local/dpsearch/etc/indexer.conf'
indexer[23235]: {01} Done (3 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[23235]: {02} Done (3 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[23235]: {03} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[23235]: {04} Done (4 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[23235]: {00} Done (5 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[23235]: {00} Total 6 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec,  0.00 sec/doc, 0 bytes/doc.
indexer[23235]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 sec/doc,  0.00 pas/doc.
indexer[23235]: {00} Fri 27 19:04:11 [23235] Flushing all buffers...
indexer[23235]: {00} Done
Segmentation fault
root@apsny:/usr/local/dpsearch/sbin#

четверг, 26 августа 2021 г. в 11:02:00 UTC+3, alex.s...@gmail.com:

Maxim Zakharov

unread,
Aug 30, 2021, 12:24:11 AM8/30/21
to DataparkSearch Engine
Период индексирования / переиндекирования задается командой Period, см. http://dataparksearch.org/dpsearch-indexing.ru.html#GENERAL-RUN и http://dataparksearch.org/dpsearch-indexcmd.ru.html#PERIOD_CMD
Возможно вам будет также  индересна команда PeriodByHops

--
You received this message because you are subscribed to the Google Groups "DataparkSearch Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataparksearc...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/dataparksearch/d014cf2d-5309-4ce6-b264-140000e75b79n%40googlegroups.com.


--
Reply all
Reply to author
Forward
0 new messages