Compaction running on hint table.

[varun saluja]

Hi Experts,

We are facing issue on production cluster. Compaction on system.hint table is running from last 2 days.

pending tasks: 1
compaction type keyspace table completed total unit progress
Compaction system hints 20623021829 877874092407 bytes 2.35%
Active compaction remaining time : 0h27m15s

Active compaction remaining time shows in minutes. But, this is job is running like indefinitely.

We have 3 node cluster V 2.1.7. And we ran write intensive job last week on particular table.
Compaction on this table finished but hint table size is growing continuously.

Can someone Please help me.

Thanks & Regards,
Varun Saluja

[Pranay akula]

Varun,

check if any hints are pending on any nodes ?? whats your hinted_handoff window , if the hints are showing continuously i would say its capacity issue your nodes unable to handle load. You can try truncating hints on one node and monitor  the hints if hints are still getting stored, for sure you may need  tweak your conf file to manage load or add nodes to cluster.

Thanks 

Pranay

--
You received this message because you are subscribed to the Google Groups "DataStax C++ Driver for Apache Cassandra User Mailing List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cpp-driver-user+unsubscribe@lists.datastax.com.

[varun saluja]

Hi Pranay,

Thanks for response. 

max_hint_window_in_ms: 10800000. Truncatehints on node is running for more than 6 hours now. And compaction stats reports same.

pending tasks: 1

   compaction type   keyspace   table     completed          total    unit   progress

        Compaction     system   hints   12152557998   869257869352   bytes      1.40%

Active compaction remaining time :   0h27m14s

Can anything else be checked here? Will manually deleting system.hint files and restart node fix this.

Regards,

Varun Saluja