warp10-standalone.sh snapshot FULL

[Roupie tristan]

Hello every one,

I am trying to use this command to get a snapshot.

"warp10-standalone.sh snapshot FULL"

I Tried this one to :

"sudo bin/warp10-standalone.init snapshot 'snapshot_name"

 following extension plugin are activated

Accelrator

Datalog ( 2 instences)

Http

KafkaPlugin

The command seems to run with never end.

Log are thos one :

2021-07-06T12:48:39,899 [Snapshot Manager] INFO  standalone.StandaloneSnapshotManager - Snapshot trigger file '/opt/warp10/leveldb/snapshot.trigger' detected, closing LevelDB.
2021-07-06T12:48:39,900 [Snapshot Manager] INFO  standalone.WarpDB - Waiting for 1 pending ops to finish.

May be I Miss something, could you help me please?

[mathias....@gmail.com]

Hi,

depending on how many SST files you have, a FULL snapshot may take quite some time as it has to create hard links for every single .sst file.

The "Waiting for 1 pending ops to finish" seems to indicate that some operation on the DB is still ongoing and that the snapshot will only begin once that last operation finishes. This will be indicated by a 'No more pending ops' message.

What version of Warp 10 are you running?

[Roupie tristan]

Thanks,

I don't have too much SST Files (20)

and when I restart warp10 service, snapshot finished immediately.

my Revision is 2.8.1

[Roupie tristan]

Ok thanks to warp10 team, we found what is the issue.

Accelerator does not allow to execute a snapshot (a task still pending) .

I have 2 instances, so I will restart one to do a leveldb snapshot.

Thank You

[mathias....@gmail.com]

Hi,

this is most likely a bug, the accelerator should not disable snapshots, there might be an issue with the inital loading which does not properly discards its iterator thus leaving a pending op. Can you file an issue on github so we can track progress on this matter?