Running nodetool repair command fails with a Scylla API stacktrace

12 views
Skip to first unread message

Mike Tihonchik

<mike.tihonchik@gmail.com>
unread,
Oct 21, 2022, 3:41:20 PM10/21/22
to ScyllaDB users
I try to run this command nodetool repair -host xxx.xx.xx.xx or nodetool repair -dc DC1
but it fails with the stack trace below. Googling for the given error does not return any valuable information. Any suggestions here? Thank you

sh-4.4$ nodetool repair -hosts xxx.xx.xx.xx -tr
error: Scylla API server HTTP POST to URL '/storage_service/repair_async/z' failed: std::runtime_error (unsupported trace)
-- StackTrace --
java.lang.IllegalStateException: Scylla API server HTTP POST to URL '/storage_service/repair_async/z' failed: std::runtime_error (unsupported trace)
        at com.scylladb.jmx.api.APIClient.getException(APIClient.java:140)
        at com.scylladb.jmx.api.APIClient.post(APIClient.java:120)
        at com.scylladb.jmx.api.APIClient.post(APIClient.java:130)
        at com.scylladb.jmx.api.APIClient.post(APIClient.java:113)
        at com.scylladb.jmx.api.APIClient.postGetVal(APIClient.java:144)
        at com.scylladb.jmx.api.APIClient.postInt(APIClient.java:148)
        at org.apache.cassandra.service.StorageService.repairAsync(StorageService.java:886)
        at org.apache.cassandra.service.StorageService.repairAsync(StorageService.java:862)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:72)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:276)
        at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
        at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
        at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
        at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138)
        at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252)
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819)
        at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801)
        at com.scylladb.jmx.utils.APIMBeanServer.invoke(APIMBeanServer.java:188)
        at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1468)
        at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
        at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1309)
        at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1401)
        at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:829)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
        at sun.rmi.transport.Transport$1.run(Transport.java:200)
        at sun.rmi.transport.Transport$1.run(Transport.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
        at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:573)
        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:834)
        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:688)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:687)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

Benny Halevy

<bhalevy@scylladb.com>
unread,
Oct 23, 2022, 2:39:37 AM10/23/22
to Mike Tihonchik, scylladb-users@googlegroups.com
Mike,

Scylla doesn't support repair trace.
Hence the error it returns.
--
You received this message because you are subscribed to the Google Groups "ScyllaDB users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scylladb-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scylladb-users/4fbc10c1-031f-4aad-8889-319fa133dbc8n%40googlegroups.com.

Noelly Medina Catharino

<noelly.catharino@scylladb.com>
unread,
Oct 24, 2022, 8:48:21 AM10/24/22
to scylladb-users@googlegroups.com, Mike Tihonchik
Mike,
To run repair remotely, the best we recommend is setting Scylla Manager 

Reply all
Reply to author
Forward
0 new messages