ISPN000097: Error while processing a prepare in a single-phase transaction

[Nguyễn Toàn]

Hi all,

I got the below error while starting the cluster with Wildfly 31, but I can't find the root cause, can you help on this?

ERROR [ServerService Thread Pool -- 5]-[org.infinispan.transaction.impl.TransactionCoordinator] ISPN000097: Error while processing a prepare in a single-phase transaction: org.infinispan.commons.marshall.MarshallingException: org.wildfly.clustering.server.infinispan.provider.AddressSetAddFunction
at org.infin...@14.0.24.Final//org.infinispan.marshall.protostream.impl.AbstractInternalProtoStreamMarshaller.objectToOutputStream(AbstractInternalProtoStreamMarshaller.java:75)
at org.infin...@14.0.24.Final//org.infinispan.marshall.protostream.impl.AbstractInternalProtoStreamMarshaller.objectToByteBuffer(AbstractInternalProtoStreamMarshaller.java:87)
at org.infin...@14.0.24.Final//org.infinispan.marshall.protostream.impl.AbstractInternalProtoStreamMarshaller.objectToByteBuffer(AbstractInternalProtoStreamMarshaller.java:92)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeRawUnknown(GlobalMarshaller.java:637)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeUnknown(GlobalMarshaller.java:626)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeUnknown(GlobalMarshaller.java:617)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNonNullableObject(GlobalMarshaller.java:383)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNullableObject(GlobalMarshaller.java:351)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.BytesObjectOutput.writeObject(BytesObjectOutput.java:26)
at org.infin...@14.0.24.Final//org.infinispan.cache.impl.BiFunctionMapper$Externalizer.writeObject(BiFunctionMapper.java:73)
at org.infin...@14.0.24.Final//org.infinispan.cache.impl.BiFunctionMapper$Externalizer.writeObject(BiFunctionMapper.java:59)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeInternal(GlobalMarshaller.java:655)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNonNullableObject(GlobalMarshaller.java:370)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNullableObject(GlobalMarshaller.java:351)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.BytesObjectOutput.writeObject(BytesObjectOutput.java:26)
at org.infin...@14.0.24.Final//org.infinispan.commands.write.ComputeCommand.writeTo(ComputeCommand.java:108)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandParameters(ReplicableCommandExternalizer.java:83)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:79)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(ReplicableCommandExternalizer.java:67)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeInternal(GlobalMarshaller.java:655)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNonNullableObject(GlobalMarshaller.java:370)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNullableObject(GlobalMarshaller.java:351)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.BytesObjectOutput.writeObject(BytesObjectOutput.java:26)
at org.infinis...@14.0.24.Final//org.infinispan.commons.marshall.MarshallUtil.marshallCollection(MarshallUtil.java:254)
at org.infinis...@14.0.24.Final//org.infinispan.commons.marshall.MarshallUtil.marshallCollection(MarshallUtil.java:232)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.writeTo(PrepareCommand.java:217)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandParameters(ReplicableCommandExternalizer.java:83)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.CacheRpcCommandExternalizer.marshallParameters(CacheRpcCommandExternalizer.java:154)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:150)
at org.infin...@14.0.24.Final//org.infinispan.marshall.exts.CacheRpcCommandExternalizer.writeObject(CacheRpcCommandExternalizer.java:85)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeInternal(GlobalMarshaller.java:655)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNonNullableObject(GlobalMarshaller.java:370)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeNullableObject(GlobalMarshaller.java:351)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeObjectOutput(GlobalMarshaller.java:180)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.writeObjectOutput(GlobalMarshaller.java:173)
at org.infin...@14.0.24.Final//org.infinispan.marshall.core.GlobalMarshaller.objectToBuffer(GlobalMarshaller.java:301)
at org.infin...@14.0.24.Final//org.infinispan.remoting.transport.jgroups.JGroupsTransport.marshallRequest(JGroupsTransport.java:1212)
at org.infin...@14.0.24.Final//org.infinispan.remoting.transport.jgroups.JGroupsTransport.sendCommandToAll(JGroupsTransport.java:1348)
at org.infin...@14.0.24.Final//org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeCommandOnAll(JGroupsTransport.java:1105)
at org.infin...@14.0.24.Final//org.infinispan.remoting.rpc.RpcManagerImpl.invokeCommandOnAll(RpcManagerImpl.java:266)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.distribution.TxDistributionInterceptor.prepareOnAffectedNodes(TxDistributionInterceptor.java:289)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.distribution.TxDistributionInterceptor.lambda$visitPrepareCommand$5(TxDistributionInterceptor.java:273)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenApply(BaseAsyncInterceptor.java:86)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.distribution.TxDistributionInterceptor.visitPrepareCommand(TxDistributionInterceptor.java:261)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenApply(BaseAsyncInterceptor.java:79)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.prepareHandler(EntryWrappingInterceptor.java:199)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.wrapEntriesForPrepareAndApply(EntryWrappingInterceptor.java:907)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.EntryWrappingInterceptor.visitPrepareCommand(EntryWrappingInterceptor.java:194)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:59)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.NotificationInterceptor.visitPrepareCommand(NotificationInterceptor.java:41)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextThenAccept(BaseAsyncInterceptor.java:103)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitPrepareCommand(PessimisticLockingInterceptor.java:121)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:59)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.TxInterceptor.handlePrepareCommand(TxInterceptor.java:141)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.TxInterceptor.visitPrepareCommand(TxInterceptor.java:115)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:59)
at org.infin...@14.0.24.Final//org.infinispan.statetransfer.TransactionSynchronizerInterceptor.visitCommand(TransactionSynchronizerInterceptor.java:41)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndHandle(BaseAsyncInterceptor.java:190)
at org.infin...@14.0.24.Final//org.infinispan.statetransfer.StateTransferInterceptor.handleTxCommand(StateTransferInterceptor.java:208)
at org.infin...@14.0.24.Final//org.infinispan.statetransfer.StateTransferInterceptor.visitPrepareCommand(StateTransferInterceptor.java:69)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:59)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:137)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:128)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:90)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:61)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.BatchingInterceptor.handleDefault(BatchingInterceptor.java:82)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:137)
at org.infin...@14.0.24.Final//org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:196)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.DDAsyncInterceptor.visitCommand(DDAsyncInterceptor.java:50)
at org.infin...@14.0.24.Final//org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invokeAsync(AsyncInterceptorChainImpl.java:220)
at org.infin...@14.0.24.Final//org.infinispan.transaction.impl.TransactionCoordinator.commit(TransactionCoordinator.java:176)
at org.infin...@14.0.24.Final//org.infinispan.transaction.impl.TransactionTable.afterCompletion(TransactionTable.java:903)
at org.infin...@14.0.24.Final//org.infinispan.transaction.synchronization.SynchronizationAdapter.asyncAfterCompletion(SynchronizationAdapter.java:67)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.afterCompletion(TransactionImpl.java:509)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.lambda$asyncAfterCompletion$10(TransactionImpl.java:499)
at java.base/java.util.concurrent.CompletableFuture.uniComposeStage(CompletableFuture.java:1187)
at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:2309)
at java.base/java.util.concurrent.CompletableFuture.thenCompose(CompletableFuture.java:144)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.asyncAfterCompletion(TransactionImpl.java:499)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.lambda$runCommitAsync$7(TransactionImpl.java:390)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934)
at java.base/java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:950)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:2340)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:144)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.runCommitAsync(TransactionImpl.java:389)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.lambda$commitAsync$0(TransactionImpl.java:170)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934)
at java.base/java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:950)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:2340)
at java.base/java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:144)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.commitAsync(TransactionImpl.java:170)
at org.infinis...@14.0.24.Final//org.infinispan.commons.tx.TransactionImpl.commit(TransactionImpl.java:150)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.ee.cache.tx.TransactionalBatch.close(TransactionalBatch.java:81)
at org.wildfly.clusteri...@31.0.1.Final//org.wildfly.clustering.server.infinispan.provider.CacheServiceProviderRegistry.registerLocal(CacheServiceProviderRegistry.java:145)
at org.wildfly.clusteri...@31.0.1.Final//org.wildfly.clustering.server.infinispan.provider.CacheServiceProviderRegistry$RegisterLocalServiceTask.run(CacheServiceProviderRegistry.java:265)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.ee.cache.retry.RetryingInvoker$1.get(RetryingInvoker.java:63)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.ee.cache.retry.RetryingInvoker$1.get(RetryingInvoker.java:60)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.ee.cache.retry.RetryingInvoker.invoke(RetryingInvoker.java:41)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.ee.cache.retry.RetryingInvoker.invoke(RetryingInvoker.java:67)
at org.wildfly.clusteri...@31.0.1.Final//org.wildfly.clustering.server.infinispan.provider.CacheServiceProviderRegistry.register(CacheServiceProviderRegistry.java:125)
at org.wildfly.cluster...@31.0.1.Final//org.wildfly.clustering.singleton.server.AbstractDistributedSingletonService.start(AbstractDistributedSingletonService.java:76)
at org.wildfly.cluster...@31.0.1.Final//org.wildfly.clustering.singleton.server.DistributedSingletonService.start(DistributedSingletonService.java:37)
at org.wildfly.clu...@31.0.1.Final//org.wildfly.clustering.service.AsyncServiceConfigurator$AsyncService.lambda$start$0(AsyncServiceConfigurator.java:100)
at org.jbos...@2.4.0.Final//org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jbos...@2.4.0.Final//org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1990)
at org.jbos...@2.4.0.Final//org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
at org.jbos...@2.4.0.Final//org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
at java.base/java.lang.Thread.run(Thread.java:840)
at org.jbos...@2.4.0.Final//org.jboss.threads.JBossThread.run(JBossThread.java:513)
Caused by: an exception which occurred:
in object org.wildfly.clustering.server.infinispan.provider.AddressSetAddFunction@ecb17daa

Thanks,

Toan.

[Nguyễn Toàn]

The root cause: it throws NotSerializabaleException for class  "org.wildfly.clustering.server.infinispan.provider.AddressSetAddFunction", but I don't know how to fix it.

[Nguyễn Toàn]

Root cause: I'm missing the upgrade the configuration for domain infinispan while upgrading from WF 22 to WF 31:

Change the singleton cache container to:

<cache-container name="server" default-cache="default" marshaller="PROTOSTREAM" aliases="singleton cluster" modules="org.wildfly.clustering.singleton.server">