CAS 6.5.2 hazelcast throttle not working

[erik.m...@gmail.com]

Hazelcast for throttling is not working.
Here are my settings, and below the settings is the long long error.
Help is appreciated.

#Authentication Throttling
cas.authn.throttle.core.username-parameter=username
cas.authn.throttle.core.app-code=CAS
cas.authn.throttle.failure.threshold=100
cas.authn.throttle.failure.code=AUTHENTICATION_FAILED
cas.authn.throttle.failure.range-seconds=60
##
#Hazelcast for Throttling
#cas.authn.throttle.hazelcast.cluster.network.members=10.0.79.37,10.0.7
9.38,10.79.50
cas.authn.throttle.hazelcast.cluster.network.local-address='10.0.79.37'
cas.authn.throttle.hazelcast.cluster.network.members=10.0.79.37
cas.authn.throttle.hazelcast.cluster.core.instance-name=cas-thrt
cas.authn.throttle.hazelcast.cluster.network.port=5704
cas.authn.throttle.hazelcast.cluster.network.tcpip-enabled=true
cas.authn.throttle.hazelcast.cluster.network.port-auto-increment=false
cas.authn.throttle.hazelcast.cluster.core.eviction-policy=LRU
cas.authn.throttle.hazelcast.cluster.core.max-no-heartbeat-seconds=300
cas.authn.throttle.hazelcast.cluster.core.logging-type=log4j
cas.authn.throttle.hazelcast.cluster.core.max-size=85
cas.authn.throttle.hazelcast.cluster.core.max-size-
policy=USED_HEAP_PERCENTAGE
cas.authn.throttle.hazelcast.cluster.core.timeout=5
cas.authn.throttle.hazelcast.cluster.core.backup-count=1
cas.authn.throttle.hazelcast.cluster.core.async-backup-count=0
cas.authn.throttle.hazelcast.cluster.core.async-fillup=true
#cas.authn.throttle.hazelcast.enable-compression=false
#cas.authn.throttle.hazelcast.enable-management-center-scripting=false

ERROR
[org.springframework.scheduling.support.TaskUtils$LoggingErrorHandler]
- <Unexpected error occurred in scheduled task>
com.hazelcast.nio.serialization.HazelcastSerializationException: Failed
to serialize
'com.hazelcast.spi.impl.operationservice.impl.operations.PartitionItera
tingOperation'
at
com.hazelcast.internal.serialization.impl.SerializationUtil.handleSeria
lizeException(SerializationUtil.java:129) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
toBytes(AbstractSerializationService.java:238) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
toBytes(AbstractSerializationService.java:214) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
toBytes(AbstractSerializationService.java:205) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.OutboundOperationHandler.t
oPacket(OutboundOperationHandler.java:63) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.OutboundOperationHandler.s
end(OutboundOperationHandler.java:58) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeRemote(
Invocation.java:611) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke(Invoca
tion.java:581) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0(Invocat
ion.java:540) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke(Invocati
on.java:240) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invo
ke(InvocationBuilderImpl.java:59) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.InvokeOnPartitions.invokeO
nAllPartitions(InvokeOnPartitions.java:120) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.InvokeOnPartitions.invokeA
sync(InvokeOnPartitions.java:98) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.InvokeOnPartitions.invoke(
InvokeOnPartitions.java:87) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.OperationServiceImpl.invok
eOnAllPartitions(OperationServiceImpl.java:410) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.map.impl.proxy.MapProxySupport.removeAllInternal(MapProxy
Support.java:699) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.map.impl.proxy.MapProxyImpl.removeAll(MapProxyImpl.java:2
90) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
org.apereo.cas.web.support.HazelcastMapThrottledSubmissionsStore.remove
If(HazelcastMapThrottledSubmissionsStore.java:24) ~[cas-server-support-
throttle-hazelcast-6.5.2.jar!/:6.5.2]
at
org.apereo.cas.web.support.AbstractInMemoryThrottledSubmissionHandlerIn
terceptorAdapter.decrement(AbstractInMemoryThrottledSubmissionHandlerIn
terceptorAdapter.java:76) ~[cas-server-support-throttle-core-
6.5.2.jar!/:6.5.2]
at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
~[?:?]
at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:19
5) ~[?:?]
at
java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:17
7) ~[?:?]
at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.jav
a:1655) ~[?:?]
at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java
:474) ~[?:?]
at
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.jav
a:150) ~[?:?]
at
java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachO
ps.java:173) ~[?:?]
at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]
at
java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
~[?:?]
at
org.apereo.cas.web.support.InMemoryThrottledSubmissionCleaner.run(InMem
oryThrottledSubmissionCleaner.java:28) ~[cas-server-support-throttle-
core-6.5.2.jar!/:6.5.2]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method) ~[?:?]
at
jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess
orImpl.java:62) ~[?:?]
at
jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth
odAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
at
org.springframework.scheduling.support.ScheduledMethodRunnable.run(Sche
duledMethodRunnable.java:84) ~[spring-context-5.3.18.jar!/:5.3.18]
at
org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.
run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-
5.3.18.jar!/:5.3.18]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
~[?:?]
at
java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.ru
n(ScheduledThreadPoolExecutor.java:305) ~[?:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.ja
va:1128) ~[?:?]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.j
ava:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by:
com.hazelcast.nio.serialization.HazelcastSerializationException: Failed
to serialize
'com.hazelcast.map.impl.operation.PartitionWideEntryWithPredicateOperat
ionFactory'
at
com.hazelcast.internal.serialization.impl.SerializationUtil.handleSeria
lizeException(SerializationUtil.java:129) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
writeObject(AbstractSerializationService.java:334) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.ByteArrayObjectDataOutput.wri
teObject(ByteArrayObjectDataOutput.java:402) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.operations.PartitionIterat
ingOperation.writeInternal(PartitionIteratingOperation.java:115)
~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.Operation.writeData(Operation.j
ava:709) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:244) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:51) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.write
(StreamSerializerAdapter.java:39) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
toBytes(AbstractSerializationService.java:235) ~[hazelcast-
5.0.2.jar!/:5.0.2]
... 40 more
Caused by:
com.hazelcast.nio.serialization.HazelcastSerializationException: Failed
to serialize
'org.apereo.cas.web.support.HazelcastMapThrottledSubmissionsStore$$Lamb
da$3420/0x0000000841191c40'
at
com.hazelcast.internal.serialization.impl.SerializationUtil.handleSeria
lizeException(SerializationUtil.java:129) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
writeObject(AbstractSerializationService.java:334) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.ByteArrayObjectDataOutput.wri
teObject(ByteArrayObjectDataOutput.java:402) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.map.impl.operation.PartitionWideEntryWithPredicateOperati
onFactory.writeData(PartitionWideEntryWithPredicateOperationFactory.jav
a:109) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:244) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:51) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.write
(StreamSerializerAdapter.java:39) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
writeObject(AbstractSerializationService.java:332) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.ByteArrayObjectDataOutput.wri
teObject(ByteArrayObjectDataOutput.java:402) ~[hazelcast-
5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.impl.operations.PartitionIterat
ingOperation.writeInternal(PartitionIteratingOperation.java:115)
~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.spi.impl.operationservice.Operation.writeData(Operation.j
ava:709) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:244) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.DataSerializableSerializer.wr
ite(DataSerializableSerializer.java:51) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.write
(StreamSerializerAdapter.java:39) ~[hazelcast-5.0.2.jar!/:5.0.2]
at
com.hazelcast.internal.serialization.impl.AbstractSerializationService.
toBytes(AbstractSerializationService.java:235) ~[hazelcast-
5.0.2.jar!/:5.0.2]
... 40 more
Caused by: java.io.NotSerializableException:
org.apereo.cas.web.support.AbstractInMemoryThrottledSubmissionHandlerIn
terceptorAdapter$$Lambda$3419/0x0000000841191840
--
--

Erik Mallory
--
"A happy man's paradise is his own good nature."
Edward Abbey

[erik.m...@gmail.com]

Hazelcast for throttling is not working.

Here are my settings, and below the settings is the error.

.....

[Mallory, Erik]

Hello,

--
Erik Mallory
Server Analyst
Wichita State University

[erik.m...@gmail.com]

Possibly related:
I find when I configure the following:
cas.authn.throttle.schedule.start-delay=PT15S
cas.authn.throttle.schedule.repeat-interval=PT2M

hazelcast for tickets will not start as well.
{uuid=c50a7ff2-aada-46df-9b27-7becfb0b82ef, partitionId=84,
source=[10.0.79.37]:5701 - 3d6b7b52-1e7b-4d02-86cf-20646660c0dc,
sourceCurrentReplicaIndex=0, sourceNewReplicaIndex=-1,
destination=[10.0.79.38]:5701 - 98a372bd-9e6c-4392-83d4-0f53bc20999e,
destinationCurrentReplicaIndex=2, destinationNewReplicaIndex=0,
master=[10.0.79.38]:5701, initialPartitionVersion=54,
partitionVersionIncrement=2, status=SUCCESS}>
2022-04-19 14:48:20,284 DEBUG
[com.hazelcast.internal.partition.InternalPartitionService] -
<[10.0.79.37]:5701 [dev] [5.0.2] Applied completed migrations with
partition state stamp: -8849522026878563695>
2022-04-19 14:48:20,284 DEBUG
[com.hazelcast.internal.partition.InternalPartitionService] -
<[10.0.79.37]:5701 [dev] [5.0.2] Applied completed migrations with
partition state stamp: -8849522026878563695>
2022-04-19 14:48:20,285 DEBUG [com.hazelcast.instance.impl.Node] -
<[10.0.79.37]:5701 [dev] [5.0.2] Graceful shutdown completed for
InternalPartitionService {stamp: -8849522026878563695, migrationQ: 0}>
2022-04-19 14:48:20,285 DEBUG
[com.hazelcast.internal.cluster.ClusterService] - <[10.0.79.37]:5701
[dev] [5.0.2] Setting master address to null>
2022-04-19 14:48:20,285 INFO [com.hazelcast.instance.impl.Node] -
<[10.0.79.37]:5701 [dev] [5.0.2] Shutting down connection manager...>
2022-04-19 14:48:20,286 INFO
[com.hazelcast.internal.server.tcp.TcpServerConnection] -
<[10.0.79.37]:5701 [dev] [5.0.2] Connection[id=1, /10.0.79.37:46505-
>/10.0.79.38:5701, qualifier=null, endpoint=[10.0.79.38]:5701,
alive=false, connectionType=MEMBER, planeIndex=0] closed. Reason:
TcpServer is stopping>
2022-04-19 14:48:20,288 INFO
[com.hazelcast.internal.server.tcp.TcpServerConnection] -
<[10.0.79.37]:5701 [dev] [5.0.2] Connection[id=2, /10.0.79.37:5701-
>/10.0.79.50:45633, qualifier=null, endpoint=[10.0.79.50]:5701,
alive=false, connectionType=MEMBER, planeIndex=0] closed. Reason:
TcpServer is stopping>
2022-04-19 14:48:20,289 INFO [com.hazelcast.instance.impl.Node] -
<[10.0.79.37]:5701 [dev] [5.0.2] Shutting down node engine...>
2022-04-19 14:48:20,301 DEBUG
[com.hazelcast.internal.cluster.ClusterService] - <[10.0.79.37]:5701
[dev] [5.0.2] Setting master address to null>
2022-04-19 14:48:23,310 INFO
[com.hazelcast.instance.impl.NodeExtension] - <[10.0.79.37]:5701 [dev]
[5.0.2] Destroying node NodeExtension.>
2022-04-19 14:48:23,310 INFO [com.hazelcast.instance.impl.Node] -
<[10.0.79.37]:5701 [dev] [5.0.2] Hazelcast Shutdown is completed in
3191 ms.>
2022-04-19 14:48:23,310 INFO [com.hazelcast.core.LifecycleService] -
<[10.0.79.37]:5701 [dev] [5.0.2] [10.0.79.37]:5701 is SHUTDOWN>

If I comment out the two options above, hazelcast for tickets works.
hazelcast for throttles doesn't work in any case.

On Wed, 2022-04-13 at 18:21 +0000, 'Mallory, Erik' via CAS Community
wrote:

[Mallory, Erik]

--
Erik Mallory
Server Analyst
Wichita State University

On Wed, 2022-04-13 at 18:21 +0000, 'Mallory, Erik' via CAS Community
wrote:

> Hello,
> Hazelcast for throttling is not working.
> Here are my settings, and below the settings is the error.
> Help is appreciated.
>
> #Authentication Throttling
> cas.authn.throttle.core.username-parameter=username
> cas.authn.throttle.core.app-code=CAS
> cas.authn.throttle.failure.threshold=100
> cas.authn.throttle.failure.code=AUTHENTICATION_FAILED
> cas.authn.throttle.failure.range-seconds=60
> ##
> #Hazelcast for Throttling

> #cas.authn.throttle.hazelcast.cluster.network.members=10.0.79.37,10.0
> .7
> 9.38,10.79.50
> cas.authn.throttle.hazelcast.cluster.network.local-

> address='10.0.79.37'
> cas.authn.throttle.hazelcast.cluster.network.members=10.0.79.37
> cas.authn.throttle.hazelcast.cluster.core.instance-name=cas-thrt
> cas.authn.throttle.hazelcast.cluster.network.port=5704
> cas.authn.throttle.hazelcast.cluster.network.tcpip-enabled=true

> cas.authn.throttle.hazelcast.cluster.network.port-auto-
> increment=false
> cas.authn.throttle.hazelcast.cluster.core.eviction-policy=LRU
> cas.authn.throttle.hazelcast.cluster.core.max-no-heartbeat-
> seconds=300