Issue with LPPE and memcached ticket registry
Windham, Gary D - (windhamg)
--
Gary Windham
Principal Enterprise Systems Architect
University Information Technology Services
The University of Arizona
Email: wind...@email.arizona.edu
Office: +1 520 626 5981
Doug Campbell
Gary,
I don’t have an answer but I saw this same error yesterday when I was testing proxy authentication on my CAS 6.0.3 test setup. In my case I haven’t configured LPPE. I did try disabling it just now but that seemed to have no effect as the error still occurs. In my case I am using spymemcache and not AWS Elasticache. For now I have switched back to the default InMemory ticket registry and proxy authentication works fine with that.
If I figured out anything I will let you know and if you discover a solution please do report back.
Thanks!
--
- Website: https://apereo.github.io/cas
- Gitter Chatroom: https://gitter.im/apereo/cas
- List Guidelines: https://goo.gl/1VRrw7
- Contributions: https://goo.gl/mh7qDG
---
You received this message because you are subscribed to the Google Groups "CAS Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cas-user+u...@apereo.org.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/CABpeFHGDx0-TPBmE-tMCmpfcgvr1eSUMhQF0xygfka%3DxXxzKVA%40mail.gmail.com.
Doug Campbell
I don’t know if this is an ideal workaround but I found in my case if I changed the transcoder setting from KYRO to SERIAL that everything starting working great.
cas.ticket.registry.memcached.transcoder: SERIAL
In the documentation it recommends using KYRO stating “This component is recommended over the default Java serialization mechanism since it produces much more compact data, which benefits both storage requirements and throughput.” There are two other options as well: WHALIN and WHALINV1.
I am not sure if it really matters which one but since the use of KYRO seems buggy maybe the recommendation for using it is no longer the best.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/001201d4fe34%2459c9aa10%240d5cfe30%24%40gmail.com.
Windham, Gary D - (windhamg)
--
Gary Windham
Principal Enterprise Systems Architect
University Information Technology Services
The University of Arizona
Email: wind...@email.arizona.edu
Office: +1 520 626 5981
I don’t know if this is an ideal workaround but I found in my case if I changed the transcoder setting from KYRO to SERIAL that everything starting working great.
cas.ticket.registry.memcached.transcoder: SERIAL
In the documentation it recommends using KYRO stating “This component is recommended over the default Java serialization mechanism since it produces much more compact data, which benefits both storage requirements and throughput.” There are two other options as well: WHALIN and WHALINV1.
I am not sure if it really matters which one but since the use of KYRO seems buggy maybe the recommendation for using it is no longer the best.
From: cas-...@apereo.org [mailto:cas-...@apereo.org] On Behalf Of Doug Campbell
Sent: Monday, April 29, 2019 10:36 AM
To: cas-...@apereo.org
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/001201d4fe34%2459c9aa10%240d5cfe30%24%40gmail.com.
--
- Website: https://apereo.github.io/cas
- Gitter Chatroom: https://gitter.im/apereo/cas
- List Guidelines: https://goo.gl/1VRrw7
- Contributions: https://goo.gl/mh7qDG
---
You received this message because you are subscribed to the Google Groups "CAS Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cas-user+u...@apereo.org.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/001901d4fe3b%244c401260%24e4c03720%24%40gmail.com.
Julien Gribonvald
Hi,
To fix your problem you have to register the missing class, here
is a PR to get as example to register some missing class
https://github.com/apereo/cas/pull/3857/files. So you can
contribute ?
After my point of view is that's a problem that KRYO need to
register all class to serialize them, but it doesn't seem to have
an other way. After there is a good beneit to use KRYO as his
serialization is more efficient than the default one.
Thanks,
Julien
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/CABpeFHFPqf5pWspLfmx%2B-ncZZ4AE5WafMduJ_XmQPCCk%2BqNBHA%40mail.gmail.com.
Julien Gribonvald
Doug Campbell
Thanks Julien.
I think I understand what is needed to be done for registering the missing class but I have no idea how to deploy a change to test it. I’m using the cas-webapp-docker to deploy to Docker using cas-overlay-template. If were able to give me some pointers as to how to test these changes I would go ahead and try to make this work on the 6.0.x branch.
Doug
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/90f4c6dd-6b79-719e-d2d2-2dcd5a3a3c31%40recia.fr.
Ray Bon
--
Julien Gribonvald
Ray I'm not sure that will work with the cas-overlay-template done with gradle.
On my side I cloned the CAS repository following the documentation and I publish to my nexus, but with docker :
- clone the cas project and apply change and publish them to your
git repo
- clone this git repo on your docker file and run commands like
locally following the doc, inside the module you will have to
build and install locally the change (command example to build
this kind of module and to install it locally : ../../gradlew
clean build install --configure-on-demand --build-cache --parallel
-x test -x javadoc -x check --stacktrace
-DskipNestedConfigMetadataGen=true -DskipGradleLint=true), like
that your cas build from the cas-overlay-template will be able to
use your change.
Julien
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/2c9626035aa380768d86806c275a7035bb5abcb5.camel%40uvic.ca.
Julien Gribonvald
Doug Campbell
Thanks guys this got me on the right track.
I first tried what Ray suggested but was having difficulties. I then adjusted and tried Julien’s approach and saw success once I downgraded my Java version. I then went back and tried Ray’s suggestion and was successful except that I had to put the files in the src/main/resources directory not src/main/java.
Anyway, I think I am starting to understand this though I want to write myself some step-by-step instructions and will probably go ahead and post those back.
Appreciate your help!
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/9048625a-584e-9afe-32d5-3d6fa4fadf17%40recia.fr.
Doug Campbell
Correction. I think I had things cached. It doesn’t work to put the files in src/main/resources.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/004b01d50100%24fb642610%24f22c7230%24%40gmail.com.
Ray Bon
Doug Campbell
Ray,
I want to modify cas/support/cas-server-support-memcached-core/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java.
Doug
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/325c903edd43c3afe97f4a6709dd443c38256061.camel%40uvic.ca.
Ray Bon
Doug Campbell
Ray,
That got me a little further along but when I try to build (./gradlew clean build) I get a lot of errors. I have tried adding compile dependencies which has reduce the number of errors but now I am stuck.
This is what I am seeing in terms of errors:
> Task :compileJava FAILED
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:147: error: incompatible types: CloseableKryo cannot be converted to val
val kryo = new CloseableKryo(this.kryoPool);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:148: error: cannot find symbol
kryo.setInstantiatorStrategy(new Kryo.DefaultInstantiatorStrategy(new StdInstantiatorStrategy()));
^
symbol: class DefaultInstantiatorStrategy
location: class Kryo
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:149: error: cannot find symbol
kryo.setWarnUnregisteredClasses(this.warnUnregisteredClasses);
^
symbol: method setWarnUnregisteredClasses(boolean)
location: variable kryo of type val
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:150: error: cannot find symbol
kryo.setAutoReset(this.autoReset);
^
symbol: method setAutoReset(boolean)
location: variable kryo of type val
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:151: error: cannot find symbol
kryo.setReferences(this.replaceObjectsByReferences);
^
symbol: method setReferences(boolean)
location: variable kryo of type val
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:152: error: cannot find symbol
kryo.setRegistrationRequired(this.registrationRequired);
^
symbol: method setRegistrationRequired(boolean)
location: variable kryo of type val
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:154: error: cannot find symbol
LOGGER.debug("Constructing a kryo instance with the following settings:");
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:155: error: cannot find symbol
LOGGER.debug("warnUnregisteredClasses: [{}]", this.warnUnregisteredClasses);
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:156: error: cannot find symbol
LOGGER.debug("autoReset: [{}]", this.autoReset);
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:157: error: cannot find symbol
LOGGER.debug("replaceObjectsByReferences: [{}]", this.replaceObjectsByReferences);
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:158: error: cannot find symbol
LOGGER.debug("registrationRequired: [{}]", this.registrationRequired);
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:160: error: incompatible types: val cannot be converted to Kryo
registerCasAuthenticationWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:161: error: incompatible types: val cannot be converted to Kryo
registerExpirationPoliciesWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:162: error: incompatible types: val cannot be converted to Kryo
registerCasTicketsWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:163: error: incompatible types: val cannot be converted to Kryo
registerNativeJdkComponentsWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:164: error: incompatible types: val cannot be converted to Kryo
registerCasServicesWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:165: error: incompatible types: val cannot be converted to Kryo
registerImmutableOrEmptyCollectionsWithKryo(kryo);
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:167: error: cannot find symbol
LOGGER.trace("Registering serializable class [{}] with Kryo", c.getName());
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:168: error: cannot find symbol
kryo.register(c);
^
symbol: method register(Class)
location: variable kryo of type val
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:170: error: incompatible types: val cannot be converted to Kryo
return kryo;
^
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:174: error: cannot find symbol
LOGGER.debug("Registering immutable/empty collections with Kryo");
^
symbol: variable LOGGER
location: class CloseableKryoFactory
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:187: error: incompatible types: no instance(s) of type variable(s) T exist so that Set<T> conforms to val
val singletonSet = Collections.singleton("key");
^
where T is a type-variable:
T extends Object declared in method <T>singleton(T)
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:190: error: incompatible types: no instance(s) of type variable(s) K,V exist so that Map<K,V> conforms to val
val singletonMap = Collections.singletonMap("key", "value");
^
where K,V are type-variables:
K extends Object declared in method <K,V>singletonMap(K,V)
V extends Object declared in method <K,V>singletonMap(K,V)
/cas-overlay/src/main/java/org/apereo/cas/memcached/kryo/CloseableKryoFactory.java:193: error: incompatible types: no instance(s) of type variable(s) T exist so that List<T> conforms to val
val list = Arrays.asList("key");
^
where T is a type-variable:
T extends Object declared in method <T>asList(T...)
Note: Some messages have been simplified; recompile with -Xdiags:verbose to get full output
24 errors
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/c0ef68e94ec42d0d809418058ac272f9718524b7.camel%40uvic.ca.
Ray Bon
Doug Campbell
Ray,
That didn’t seem to change anything. Here is what I have added in the dependencies section of build.gradle:
compileOnly group: 'org.projectlombok', name: 'lombok', version: '1.18.2'
compile "com.esotericsoftware:kryo:4.0.2"
compile group: 'com.esotericsoftware', name: 'kryo-shaded', version: '4.0.2'
compile group: 'de.javakaffee', name: 'kryo-serializers', version: '0.42'
compile "org.apereo.cas:cas-server-core-authentication-api:${casServerVersion}"
compile "org.apereo.cas:cas-server-core-authentication-attributes:${casServerVersion}"
compile "org.apereo.cas:cas-server-core-services-authentication:${casServerVersion}"
compile "org.apereo.cas:cas-server-core-services-api:${casServerVersion}"
compile "org.apereo.cas:cas-server-core-tickets-api:${casServerVersion}"
compile "org.apereo.cas:cas-server-core-util-api:${casServerVersion}"
compile "org.apereo.cas:cas-server-support-memcached-core:${casServerVersion}"
I came up with this based on looking at the error messages I saw and guessing what packages were needed.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/9d5f2c54556bb0125cadab59a1ef397d9ffa9ae3.camel%40uvic.ca.
Ray Bon
Doug Campbell
Okay. I finally figured it out this time J This is actually tested and confirmed to work.
Here are the steps:
1. Create the directory structure src/main/java under the cas-overlay directory.
2. Further create the directory structure of your project under src/main/java.
In my case since I was working on the CloseableKryoFactory.java file of the cas-server-support-memcache-core module code I created the same directory structure as in the apereo cas source code under src/main/java which is org/apereo/cas/memcached/kryo.
3. Add the files that you are changing into their appropriate places in the directory structure under src/main/java.
In my case I added CloseableKryoFactory.java under src/main/java/org/apereo/cas/memcached/kryo.
4. Make necessary changes to file(s).
5. Now in order to build you need to add at least the gradle-lombox plugin to the dependencies.
This is done by modifying build.gradle with the highlighted lines:
buildscript {
…
dependencies {
…
classpath "io.franzbecker:gradle-lombok:$gradleLombokVersion"
}
}
apply plugin: "io.franzbecker.gradle-lombok"
lombok {
version = "$lombokVersion"
}
Note: The version used for gradle-lombok and lombok can be obtained from the gradle.properties file in the apereo cas source root directory.
6. In addition to this change in the build.gradle, it was also necessary to provide the lombok.config file from the apereo cas source root directory and put it in the cas-overlay directory.
7. Then you will also need to add any other dependencies to the build.gradle file. You should add these using compileOnly since they are already provided. In the case of the changes I was making I figured out through trial and error that I needed the following dependencies (not sure if there is a faster/easier way to determine this or not). I ended up needing the following dependencies:
compileOnly "com.esotericsoftware:kryo:4.0.2"
compileOnly "de.javakaffee:kryo-serializers:0.42"
compileOnly "org.apereo.cas:cas-server-support-memcached-core:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-authentication-attributes:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-authentication-api:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-services-api:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-services-authentication:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-tickets-api:${casServerVersion}"
compileOnly "org.apereo.cas:cas-server-core-util-api:${casServerVersion}"
Now running ./gradlew clean build should cause everything will build nicely.
Alternate Method
The other way I did this was to create the .jar file and then deploy that into the overlay.
I used the method Julien indicated of cloning the cas project and then making changes to the file(s). I then ran the following from the module directory (cas/support/cas-server-support-memcached-core in my case):
../../gradlew clean build --configure-on-demand --build-cache --parallel -x test -x javadoc -x check --stacktrace -DskipNestedConfigMetadataGen=true -DskipGradleLint=true
The .jar file then is created in the build/libs sub-directory.
I created src/libs under the cas-overlay and copy the generated .jar file to it. It doesn’t actually matter where I put the .jar file. I just thought this seemed to make sense.
Then I modified build.gradle and added the following to the dependencies to pick up this local .jar
compile files('src/libs/cas-server-support-memcached-core-6.0.3.jar')
Again running ./gradlew clean build should cause everything will build nicely.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/cas-user/861e54d1a1ab001ab7fee4e0adc1c2b9879d5059.camel%40uvic.ca.