Serializable and not serializable lambdas

9 views
Skip to first unread message

Pranas Baliuka

unread,
Sep 15, 2020, 8:56:03 PM9/15/20
to hazelcast-jet
I'd like to know bit more about how class loader works in JET.
Is it safe to assume what if all nodes started with code available in original process class path the serializable is optional for the lambdas used in JET jobs?

Thanks!

Viliam Durina

unread,
Sep 16, 2020, 5:16:57 AM9/16/20
to Pranas Baliuka, hazelcast-jet
Jet jobs can use any of these classes:
- available on member's classpath (e.g. through adding a jar to the `lib` folder)
- uploaded using Hazelcast Code Deployment
- added through JobConfig.addClass/addJar

The advantage of the last option is that the code is restricted for that particular job and can be updated without restarting the cluster.

The code availability has nothing to do with serializability of lambdas, you need both: Your lambdas need to be serializable (especially the state they capture) and their code available.

Viliam

Visit our website at http://www.algoteq.com

Privileged/Confidential information may be contained in this message and may be subject to legal privilege. Access to this e-mail by anyone other than the intended is unauthorised. If you are not the intended recipient (or responsible for delivery of the message to such person), you may not use, copy, distribute or deliver to anyone this message (or any part of its contents) or take any action in reliance on it. In such case, you should destroy this message, and notify us immediately. If you have received this email in error, please notify us immediately by e-mail and delete the e-mail from your computer. If you or your employer does not consent to internet e-mail messages of this kind, please notify us immediately. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. As Algoteq Pty Ltd cannot accept responsibility for any loss or damage arising from the use of this e-mail or attachments we recommend that you subject these to your virus checking procedures prior to use. The views, opinions, conclusions and other informations expressed in this electronic mail are not given or endorsed by the company unless otherwise indicated by an authorised representative independent of this message.

--
You received this message because you are subscribed to the Google Groups "hazelcast-jet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast-je...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast-jet/49a65e53-fa2c-41a5-b05c-4137ec79a84cn%40googlegroups.com.


--
Viliam Durina
Jet Developer
      hazelcast®
 
 
2 W 5th Ave, Ste 300 | San Mateo, CA 94402 | USA
+1 (650) 521-5453 | hazelcast.com

This message contains confidential information and is intended only for the individuals named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required, please request a hard-copy version. -Hazelcast
Reply all
Reply to author
Forward
0 new messages