MicroProfile and Jakarta EE AI plan

[Emily Jiang]

The AI topic came up in both MicroProfile and Jakarta EE meetings. The MicroProfile AI group was set up in 1Q 2024 and the group has made significant progress towards writing MicroProfile and Jakarta EE AI-infused applications connecting with a LLM via configuration. The weekly discussions and recordings can be accessed here.

The MicroProfile AI group evaluated some Java AI libraries and also attempted to create a new set of APIs. After some investigation and prototype, the MicroProfile AI group decided to adopt the defacto standard Langchain4J and concentrated on the integration of Langchain4J with Jakarta CDI, MicroProfile Fault Tolerance, MicroProfile Telemetry, etc. In this way, the Java communities can work together and put wisdom in one place. You can see the prototype here. As part of the prototype, a sample application was developed to work with some popular runtimes including Liberty, Quarkus, Helidon and Glassfish. You can try out the samples from here.

The prototype is nearly wrapped up. Now it is time to discuss a potential home for the integration. 

Option 1: contribute to the codebase of langchain4j and place it under a repo like langchain4j-microprofile-jakarta, leveling up with langchain4j-spring. Both Jakarta and MicroProfile communities can freely contribute and promote this work.

Option 2: place this integration under the MicroProfile github repo as a library.

It seems Option 1 has a greater advantage. We will discuss this further at the next week's MP AI call on Monday. The call details are in the MP Calendar. Please join the discussion if you would like to share your point of view. Please comment if you have any thoughts on this.

Thanks

Emily

--

Thanks
Emily

[Reza Rahman]

The Microsoft position is captured well here: https://docs.google.com/document/d/14kSPRzEb0_BXrow1ej7Z6cus23uWypR_NcoegimJaBA/edit.

We are working through all channels in the hopes of building momentum towards the direction we would like to see.

---

From: 'Emily Jiang' via MicroProfile <microp...@googlegroups.com>
Sent: Wednesday, February 5, 2025 9:15 AM
To: MicroProfile <microp...@googlegroups.com>; jakartaee-platform developer discussions <jakartaee-p...@eclipse.org>
Subject: [microprofile] MicroProfile and Jakarta EE AI plan

 

--
You received this message because you are subscribed to the Google Groups "MicroProfile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to microprofile...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/microprofile/CAECq3A8o7AUqS1er7i3tSmFrG0Dux2-JHO_D5THeciRwqmFCyA%40mail.gmail.com.

[Kito D. Mann]

I think Option 1 is the best choice... I think it'd actually raise visibility for MicroProfile / JakartaEE with respect to AI applications, and gives us a space to grow (and perhaps collaborate) with the Spring integration efforts.

___

Kito D. Mann | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.