AI discussion

[Emily Jiang]

In yesterday's MicroProfile Live Hangout (minutes here), Reza brought up the idea of embracing OpenAI libraries in MicroProfile and the idea was welcomed and discussed briefly. At the call, we decided to have some offline discussion on this mailinglist to accommodate the ones who could not make the calls and then further discuss at next week's technical call.

As you may know, recently, Spring has provided Spring AI to create AI applications (see code here) and it seems that a lot of attention was drawn. The other project langchain4j is also very popular, which is to simplify the integration of AI/LLM capabilities. Spring has also provided an example of working with Langchain4j.

I have a few ideas:

1. Provide MicroProfile AI programming model to develop AI applications

2. Provide some APIs if needed to connect with LLMs, which might use Langchain4j

3. Integrate with some other popular OpenAI libraries

Any thoughts?

--

Thanks
Emily

[Reza Rahman]

Thanks Emily! Depending on what the direction and interest level is, Microsoft could potentially invest some engineering resources into this. I’ll be observing carefully for now.

---

From: 'Emily Jiang' via MicroProfile <microp...@googlegroups.com>
Sent: Wednesday, January 24, 2024 6:04 AM
To: MicroProfile <microp...@googlegroups.com>
Subject: [microprofile] AI discussion

 

--
You received this message because you are subscribed to the Google Groups "MicroProfile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to microprofile...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CAECq3A8K4Kp5sS6nDiAM2FTrAwUZLPbwwYSHUWCaVYkEhVSyqg%40mail.gmail.com.

[Kito Mann]

Hello Emily,

I think this is a great area for MicroProfile to jump into.

I should point out that it's worthwhile to look at the existing Quarkus extension for this. 

Also, it would be smart to loop in Frank Greco and Zoran Severac (spec leads for JSR 381: Visual Recognition (VisRec) Specification). I've had some chats with them about LangChain4J and they have some good insight. I have cc'd them here in case they want to chime in.

___

Kito D. Mann | @kito99 | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/SJ0PR84MB2255BBBA76A97B6C2E2747A1A87B2%40SJ0PR84MB2255.NAMPRD84.PROD.OUTLOOK.COM.

[Martijn Verburg]

Microsoft's Java SDK for Semantic Kernel is another framework (https://devblogs.microsoft.com/semantic-kernel/introducing-semantic-kernel-for-java/) - I suspect it will go GA within the sort of timeframes that Microprofile is looking at.

This space is obviously *very* fast moving and challenging to pin down, Reza will be able to assist with whatever insights Microsoft can share going forwards :-).

Cheers,
Martijn

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/1880a846-b403-498c-b02d-bb7c19ccdac1%40Spark.

[Emmanuel Bernard]

During your conversations did you touch on why openAI specifically? Why choose a specific vendor as target?

[Mark Little]

+1

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CANYWk7PqzudZCMuaEkHZ2w5eg79WFxn_LEO842K6UMc-X5VSng%40mail.gmail.com.

---
Mark Little
mli...@redhat.com

JBoss, by Red Hat
Registered Address: Red Hat Ltd, 6700 Cork Airport Business Park, Kinsale Road, Co. Cork.
Registered in the Companies Registration Office, Parnell House, 14 Parnell Square, Dublin 1, Ireland, No.304873

[Emily Jiang]

Hi Emmanuel,

On Thursday, January 25, 2024 at 9:02:15 AM UTC Emmanuel Bernard wrote:

During your conversations did you touch on why openAI specifically? Why choose a specific vendor as target?

Nope. Reza and co. might be able to elaborate a bit more here. I just listed the discussion topics for further offline discussion. You were quite right to point it out the vendor choices. Personally, we should define a programming model in a vendor neutral way so that the impl can pull in any AI vendors they want. I think investigating on Langchain4j,  Hugging Face, etc is a worthwhile exercise. We will spend a bit more time to brainstorm in the next Tuesday's MP technical call. Please join if you can.

Thanks

Emily

[Emily Jiang]

Thank you for sharing Kito! I did not know about JSR 381's interest in LangChain4. I will talk to Zoran and Frank to find a bit more.

Martijn, thanks for sharing the Java SDK project here. Sounds like it only works on Microsoft's Java SDK, which might not be better fit for this. If the effort is made to OpenJDK, it would be awesome.

Thank you all for sharing the info! I have learned quite a bit already.

Emily

[Reza Rahman]

No specific reason. OpenAI is the one we are obviously most familiar with and what would be easiest to find resources for. Other approaches are of course also fine but we may not be able to assist directly.

---

From: 'Emily Jiang' via MicroProfile <microp...@googlegroups.com>
Sent: Friday, January 26, 2024 5:45 AM
To: MicroProfile <microp...@googlegroups.com>
Subject: Re: [microprofile] AI discussion

 

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/b506f9d3-105d-4514-bf1c-83213f0a879bn%40googlegroups.com.

[Reza Rahman]

Hi folks,

As discussed in the Community Call today, as part of the Yearly Program
Plan, we agreed to set up measurable metrics for marketing. To that end,
we need to collectively decide on one/two metrics. The idea is to put
these on a live dashboard. The dashboard could be public or Working
Group private. The dashboard will be driven by a database that is
automatically updated on a periodic basis. I will set all this up. Note,
the metrics we decide for marketing could also serve as the metrics
overall for MicroProfile.

Here are the candidates discussed so far. Please feel free to suggest
others.

* Adoption according to credible industry surveys that measure
MicroProfile (such as the annual Jakarta EE survey:
https://newsroom.eclipse.org/news/announcements/eclipse-foundation-releases-2023-jakarta-ee-developer-survey-report).
* Google Trends:
https://trends.google.com/trends/explore?date=2016-09-01%202024-01-31&q=MicroProfile
* Job postings: https://www.indeed.com/jobs?q=MicroProfile
* MicroProfile web site visits
* Social media following
* MicroProfile Starter usage

Can you kindly chime in? I would like to close on one/two metrics in no
more than two/three weeks.

Thanks,

Reza

[Reza Rahman]

In the spirit of getting things started, I think it's sufficient to
simply begin tracking Google Trends for now. What do others think?

[Kito Mann]

+1 

We've got to start somewhere...

___

Kito D. Mann | @kito99 | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.

--
You received this message because you are subscribed to the Google Groups "MicroProfile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to microprofile...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/322cfa4b-861d-40ca-83fe-202d9c43cf9c%40gmail.com.

[Reza Rahman]

What others think? Unless I hear otherwise by next week I suggest Google Trends as a pretty good way forward.

[Vincent Mayers]

sure lets start there

Cheers

Vincent 

@vincentmayers

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/e32b7b6b-f714-4163-a93a-ef59ebcc46bc%40gmail.com.

[Emily Jiang]

Further to last week's technical hangout, I have created this doodle poll for you to add your name and availability if you are interested in further collaboration. We will then set up a few calls to brainstorm AI support. 

Thanks,

Emily

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/SJ0PR84MB225594B9F25B5BD8CB179D4FA8792%40SJ0PR84MB2255.NAMPRD84.PROD.OUTLOOK.COM.

--

Thanks
Emily

[Emily Jiang]

Based on the doodle poll, the best slot is Monday 18th March 4pm-4:30pm. I have schedule a call for us to get together.

Join Zoom Meeting https://eclipse.zoom.us/j/83815795087 

Meeting ID: 838 1579 5087

You can find the full details from the MP Calendar here. Hope to see you there!

Thanks

Emily

[Buhake Sindi]

Hi everyone,

I don't know if this is the correct platform. I've recently published a list of AI client libraries for various AI services:

They both feature:

1. Java JDK 17+
2. Jakarta JSON-B for JSON Binding
3. Java's new HttpClient for API request/response.

It was just to make my libraries smaller, using existing frameworks. These can be found on my GitHub repository here: https://github.com/orgs/sinditech/repositories

I can understand LangChain4J is popular, and they integrate well with various AI LLMs out there (including some Chinese versions), so I don't mind at all looking at LangChain4J and incorporating something similar into MicroProfile. I'm all for it.

Thanks,

Kind Regard,

Buhake Sindi

Virus-free.www.avast.com

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/cf52cf9a-e874-42e1-858f-d1770d6d0e27n%40googlegroups.com.

[M P]

Do you know total amount of project buget was spent to date?

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/cf52cf9a-e874-42e1-858f-d1770d6d0e27n%40googlegroups.com.

[Emily Jiang]

Thank you Buhake for sharing! Let's have an initial conversation in 7 mins to look at the scope etc.

Thanks

Emily

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CABUp4f5uLs348TWy4Qzf2%3DySc42wdzTFU1tXYJjrwEnH4NfU5g%40mail.gmail.com.

--

Thanks
Emily

[Emily Jiang]

Thank you to the ones who attended the AI call yesterday! The call was recorded and the video will be uploaded in due course. You can also catch up the discussion via the minutes here. We will meet up at the same time next week. Hope to see many of you next week.

Thanks

Emily

--

Thanks
Emily

[John Clingan]

I had a meeting conflict but will work with Ryan to get the meeting recording posted.

[Emily Jiang]

Thanks John!

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/451f9a9a-9cfe-4ffc-9340-6cce6aa8f0e0n%40googlegroups.com.

--

Thanks
Emily

[Emily Jiang]

AI meeting will be on today. Hope to see more of you there. You can find the meeting details from our MP calendar.

[ant...@sabot-durand.net]

Today's AI meeting was canceled : we were only 2.

But during last week Ricken (my colleague that contributed Mistral LLM integration in Spring AI[1]) and I, started a small doc to gather information for the spec and describe what the could cover first version of the spec (roughly abstraction on LLM consuming and tooling to build a RAG)

Doc is here : https://docs.google.com/document/d/1Nnj3LHJPEMNF_nQDXnyAO_A-0MMOZ73CA9ONHAA5DCQ/edit?usp=sharing

Of course, it's only suggestion and a starting point for spec discussion.

Antoine

[1]: https://spring.io/blog/2024/03/06/function-calling-in-java-and-spring-ai-using-the-latest-mistral-ai-api

[Emily Jiang]

Thank you Antoine for the update! I was double booked. Monday next week is Easter Monday. Shall we cancel the next meeting and resume on 8th April? In the meanwhile, we can collaborate offline.

Thanks

Emily

[Antoine Sabot-Durand]

+1 to cancel Easter / April’s fool meeting ;-). Let’s meet on April 8th

Antoine

Le 26 mars 2024 à 00:28, 'Emily Jiang' via MicroProfile <microp...@googlegroups.com> a écrit :



--
You received this message because you are subscribed to a topic in the Google Groups "MicroProfile" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/microprofile/9IXZG_BnUcs/unsubscribe.
To unsubscribe from this group and all its topics, send an email to microprofile...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/f78b27b4-e594-4297-964c-1d71d7d16d00n%40googlegroups.com.

[Emily Jiang]

Thank you Antoine! The AI meeting on April Fools day was cancelled :). The next meeting will be on 8th April. See you then.

Thanks

Emily

[Buhake Sindi]

Hi everyone,

I have a roughly drafted proposal (without the fancy letterheads) of what we can look at as we create an AI specification for Microprofile.

I've attached the doc. I'm looking forward for feedback.

Thanks,

Kind Regard,

Buhake Sindi

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/72ef9455-9809-43f7-84b8-e4db018f5970n%40googlegroups.com.

[M P]

I need the ID and Password for the Marketing group. Tried to log on with link and it asked for a pass word.

Thanks

Marcia Peterson

[Emily Jiang]

The meeting can only be joined at the scheduled time. During that time, no password is required.

Thanks

Emily

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CAH7Jdz%3D-7NXnsbA8rOCf6ggOOxRKZyD%3D3tZu9_4uBMf_o25oHQ%40mail.gmail.com.

--

Thanks
Emily

[Emily Jiang]

Thank you Antoine, Buhake for sharing your thoughts via the doc! In order to consolidate the efforts, I have created a sandbox AI projects for you add your proposal to the project and we can reiterate it. By the way, Open Liberty has added a langchain4j example to demonstrate how to use MicroProfile and Jakarta EE to create AI apps here.

I will be traveling to DevNexus today so I won't be able to join the call. Please go ahead to have the call. I have asked John to join if he is available. If possible, please have the call recorded.

Thanks,

Emily

[Jean-Francois James]

Hi Emily,

FYI, I have adapted the Open Liberty langchain4j example to Helidon.

Thanks to JakartaEE/MicroProfile portability, no change in the main code!

Best regards.

[Emily Jiang]

Great, thanks Jean-Francois! Hope to see many of you on Monday's AI call.

Thanks

Emily

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/96d51aef-7974-485e-9fa7-4756c354e3c1n%40googlegroups.com.

--

Thanks
Emily

[Jean-Francois James]

Hi Emily (and others),

I've also published a  "car booking" example based on Quarkus-langchain4j : https://github.com/jefrajames/car-booking 

I've presented it at JChateau last month.

Regards.

[Kito Mann]

This is somewhat of a tangent, but I think we should have a list of JakartaEE / MicroProfile LLM integration examples. It could be as simple as awesome list on Github or something on the JakartaEE / MicroProfile sites. Thoughts?

___

Kito D. Mann | @kito99 | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/79782ee9-8e25-48cb-b080-4505decc879en%40googlegroups.com.

[Emily Jiang]

Hi Kito,

Sounds good. Please go ahead to create a list. For MP, do you suggest using the wiki or creating a blog entry.

Thanks

Emily

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/f449f3ab-62d6-4f21-88e7-010985b6f3ca%40Spark.

--

Thanks
Emily

[Kito Mann]

Hey Emily,

The wiki seems like the best choice out of the two. Are there any other options?

___

Kito D. Mann | @kito99 | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CAECq3A-wji%3DEmWGBYEjNF4iW5O493UoOL3e14VgF0viNrQELPw%40mail.gmail.com.

[M P]

Ryan, 

Would it be possible for Marketing to use Jasper AI which is a Blogger Template that helps generate tweets for those that want to post. Its fast and easy to use.

Marcia Peterson

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/451f9a9a-9cfe-4ffc-9340-6cce6aa8f0e0n%40googlegroups.com.

[M P]

Ryan, 

Would it be possible for Marketing to use Jasper AI which is a Blogger Template that helps generate tweets for those that want to post. Its fast and easy to use.

Marcia Peterson

On Tue, Mar 19, 2024, 10:30 AM John Clingan <jtcl...@gmail.com> wrote:

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/451f9a9a-9cfe-4ffc-9340-6cce6aa8f0e0n%40googlegroups.com.

[Kito Mann]

Hey Emily,

I'm happy to add this to the wiki, but I don't have the rights to do so... I'm an EF member but not officially part of any MP projects.

___

Kito D. Mann | @kito99 | @kit...@mastodon.social | LinkedIn
Java Champion | Google Developer Expert Alumni 
Expert consulting and training: Cloud architecture and modernization, Java/Jakarta EE, Web Components, Angular, Mobile Web
Virtua, Inc. | virtua.tech
+1 203-998-0403

* Enterprise development, front and back. Listen to Stackd Podcast.
* Speak at conferences? Check out SpeakerTrax.

To view this discussion on the web visit https://groups.google.com/d/msgid/microprofile/CAH7Jdz%3Dm47Rqh01rWpUMfAm-%3Dg1KNfwodcH-wwCZ_hEecNZ3BA%40mail.gmail.com.

[Emily Jiang]

Hi Kito,

I forgot that you need to be a committer for create a wiki page. My apologies. How about your start a googledoc and place here. Once there is doc, I will create a wiki link and point to your googledoc?

Thanks

Emily

[Reza Rahman]

Hi folks,

As we discussed in the past, it is now time to collaborate with the
Jakarta EE working group on the newly minted Cloud Native Java Technical
survey. Here is the current draft:
https://docs.google.com/document/d/1l3Yscex_5cANg4Uyjj4dFGLXWPBoPfksWkPV_5IOUZU/edit?usp=sharing.

Please take a look and either comment directly on the document or here.
Emily and I will ensure your input gets due consideration. Please do
this in the next two weeks.

Thanks,
Reza

[Reza Rahman]

Gentle reminder. I'll consider feedback closed by next week.