Ai - addon or leverage Jmix ai

As the AI is builtin the platform (RAG, training, …chat etc), how can we leverage it in developing my add-on project to my main project in order to let my application users get answers to the specific application, perform tasks (e.g. create and submit leave application etc.?

You can find an example of working with Spring AI and implementing a RAG pipeline in a Jmix application in this project:

Regards,
Konstantin

1 Like

Thanks.

Do you have any plan to bring this as add-on?

I asked Jmix AI assistant about how to use Jmix AI in my Jmix application, got the following answer:

Based on current official Jmix documentation:
There is no dedicated Jmix “AI add-on” available in the Jmix Marketplace for inclusion in your business applications.
The only AI-related feature described is the “Jmix AI Assistant.” This assistant is meant to help you as a developer by finding documentation, generating code snippets, and answering platform or programming questions while building Jmix applications (through the Jmix documentation website or Studio). It is not infrastructure for integrating AI features within your user-facing apps.
Summary:
You can use the Jmix AI Assistant in Jmix documentation/Studio for development support.
As of now, there is no Jmix-provided or officially documented AI add-on to bring AI capabilities (chatbots, machine learning inference, etc.) into the runtime or business logic of your own Jmix applications.
If you want to add AI features (such as using OpenAI, Azure AI, or others) in your Jmix apps, you would need to integrate these services yourself using standard Java and HTTP API approaches.
If you would like step-by-step guidance on how to call external AI services from a Jmix project (for example, using OpenAI’s GPT or Azure Cognitive APIs), please specify the service or use-case, and I can provide example code and relevant configuration details for Jmix 2+.

Hi Konstantin
Interestingly, I discovered AI client menu from Advanced menu of the studio (helped by AI Assistant). I am trying to create the cleint but nothing happening when i try to complete the wizard, see below:

Step 1
image

Step 2

image

Step 3
image

When I click next, dothing happens, the screen stays like that

Regarding your idea about an add-on that would simplify building AI-powered apps: could you share more details about your potential use cases?

Hi Konstantin
Happy sharing.
Say for example, I have HR system developed in Jmix Platform where I want to develop AI integration that can perform several things like:

  1. Answers general HR questions submitted by employees.
    In order to enable AI answer questions withing the HR rules of the company, I will store different HR documents in different file format but may be mostly in pdf in e.g. database or file storage knowledge centre . The AI will learn from those documents and answer accordingly.

At any given point if the AI doesn’t find the exact answer expected, AI will escalate the question to the HR team who will answer the question and the answer will be saved also in the knowledge centre. AI will continue learning also from answers given by HR team too.

  1. Employees asks AI agent about leave days balance, entitlements criteria for him/herself and the AI agent checks in the database and answers.

  2. Employee asks AI agent to create and submit lave application, AI agent create and submit lease application and it goes on to approval as usual.

  3. Option to offer voice conversation with AI.

The add-on can ease integration and building of such functionalities for applications developed within Jmix without the ground work, like any other add-ons line REST, Report etc.

Please feel free to ask if you need any deeper details of use cases.

Thank you for sharing your ideas. We’ll think what we can do to provide some starting points for integrating AI into Jmix apps.

2 Likes