AI responses feedback

Support
#1

Just wanted to give some feedback on my experience with the Jmix AI assistant.

I use it daily, on average 2~3 times per day, sometimes more.

The first response is typically very good. There is some hallucination, but since I’ve been using Jmix for a long time, I can spot them easily most of the time.

The follow-up questions are not being answered very good. I’m assuming this is a problem with the memory. On more than one occasion, it seemed like it had completely forgotten about the initial question and treated the follow-up questions as the first.

And since it missed that context the rest of the conversation became useless.

In summary, it is very helpful. Answers on Jmix specific questions give good results. If the memory can be fixed it is a great companion.

3 Likes
#2

Indeed, Jmix AI assistant is a great help, especially for beginners.
I use the paid version of Anthropic Sonnet 4.5 for more serious questions, code examples, and problem-solving, alongside the free version of ChatGPT, as “Google on steroids”, so I don’t spend Sonnet’s quota. I’m also careful to frame my questions in generalized ways where it matters, so then I use/change/adapt the solution, in order not to leak any sensitive information.
Recently, I have seen myself and from the testimonies of other people, that generative AI solutions are nearing the levels of “junior developers” with their capabilities.

Kind regards,
Mladen

1 Like
#4

Thank you for your feedback!

Jmix Assistant now remembers 10 previous questions in a conversation. Do you think we should increase this amount?

BTW, we have also observed that the latest top-notch models (first of all Sonnet 4.5) became very good in coding with Jmix. You can just create a new project in Studio, start an agent in it, and begin vibe coding. This is really fun.

Perhaps a Jmix documentation/samples MCP server could improve the quality and reduce hallucinations for an agent, so we are considering creating it.

Regards,
Konstantin

1 Like
#5

it’s not a because of the 10, it happens even on the first follow-up.

If i look in the chat history and click on a question then sometimes the follow-up questions are listed under that question, so in that case it worked.

But in other cases, my responses are listed as if they were a separate question, just seems to be a bug. perhaps it depends on the time between original question and follow_up?

#6

Looks like a bug.
Are you using Studio or web chat? How often do you experience this problem? When was the last time?

#7

web, for some reason i always end up via the web.

last time was yesterday. I asked something about the lifecycle of the view and my followup was that this was too late. it was considered a new question

image

#8

Hi Tom,

We have found a bug in the initial opening of the web assistant page: it shows a previous conversation, but without any messages. So you may think you have started a new conversation, but in fact your messages are added to a previous one.

We’ll fix it, and the web app will always create a new conversation when opened without the conversation ID in the URL.

However, the problem you described can have a different cause. If you can remember more details, or it will be reproduced again, please let us know. In what sequence you clicked chat items on the left, what was in the URL, whether you just logged in, what messages were displayed in the main area, etc. This kind of information would help.

Thank you.

Regards,
Konstantin