Channel forms with inline error and captcha does not work

I don’t know if this is a bug or if it’s just me that is doing it wrong.

I’m working with a channel form where I have enabled inline errors. The form submits just fine, when I’m logged in as a normal user. When I’m submitting the form as a guest it returns with errors, but my submitted data is added to the channel as a new entry. If I disable inline errors and submit the form again with captcha I don’t get any errors at all.

I’m using EE version 3.5.11 with enabled MSM.

Is there a known problem with captcha and inline errors ?

Thanks in advance.