Hi Martin!
It is usually one of two things: either you have something loaded on the guitar side of the MIDI Guitar software (blue box),
…or you have some ‘direct monitoring’ option on your audio interface that you need to address (turn off, or all the way to the right or left, depending on what audio interface you have)
Others with the same issues have had this discussion here:
How Do I Mute the Dry Guitar Sound