According to my experience, the native English speakers are ver
about their judgement of accents. Once they arrive at their conclusion all that is left for you is to explain how could you declare that you've never been to German, Sweden, British,etc. while you have that accent. That is, they doubt you words, not their judgements.