If the conversation is made up of messages in multiple folders and one of the messages in the conversation is unread, the indicator will show on any folder where the conversation exists.
If conversations don’t work for you, you can disable them using Menu > View > Conversations > Disable Conversations.