Quick answer is it stays there till theyve read it. ie till theyve actually clicked on the message and its opened.
Sometimes the recipient overlooks a recent PM if theyve been answering a few,especially if from the same member.
To help combat this I sometimes change or modify the title so it doesnt get lost amongst all the others