Those are "messages". They won't be removed until you "read" them by clicking the X to the right. Yes, this is a bad design from our side, and you are definitely not the first to not understand it.
Note that you might have gotten more than one of those, with small differences in the text.