As in many cases on Stack Exchange, you can hover over things and get more information about them:
Yaakov Ellis says it will go away in 60 days; if you want it to go away earlier, all you have to do is perform a review in that queue, or skip an item. (It's not enough to just dismiss the guidance popup.)