Depending on how you denied it, the site will ask again if you reload the page. But if you permanently denied it you have to fix it in your web browser. That's different depending on what web browser you use.
This page seems to show how it's done in the most common web browsers.