I'd like to browse through the best answers from a site, for example from ServerFault.
I'm sure they would contain great information but I can't find a way to access just the top answers (regardless of the question)
If you want just the answers, you can set up a search using
This will give you all answers on the site, sorted in the descending order by votes. So, the top-voted (and theoretically "best") answers will be shown first regardless of the question.
See more search options here. This will work on any site, just replace "stackoverflow.com" with the relevant domain.
Go to any SE website. Press the Questions tab, then press the votes tab. This shows a list of all questions with the highest amount of votes (and with this comes, in most cases, the best answers). As shown below: