How to Find Free Public Records?

I know that you can look at your local courthouse in the records department. You can look at land, marriage license, death certificates etc.