Do Books Go In Quotes, Italics, or Underlined?

When I mention the name of a book in my essay, what's the proper way to do it? Similarly, what do I do with the titles of magazines? Thanks.