It’s generally used metaphorically. It just means you shouldn’t judge something based on appearances.

And modern book covers are designed to get you to pick up the book. Amazing covers don’t mean the book is necessarily good, it just means they had a great designer.