I started the book, got halfway, watched the show, and finished the book and I would agree. The mystical stuff is a substantial portion of the book and stripping it out doesn't do the story any favors.
Lady Silence is way fucking cooler in the book. They botched her super hard.