Yeah the problem was mainly with the director. Mike Newell's only movie in the series was Goblet of Fire, and supposedly Rowling was less involved with the production of that movie as well. Gambon's Dumbledore was fine in movies 5-8, which were all helmed by a single director.