I wasn't disagreeing with you, I was just being more specific. They are referred to as the Dunedain several times in the books, and at least once in a deleted scene in the movies (Eowyn in Two Towers). They also aren't the only remnants of Numenor. The Houses of Hurin (Denethor, Boromir...