Looks like a consensus here at the FoH brain trust
T2+ cities or something, managing the number of towers that can appear and especially be rebuilt is a vital decision for them to make. I'd prefer you bought them for those resources things from another tab on the settlement, and rebuilt them...