I won't claim to know anything about the science behind any of this. The reasons I avoid refined sugar are:
1) It usually isn't accompanied with many/any other nutrients, unlike the sugar from fruit which gets you vitamins, fiber, etc.
2) Eating fruit might be full of sugar, but it is also...