It was an alternate universe so nobody really cared, tons of swapping happened in Ultimates. And then when they actually got Samuel L Jackson to play the role in the MCU, nobody cared again because he's fun as hell to watch and pretty much rocked the role.
It really wasn't blackwashing compared...