Yeah, I think he just never explained how they're white and his ex is black. Also, he just ignores the existence of siblings sometimes - and even completely retconning them because I think there are times when he's said he doesn't have a sister or brother - but we've already seen them in episodes.