It understands math only from a language and token manipulation standpoint. It does not 'do math.' If you want to do math, use the Wolfram Alpha plugin.
Ironically, the base ChatGPT model was better at math before the RLHF. Once the RLHF layers were applied, it actually lost the ability to...