Guy who works in Cybersecurity here....
There are tools for this, we sell a set of them. We refer to it as "Code to Cloud" security. To go everywhere from code generation, to securing workloads in prod environments. This includes data used in conjunction with AI, and identifying which AI tools are and aren't being used, and has the capability to intercept/block unauthorized stuff.
With most customers I deal with the management still has no f-ing clue whatsoever about securing AI usage, and barely enough clue about data in motion DLP to be able to define what can and can't be sent to systems outside the company. And even a smaller subset think about securing code while it's being developed. They think it's black magic when we can "automagically" catch a developer hard coding credentials into systems and flag it to be corrected.