I don't believe it affects other CPU modules, just the Compute Module 3.
It looks like it shuts down, but the USB is still powered and it is pulling about 43mA from the batteries. After shutting down, if I take out the batteries and put them back in, current drops to 60uA closer to what I would expect.
Posting this on Discord, looks like other have also had this issue.