How many VCOs are you trying to drive with the same CV? If it's more than three, you might want to look into a buffered mult (if you don't have one). This sounds a bit like a voltage sag issue, and the buffering circuit should clear that up.