There is no wrong way to build a patch. Sometimes you start with the audio pathing... sometimes you start with the CV. It depends on your idea or mental sketch.

Once you have a bit of experience, you'll start coming up with interesting ideas... AWAY from your case. Maybe there's a feature you haven't explored. Maybe you have this crazy CV routing idea that might or might not work the way you've envisioned it.

Just be prepared for happy-little-accidents that take you away from your original goal. Don't be afraid to explore something accidental or unintended. That's the beauty of modular.