I built the 7U myself out of cherry, it's 220HP. I plan to eventually make a matching 7U that stands upright to go where the 84HP intellijel is right now. But I do get your point!
Rack space is freaky expensive, it's also a great luxury to have all the modules right there and immediately patchable. I know that moving the DFAM out of the rack will mean it gets patched less.
Here's the thing, I'm not really using the DFAM nearly as much anyways. I really love the module, but it has some drawbacks that make it difficult in a larger rack setting:
1) It lacks a 'reset' input, so it's a pain in the ass to sync to other sequencers, you have to manually advance the trigger.
2) It has only coarse tuning knobs, and they are very fiddly.
3) Tiny-ass trim pots.
I think I may have just outgrown this module. I am using it mainly as hi-hats or as a paraphonic voice. I'm thinking of these guys as the more satisfying upgrade: CS-L, DPO, CIP, or maybe that upcoming Panharmonium thing. And maybe I'd still have room for a Maths and a Veils.