Deep underground. Very, very deep underground. Also, they may be more common on higher level planets.
They are much more common on higher tier planets even within the first 400 or so blocks down. Once you start hunting for aegisalt/violium/redthingieswhosenameIforgot you can come across them in veins of up to 10 at a time while looking for the stuff you need to tier up.