DirectX is more than just graphics. That includes sounds, user input (mouse and keyboard) and networking.
yeah, I forgot to mention that, that unless you are going to use OpenAL, most companies will have you use DirectX anyway for atleast sound/input/etc. even if you dont use D3D.