Yes, using std::domain_error; will work.
Since domain_error is part of the std namespace, you have to call it std::domain_error in your code, or put the using declaration like you mentioned, or have a global using directive. If you've been using using declarations like using std::cout, then you should be consistent and do the same for domain_error.
