Depends which parts. My fav terminal is the XFCE Terminal, which is explicitly a stand alone application and easy to use and install sans XFCE. It is very similar to the gnome terminal, which also can be used sans gnome but requires more gnome components to work. The modularity is still enough that you can still actually use the gnome taskbar without gnome proper. I used to invoke it via the command line occasionally for some reason and then kill it when I was done (because of some reliance some other piece of software had).
Or is it feasible to have parts of a DE running without the whole thing ?