With <> only the include file path is scanned.
With "" the current directory is first scanned, then the include file path is scanned.
I would keep the private file in with your source, and the public file somewhere in the include path.
See Include Syntax (The C Preprocessor)