Advice on raw image matrix matching

I'm currently trying to get my head around creating a number recognition program
i've had a look around and I've had a bit of problem trying to find what to use
My background is in C / C++ but I've never had any experience with dealing with images

My question is there any libraries anyone would suggest and is it possible to get the raw image and compare it to known number raw images to get an accurate pattern recognition

I'm using a serial camera to take black and white images

any other suggestions are welcome