It turns out that it does give me color data, I was just interpreting it incorrectly .. was simple to figure out when I made my own 2 pixel by 2 pixel image.

thanks all.