I really would want to have some kind of protection for the lens. Having the device in the pocket could easily scratch the lens.
Not that one scratch affects the image quality that much, if...