Math always helps, but you can program without knowing much about it. It depends on the types of programs you want to write, of course. I can think of several people who started C or C++ programming...