I thought that I'd skip multi-character operators entirely, but am having difficulties to come up with enough single-char operators for covering the ground.
My idea was to make the tokens run through another function ...say.. the 'joiner' which would do stuff like..
*Join multi character operators together.
*Convert integers separated by a ' . ' into doubles ..etc
But I can't imagine what to do when the joining of the operators isn't necessary.
For example :
When the input is a mathematical expression in rpn(postfix) notation, two '+' `s together does not necessarily mean an increment operator, but it could mean so at times!