Using strtok() to separate data

Is it possible to use strtok() to separate data, eliminating all whitespace? I have data that is separated by spaces, tabs, and occasionaly new lines. Is it possible to use strtok to take care of this? I've tried using strpbrk() but I don't think it works the same way as strtok, by being able to use NULL as the first parameter to continue on from where you left off.

Yes, you can do that

har har.
thanks
should've asked for an example.
plz to show one :p

Code:

---


#include <stdio.h>
#include <string.h>

void function(char *ptr)
{
const char delim[]=" \n\r";
ptr=strtok(ptr,delim);

while(ptr!=NULL)
    {
    printf ("%s\n",ptr);
    ptr = strtok (NULL, delim);

    }

}


int main()
{
 char ptr[]="How do you do"; 
 function(ptr); 

   
}

---

>>to use strtok() to separate data, eliminating all whitespace?
If you're looking to break the string into separate tokens and copy them elsewhere in individual pieces, do a board search or google or cppreference on strtok().

And if you're having trouble with cppreference, here's the exact spot ;)

Ok, thanks. I was using www.cplusplus.com library reference to look up strtok, and even at www.cppreference.com they don't show if it's clear that if you use multiple delimiters, that they don't have to be in order. Thanks all.

>>they don't show if it's clear that if you use multiple delimiters, that they don't have to be in order.

Oh. Well, last I checked strtok() just stops when it finds any one of the delimiters you specified - it doesn't search for the entire string of delimiters.

Do an iteration through your string with two counter variables. One for write, one for read. When you hit a valid spot, move whatever is in read to write, and increment both. If you hit a space, newline, tab or null, move your read but not your write.

This will overwrite all the spaces in the string with whatever comes after the spaces. So "Hello all" would become "Helloall". Just be sure to increment the write counter one more time and plop the null terminator at the end.

After that, you can even use strlen() to figure out how long it is and then copy it into a brand new, properly sized array, if for some reason you wish to discard the old larger one.

>>Do an iteration through your string with two counter variables.
Better yet, use two char*'s as the iterators to eliminate needless implicit pointer arithmetic ;) But I think the point of the question was to 'separate data' while ignoring whitespace. Fusing the string into one glob would do the opposite.

Although, neandrake, I would recommend that you use a stringstream rather than manually doing it with strtok().

Code:

---

#include <string>
#include <sstream>

std::string input;
//get the input into 'input'... however you do it

std::istringstream ss;
ss.str(input);

int a;
int b;
std::string c;
double d;

sstr >> a >> b >> c >> d;

---

It's really convenient. Alternately, you could use a std::stringstream if you want to append data to the stream as well (for example using the << operator) for later reading... or if you're just trying to glue stuff together into a string, use a std::ostringstream and use the << operator to write to the stream, then use ss.str() to retrieve the result.

Oh, I'm sorry. I got it working using strtok() with multiple delimeters. It's been working for about 3 hours now =). thanks though