Thread: Using strtok() in conjunction with fgets() to parse file data.

Originally Posted by ofCircuits

I have been trying to get this to work, but I've started to realize that I do not have a complete understanding of what strtok() actually does.
I'm getting this warning when debugging: "assignment makes integer from pointer without cast."

It also helps if you show us the line which produced the error message. Because the line numbers might be different on the message board, you should indicate with the full text of the line exactly which line produced the message.

As far as strtok goes, it tokenizes a string. In my opinion it is meant for exactly one use case in mind, basically something like this

Code:

const char delim[] = " ,";
char someString[] ="- This is, a sample , string.";
char *tok = strtok(someString, delim);
while (tok != NULL)
{
    printf ("Found token: %s\n", tok);
    tok = strtok(NULL, delim);
}

If you're using it for anything other than that, it probably won't work. For example, I would personally start with that boilerplate code and then modify it to include a counter, etc. if you really want to. HOWEVER if you know how many tokens are in your line, you may as well use sscanf. The return value indicates how many tokens were successfully matched, so it is easy to detect errors in your data.

Originally Posted by c99tutorial

It also helps if you show us the line which produced the error message. Because the line numbers might be different on the message board, you should indicate with the full text of the line exactly which line produced the message.

Originally Posted by ofCircuits

This warning happens when assigning str to goal and assist, and I think it is because they are, when dereferenced, integers.

This corresponds with lines 18 and 22.

Originally Posted by c99tutorial

As far as strtok goes, it tokenizes a string. In my opinion it is meant for exactly one use case in mind, basically something like this

Originally Posted by c99tutorial

Code:

const char delim[] = " ,";
char someString[] ="- This is, a sample , string.";
char *tok = strtok(someString, delim);
while (tok != NULL)
{
    printf ("Found token: %s\n", tok);
    tok = strtok(NULL, delim);
}

This seems to be the standard example I've been able to find online, but like I said:

Originally Posted by ofCircuits

From what I understand about strtok(), it returns a string, and takes in a character array and a key value that tells it when to stop. In the online examples I've seen, they use NULL in the first field. I'm not sure why.

I guess I'm just looking for some help to achieve a deeper understanding of what is going on so that I may fix my problem.

Originally Posted by c99tutorial

If you're using it for anything other than that, it probably won't work. For example, I would personally start with that boilerplate code and then modify it to include a counter, etc. if you really want to. HOWEVER if you know how many tokens are in your line, you may as well use sscanf. The return value indicates how many tokens were successfully matched, so it is easy to detect errors in your data.

I must use strtok(). Thank you for your help.


EDIT: I seem to be making some headway with your template. One thing I've noticed is that the newline is being tokenized with my last value, but I think I can handle that.

One more thing: it's not valid to really assign `tok' anywhere after it's been returned by strtok. For example, don't do this:

Code:

myarray[i] = tok;

Instead, you should make a copy like this

Code:

strcpy(myarray[i], tok);

myarray must be an array of character pointers, each of which has enough room to store tok.

Originally Posted by ofCircuits

I see, but in cases when I need to convert tok to an integer to store an integer?

Yes, then it's fine. It probably helps to see your string like this

char someString[] = "One Two Three Four";

when you run strtok with a delim of " " it will scan through to find the first space and then stick in a \0, so now your string is "One\0Two Three Four" and the return value points to the beginning of "One". Each time you call it, it just moves this internal pointer on to the next token. When it gets to the end it returns NULL.

If you know how many tokens there are, use sscanf. If you are required to use strtok for some obscure reason, then use strtok, but I would always check for NULL because that's what the spec says it returns:

Man Page for strtok (freebsd Section 3) - The UNIX and Linux Forums