Thread: Splitting A String Into Tokens!

Right, I am having a little trouble with making a string tokeniser to split up a string!

NOTE: This is for university coursework. So please just give examples; not a complete solution!

and a typical request looks something like:

BREW POT-1 HTCPCP/1.0\r\nAccept-Additions:#milk-type;skimmed#milk-amount;lots\r\n

obviously there is a little bit missing in the above request (syrup, sweetener etc.)

All i am trying to do is to split up the string into tokens so i can process the request! at the server end!!!!!

i want to be able to have the tokens;


BREW
POT-1
HTCPCP/1.0
....

using delimeters " ;#\r\n"

How can i do this??? ...All i want to do at the moment is print the tokens to the screen as the request arrives!!!


Here is the code that I have done so far, but its not working!!!!!!!!

Code:

  
char Array[MAX_ARRAY] = "BREW POT-1 HTCPCP/1.0\r\nAccept-Additions:#milk-type;skimmed#milk-amount;lots\r\n";
  char *TmpArray;
  char *Tokens[MAX_TOKEN];
  int TokenCount;

  char *ptr;
    
  TokenCount = 0;
  TmpArray = strdup(Array);
  for (ptr = TmpArray; *ptr;) {
    while (*ptr == ' ')               /* ignore leading space AND treat consecutive spaces as a single separator */
      *(ptr++) = 0;                   /* replace the space with end-of-string */
    if (++TokenCount >= MAX_TOKEN)    /* check for too many tokens.  Ignore the extras. */
      Tokens[TokenCount] = ptr;       /* Save the address of the current token */
    while (*ptr && *ptr != ' ')       /* Skip the contents of the token */
      ptr++;
  }
  
  for (i = 0; i < TokenCount; i++){
    printf("tokens: %s\n", Tokens[i]);
  }

Thanks for your help!!!! Matt.

Originally Posted by Dave_Sinkula

I'd wager the assignment is geared toward a strtok type solution akin to this.

You would think. However out lecturer hates strtok with a passion.

Thanks for the help Dave!!! ...I have managed to write a string tokeniser without using strtok and its pretty simple!!!!!! Well, heres the code for it.....

Code:

char ** stringTokenizer(char * theData, char * theDelims){
  
  static char *Token[5];   /* ARRAY TO STORE POINTERS TO TOKENS */
  int cnt = 0;              /* TOKEN COUNTER */
  
  /* LOOP THROUGH INPUT STRING UNTIL END OF STRING CHAR IS FOUND */
  while (*theData!='\0') {
    /* IS THE CURRENT CHAR A DELIMETER CHAR? */
    while (*theData!='\0' && strchr(theDelims,*theData)) {
      *theData='\0';   /* REPLACE DELIMETER CHAR WITH STRING TERMINATION CHAR */
      theData++;       /* POINT THE THE FIRST CHAR OF THE NEXT TOKEN */
    } 
    Token[cnt++]=theData;  /* RECORD THE POSITION OF THE NEXT TOKEN */
    /* EAT UP ALL NON-DELIM CHARS IN CURRENT TOKEN */
    while (*theData!='\0' && !strchr(theDelims,*theData)) { 
      theData++; /* MOVE TO NEXT CHAR IN STRING */
    }
  }
  Token[cnt] = 0;
  return Token;   /* RETURN THE ARRAY OF TOKENS */
  
}

thats rubbish itll never work!

Originally Posted by bll2109

thats rubbish itll never work!

You idiot ben! ...write your own tokeniser! stop stealing my code!!!

Originally Posted by bobthebullet990

You idiot ben! ...write your own tokeniser! stop stealing my code!!!

what you on about i wrote it in the first place and you stole it from me! idiot matt

Originally Posted by bobthebullet990

You idiot ben! ...write your own tokeniser! stop stealing my code!!!

Get a life u looser!!! Goto cern and never return! later aligator! over and out!

Originally Posted by bobthebullet990

Get a life u looser!!! Goto cern and never return! later aligator! over and out!

your only jealous

Originally Posted by SlyMaelstrom

*clicks the lock button he wishes he has*

lock down mate!! lock down!!

Watch out guys! the time is goin all hyroglifical and the shutters are goin down! QUICK Hit the execute button! ...Its not supposed to be like this! ...how is it sposed to be Lock????? (This is the question!)

HUH! ...So u wanna convert an int to a char array and then put that char array into the send buffer! u idiot! U just print the int straight into the send buffer!!!

point proved mate!!! L.O.L...........................

how about we get on with some work instead of sending lame ass messages from 2 machines away of each other!