Thread: Any regex people here?

I want to make a list of all links from an index.html page. All I want is the URL and I'll live with the assumption that there's double quotes around it - for now. Here's what I have so far:

Code:

#include <stdlib.h>
#include <string.h>
#include <regex.h>

#define MAX_STRING_SIZE 1024

int main() {
  int rc;
  regex_t * myregex = calloc(1, sizeof(regex_t));
  regmatch_t matches[3];
  FILE *fp;
  char line[MAX_STRING_SIZE];
  
  if(myregex == NULL)
     return 1;

  fp = fopen("/var/tmp/index.html", "r");
  rc = regcomp(myregex, "href\\s*=\\s*(\")*(.*?\")([^\"]+)", REG_EXTENDED);
  while(fgets(line, MAX_STRING_SIZE, fp) != NULL) {
     if(regexec(myregex, line, 3, matches, 0) == 0) {
        printf("String: %s\n", line + matches[2].rm_so);
     }
  }
  free(myregex);
  return 0;
}

My output shows me the URL, but it also shows me the rest of the line of text as well. I keep trying to tell it (I think) to stop after the first double quote after the URL, but no matter what I keep getting the rest of the line.

Thank you in advance for helping out.

It's for my lack of trying everything else I could possibly think of.

Really, I've stumbled so many times with regex. I've read and reread books and examples and everytime I come across a situation where they seem like the best strategy, I create them very carefully and with a lot of research, then they just never work.

Any suggestions are so welcome.

I tested that with Perl and yes it does work, however the POSIX API must be different because it doesn't work in C.

And I like your quote.

Is there any other method you'd use to scan through an html file looking for all links?

Thank you for your help.

Try:

Code:

href[:space:]*=[:space:]*['|"]([^"|']*)

Also, you probably shouldn't calloc your regex_t struct. Use a stack variable, pass a pointer to it to the functions, and use regfree when you're done:

Code:

regex_t re;
regcomp(&re, ...
regexec(&re, ...
regfree(&re);

rags_to_riches - I tried your regex and it still pulls everything to the end of the line. Should I use some non-greed qualifier? Like "?".

I originally thought about using strstr, but thought I should use regex and once and for all learn the darn thing.

I might go back to strstr with strtok as my method.

Thank you all for your ideas, comments and suggestions.

What did we all do before there were forums like this? I know I struggled for weeks before finding answers. This almost seems like cheating. Almost.

Thank you all.

Thanks CornedBee.

I'll search for how to use PCRE(C) and see if it works easier than what I'm using now. It's really been frustrating.

rags_to_riches - you are fantastic!

Thank you for your help. (help nothing. you did it for me)

I had tried it with the ending offset but I did my math in reverse so I got some weird characters all over my screen so I knew I went into some deep memory area.

Hopefully this thread gets indexed on all the search engines because your code will definitely be useful to many, many others.

Thank you again.

Is there a way to grab all href's on one line?

I'm coming across one line of html that has multiple href's on it and this is only collectinng the first one.

Any ideas?

It's worth $100 for the help. (not to me, to you)