help with implementing timeout in sockets

This is a discussion on help with implementing timeout in sockets within the Networking/Device Communication forums, part of the General Programming Boards category; Hi everyone, I have made a program that will connect to a server and download the webpage from it using ...

  1. #1
    Registered User
    Join Date
    May 2010
    Posts
    2

    help with implementing timeout in sockets

    Hi everyone,

    I have made a program that will connect to a server and download the webpage from it using the GET method. I am using this program to constantly monitor updates on some specific webpages, and I will probably be using thread to handle multiple sites.

    Anyway, the problem I am having is, for some websites, when I try to recv() the html, it will receive all of it but then at the end just hang for a while (maybe 7-10 seconds).

    For example, on the website Netgear.com, I will receive the last line "</body>" and then it will pause there for about 5-6 seconds then exit. Actually this website just hangs forever!

    On other hand, if I try something like Linux.com | The source for Linux information, it will work (the last two lines are "</html>\n" and a "0\n") with no hanging at all.

    I want to have it such that it never waits for more than 1-2 seconds.

    So I tried following:

    =============================
    insert
    Code:
    struct timeval tv;
    	tv.tv_sec = 3;
    	tv.tv_usec = 0;
    	setsockopt(sd,SOL_SOCKET,SO_RCVTIMEO,&tv,sizeof(tv));
    
    while (recv(sd, &str_buffer, 1, 0))
    {
    ...copy webpage
    }
    ==============================

    but it didnt work. the same hanging still occured I got that above example of a timeout from the unix network programming book by stevens.

    Does anyone know whats wrong with my code? Or any other method besides SELECT()?

    I don't want to use select() since i feel it will make the handling of threads more difficult for me. I have searched on the web for ages and its always SELECT(), alarm with signal (not good for threads i hear) or this setsockopt option.

    Thanks guys, your help is much appreciated!
    Last edited by logik25; 05-31-2010 at 01:06 PM.

  2. #2
    spurious conceit MK27's Avatar
    Join Date
    Jul 2008
    Location
    segmentation fault
    Posts
    8,300
    With HTTP requests you should use the Content-Length field to loop your read until you have read the number of bytes indicated.

    This:
    Code:
    while (recv(sd, &str_buffer, 1, 0))
    has no reason at all to stop waiting for (infinite amounts of) data.
    C programming resources:
    GNU C Function and Macro Index -- glibc reference manual
    The C Book -- nice online learner guide
    Current ISO draft standard
    CCAN -- new CPAN like open source library repository
    3 (different) GNU debugger tutorials: #1 -- #2 -- #3
    cpwiki -- our wiki on sourceforge

  3. #3
    Registered User
    Join Date
    May 2010
    Posts
    2
    but what if we are in a situation where we cant get all the content? I have noticed some websites give the last line or two like 10 seconds later. iwouldnt mind just closing it off by that time

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. Best way to poll sockets?
    By 39ster in forum Networking/Device Communication
    Replies: 3
    Last Post: 07-22-2008, 02:43 PM
  2. multiplexing
    By kaijuu in forum C Programming
    Replies: 0
    Last Post: 03-29-2008, 07:47 AM
  3. Replies: 8
    Last Post: 03-10-2008, 12:57 PM
  4. connect timeout
    By X PaYnE X in forum Networking/Device Communication
    Replies: 8
    Last Post: 05-14-2005, 10:30 PM
  5. Implementing timeouts with TCP sockets
    By nkhambal in forum C Programming
    Replies: 2
    Last Post: 04-14-2005, 12:10 AM

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21