Problems with buffers

I would like to have my client.c program send a get message to a host port 80 and receive the ENTIRE index.html and print to screen.

For some reason even if I up the char buf[1000000] I still can't capture the entire file.
Is there a better way to do this than by allocating 1000000 space?

Code:

---

#include <stdio.h>
#include <sys/types.h>
#include <sys/socket.h>
#include <netinet/in.h>
#include <netdb.h>

void error(char *msg)
{
    perror(msg);
    exit(0);
}

int main(int argc, char *argv[])
{
    int sockfd, portno, n;
    struct sockaddr_in serv_addr;
    struct hostent *server;
    char buffer[1000000];

    if (argc < 3) {
      fprintf(stderr,"usage %s hostname port\n", argv[0]);
      exit(0);
    }
    portno = atoi(argv[2]);
    sockfd = socket(AF_INET, SOCK_STREAM, 0);
    if (sockfd < 0)
        error("ERROR opening socket");
    server = gethostbyname(argv[1]);
    if (server == NULL) {
        fprintf(stderr,"ERROR, no such host\n");
        exit(0);
    }
    bzero((char *) &serv_addr, sizeof(serv_addr));
    serv_addr.sin_family = AF_INET;
    bcopy((char *)server->h_addr,
        (char *)&serv_addr.sin_addr.s_addr,
        server->h_length);
    serv_addr.sin_port = htons(portno);
    if (connect(sockfd,&serv_addr,sizeof(serv_addr)) < 0)
        error("ERROR connecting");
    printf("Please enter the message: ");
    bzero(buffer,256);
    fgets(buffer,255,stdin);
    n = write(sockfd,buffer,strlen(buffer));
    if (n < 0)
        error("ERROR writing to socket");
    bzero(buffer,1000000);
    n = read(sockfd,buffer,1000000);
    if (n < 0)
        error("ERROR reading from socket");
    printf("%s\n",buffer);
    return 0;

---

Quote:

---

For some reason even if I up the char buf[1000000] I still can't capture the entire file.

---

So it must be over a megabyte, right?

Answer: Call read() more than once. You can do this, you know. Just keep checking for n<0.

[edit] In fact, something like this might even work.

Code:

---

unsigned char c;
while(read(sockfd,&c,1) >= 0) putchar(c);

---

[/edit]

[edit]
Never mind found it.
[/edit]

I keep getting error
client.c:60: error: syntax error at end of input

Code:

---

unsigned char c;
while(read(sockfd,&c,1) >= 0) putchar(c);

---

still doesn't work.
Just blank space

Code:

---

#include <stdio.h>
#include <sys/types.h>
#include <sys/socket.h>
#include <netinet/in.h>
#include <netdb.h>

void error(char *msg)
{
    perror(msg);
    exit(0);
}

int main(int argc, char *argv[])
{
    int sockfd, portno, n;
    struct sockaddr_in serv_addr;
    struct hostent *server;
    char buffer[256];
    unsigned char c;

    if (argc < 3) {
      fprintf(stderr,"usage %s hostname port\n", argv[0]);
      exit(0);
    }
    portno = atoi(argv[2]);
    sockfd = socket(AF_INET, SOCK_STREAM, 0);
    if (sockfd < 0)
        error("ERROR opening socket");
    server = gethostbyname(argv[1]);
    if (server == NULL) {
        fprintf(stderr,"ERROR, no such host\n");
        exit(0);
    }
    bzero((char *) &serv_addr, sizeof(serv_addr));
    serv_addr.sin_family = AF_INET;
    bcopy((char *)server->h_addr,
        (char *)&serv_addr.sin_addr.s_addr,
        server->h_length);
    serv_addr.sin_port = htons(portno);
    if (connect(sockfd,&serv_addr,sizeof(serv_addr)) < 0)
        error("ERROR connecting");
    printf("Please enter the message: ");
    bzero(buffer,256);
    fgets(buffer,255,stdin);
    n = write(sockfd,buffer,strlen(buffer));
    if (n < 0)
        error("ERROR writing to socket");
    bzero(buffer,256);
    //n = read(sockfd,buffer,1000000);
    //if (n < 0)
    //    error("ERROR reading from socket");
    //printf("%s\n",buffer);

    while(read(sockfd,&c,1) >= 0) putchar(c);
    return 0;
}
~

---

Hmm, I've never actually used sockets before. I don't know what's wrong with it.

The only thing I can think of is that putchar() is not flushing your output buffer, so you don't see anything. Try this:

Code:

---

while(read(sockfd,&c,1) >= 0) putchar(c);
printf("\n");

---

Or try adding a

Code:

---

fflush(stdout);

---

instead of the printf.

Did not work :(
Anyone else?

Code:

---

    bzero(buffer,256);
    fgets(buffer,255,stdin);
    n = write(sockfd,buffer,strlen(buffer));

---

• You don't need to zero the buffer -- fgets() sets it. (If you did need to zero the buffer,
  Code:

  ---

  char array[SIZE] = {0};

  ---

  would be an easier way.)
• You can pass 256 to fgets(); it knows how to handle NULLs and newlines etc.
• You don't write() a newline. Try passing strlen(buffer)+1.

That does not fix it.

* Shutdown & Close the sockets after you're done with them

The host propably isn't sending you anything, hence the waiting. If it's a webserver, the server won't send ANYTHING until you request something. ie, you can't just connect and start reading.

Assuming you read the source code you will see where I do send a message to the server.

I do receive the first 300 bytes or so of the index file. That is all.
Hence why I said is it a buffer situation.
But now after using the other guys putchar methods I don't get anything except blank space.

Closing the socket is the last thing I would do before returning 0.
However, closing the socket has nothing to do with reading it.

Quote:

---

I do receive the first 300 bytes or so of the index file. That is all.
Hence why I said is it a buffer situation.

---

Is your buffer 300 bytes, more, or less?

What do you mean by blank space? Newlines? Spaces? NULLs? What input do you type? You have to provide more information.

Quote:

---

Closing the socket is the last thing I would do before returning 0.
However, closing the socket has nothing to do with reading it.

---

No, but with FILE* files, you need to flush the file before you can switch from reading to writing or vise versa. This could be the case with sockets as well, I'm not sure.

Let's forget the buffer.
Can I just create a 'buffer' that can expand or allocate as needed.
I do not know how large each site will be.
Can't I just create a variable to hold all sizes?

I don't think that's your issue. If it was, and you increased your buffer to larger than 300 characters, then you'd get more than 300 characters, right? But I'm guessing that you don't.

If you do, or if you're just curious, you could do something like this:

Code:

---

while(recv(sockid, buffer, len, MSG_PEEK) < 0) len ++;
len --;

---

Then you read len characters from sockid, as len characters are waiting to be received.

But that basically just does the same thing as my code . . .

At least I think that would work. I just googled and found this -- I've never actually really used sockets before, remember. :)

Have you compared what message traffic you get when you attempt this using your standard browser with what you get when you use your program?

Use ethereal / wireshark to find this out.

ISTM that your initial HTML request cannot be valid, so there is no way to get a response.