OPEN VERY VERY big text file inC?
Hi all, first of all, sorry for my english!
i'm newbie for C in Unix enviroment.
i have a big structed-text file (about 500 MB in file size). I wanna to open this file but don't know about it's struct.
Help me:
1. What's best source code (IN C for Unix) to open this file?
2. many thanks for your sharing
I'd use standard fopen() - assuming you have no specific requirements about dealing with the file that REQUIRES some other method.
500MB isn't THAT large a file, so it should be no genuine problems dealing with it.
Obviously, on a machine with limited memory, you can't necessarily load the entire file into memory [and of course, if the file contains different sections, you may not need to do that either].
--
Mats
Compilers can produce warnings - make the compiler programmers happy: Use them!
Please don't PM me for help - and no, I don't do help over instant messengers.
If you get to the 2.0GB range, then you'll need to start ensuring that you are using the correct pointer types. There are >2.0GB support functions, but they REQUIRE you to use the 64-bit indexes.
The reason for this is that C's standard FILE* functions use, as a minimum, signed 32-bit integers (longs) to store the position in the file. The maximum value you can represent in this scheme, of course, is 2^31-1 = 2,147,483,647, or exactly 2 gigabytes.
Functions that use 64-bit positions can handle absolutely huge files. You probably won't be running into the limit for them for a few decades yet. But they aren't as standard, of course.
dwk
Seek and ye shall find. quaere et invenies.
"Simplicity does not precede complexity, but follows it." -- Alan Perlis
"Testing can only prove the presence of bugs, not their absence." -- Edsger Dijkstra
"The only real mistake is the one from which we learn nothing." -- John Powell
Other boards: DaniWeb, TPS
Unofficial Wiki FAQ: cpwiki.sf.net
My website: http://dwks.theprogrammingsite.com/
Projects: codeform, xuni, atlantis, nort, etc.
many thanks!!!!!!!
everything's OK for me!!!!!!!
500 MB? That's not even 2 gigabytes. You're nowhere close to "very very big..."
awww, and i thought this thread was going to be about processing data that doesn't fit into memory. You got my hopes up.
For reference, here's the internationally accepted standard of english pronouns for file sizes.
100's of MB = Large
GB's = Quite Large
10's of GB = Big
100's of GB = Very Big
TB's = very very big
PB's = Huge
