What's best for mass data access?
I'm re-writing a prgram that runs once a year. Every time it runs, it takes 6-8 hours. In short, the application manipulates a table which contains ~350,000 rows and 8 columns. Data in each column is validated/scrubbed and at the end of this long process, a few text files are produced.
The current process runs in MS Access.
I can re-write it in VB 6.0, VB.NET, or C++.
I was initially considering c++ and writing that huge table into a struct-based vector. then I got to thinking about memory req's. The Access DB is around 200,000KB, 80% of which is that table.
I think I've just fallen in love with vectors so it sounded cool. My basic idea was move as much data into memory and deal with as few table calls as possible. True, I could move chunks of records, like a few thousand at a time...
So, should I do this in C++ or in an easier VB language?