large data handling

This is a discussion on large data handling within the C++ Programming forums, part of the General Programming Boards category; i need to read a table with over 2GB in size, and then find the shortest-path based on the read ...

  1. #1
    re-
    re- is offline
    Registered User
    Join Date
    May 2007
    Posts
    2

    large data handling

    i need to read a table with over 2GB in size, and then find the shortest-path based on the read data. what is the best way to handle such a huge data ?

  2. #2
    Registered User
    Join Date
    May 2007
    Posts
    88
    I think you're going to need to be more specific if you want a meaningful answer to this question.
    What do you mean by shortest path? What is the algorithm you will be using to find it?

  3. #3
    re-
    re- is offline
    Registered User
    Join Date
    May 2007
    Posts
    2
    i think i'm gonna go with dijkstra algorithm, and from what i know they expect over 100 calls / second so it has to be quite advanced
    the only problem i see is how to handle the data, which has a tendency to change.. say.. twice a day.

    I can also say that the data is in MySQL - if its any help
    Last edited by re-; 05-26-2007 at 03:41 PM.

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. Bitmasking Problem
    By mike_g in forum C++ Programming
    Replies: 13
    Last Post: 11-08-2007, 12:24 AM
  2. Large Data management in using File
    By mohsan1987 in forum C Programming
    Replies: 6
    Last Post: 09-14-2006, 07:41 AM
  3. question about a working linked list
    By cold_dog in forum C++ Programming
    Replies: 23
    Last Post: 09-13-2006, 02:00 AM
  4. C diamonds and perls :)
    By Carlos in forum A Brief History of Cprogramming.com
    Replies: 7
    Last Post: 05-16-2003, 11:19 PM
  5. confused by handling of data type
    By The Gweech in forum C++ Programming
    Replies: 1
    Last Post: 07-09-2002, 05:28 PM

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21