Thread: Best interprocess communication method for transferring large amounts of data?

  1. 05-05-2009 #1
    mntgoat
    mntgoat is offline
    Registered User
    Join Date
    May 2009
    Posts
    1

    Best interprocess communication method for transferring large amounts of data?

    Hello all, I have two processes. The first process reads large amounts of data off the HDD (originally created with a SDR sending data to the disk via a USB 2.0 link) at a minimum speed of 40MB/s. The second process will will run the data through various DSP algorithms. I need to develop a good strategy for processing this data in real-time as it enters the system. What would be the best way of streaming data through the various processes (at 40MB/s)? I was thinking shared memory but not quite sure about this strategy. Can anyone suggest any good reference material for large-volume, high-speed real-time data processing?

    I'm running Fedora 10 and writing code in C.

    Thanks,
    -mntgoat
  2. 05-05-2009 #2
    Cactus_Hugger
    Cactus_Hugger is offline
    int x = *((int *) NULL); Cactus_Hugger's Avatar
    Join Date
    Jul 2003
    Location
    Banks of the River Styx
    Posts
    902
    I should hope that shared memory should be able to keep up with 40MB/s...
    Even pipes should handle that.
    Code:
    $ dd if=/dev/zero | tr a A > /dev/null
3794322+0 records in
3794322+0 records out
1942692864 bytes (1.9 GB) copied, 10.448 s, 186 MB/s
    long time; /* know C? */
    Unprecedented performance: Nothing ever ran this slow before.
    Any sufficiently advanced bug is indistinguishable from a feature.
    Real Programmers confuse Halloween and Christmas, because dec 25 == oct 31.
    The best way to accelerate an IBM is at 9.8 m/s/s.
    recursion (re - cur' - zhun) n. 1. (see recursion)
« Previous Thread | Next Thread »
Popular pages Recent additions subscribe to a feed

Similar Threads

  1. recv large amounts of data
    By kpreston in forum Networking/Device Communication
    Replies: 19
    Last Post: 10-16-2008, 03:03 PM
  2. Large Amounts of Static Data
    By Skerge in forum C Programming
    Replies: 5
    Last Post: 12-12-2007, 04:12 PM
  3. Store Large Amounts of Text Into Variable
    By phaserwarrior in forum C++ Programming
    Replies: 1
    Last Post: 10-13-2007, 08:30 AM
  4. Handling Large Amounts of Data
    By kas2002 in forum C++ Programming
    Replies: 9
    Last Post: 12-21-2006, 04:52 AM
  5. accepting large amounts of data
    By Sekti in forum C++ Programming
    Replies: 1
    Last Post: 04-05-2002, 05:45 PM

Tags for this Thread