Thread: Comparison of network filesystems?

  1. #1
    Registered User
    Join Date
    Dec 2006
    Location
    Canada
    Posts
    3,229

    Comparison of network filesystems?

    I am currently running samba on my Linux server to serve to a few desktops and laptops, running a mix of Linux and Windows, on my LAN. All is fine, very responsive and throughput is okay (~80% of FTP), but we will be away from our house for a few months (to the other side of the Pacific Ocean), and wish to access the files over the Internet.

    The obvious solution (to me at least), is to continue using samba over VPN. I actually tried it last year (PPTP using dd-wrt firmware on my router), and it worked, but was painfully slow (entering a directory takes ~10 seconds, throughput is not that great either), so I am looking for an alternative solution now.

    It appears that the main problem with samba/cifs is that it is very chatty, has a large overhead (small chunks of data at a time), and is "serial". All of which make it unsuitable over a higher-latency network such as the Internet.

    I have looked into a few solutions. NFS has poor Windows support (in particular, it doesn't support Unicode filenames), and is very firewall-unfriendly (probably need to use VPN). WebDAV looks promising, since it's very firewall-friendly, and I already have Apache running, but it would be unconventional to use it as a general purpose NFS? Not sure about FTP (it seems crude). SSHFS sounds very nice - very convenient to set up (UNIX logins, doesn't need anything other than SSH, which I already have), seems to be efficient (and SSH supports compression), content caching, large blocks, and multithreading (from the website). Except there is no Windows client... Both Linux and Mac clients are on top of FUSE.

    If I really want to use SSHFS, I guess I can run Linux in VMware to provide a "proxy" over samba, but that sounds ugly. Or perhaps I can write a simple SSHFS->SMB wrapper for Windows (pretending to be a SMB server). Writing a filesystem driver for Windows is way beyond me, but that would be the best solution I guess.

    What are your suggestions?
    It's going to host a bunch of small (documents) files mostly, so responsiveness is more important than raw throughput.
    Network is probably going to be ~50kbytes/s both ways, ~150ms ping.
    Clients will be Windows and Linux.
    Unicode support is needed (my parents have many files with Chinese filenames).
    Load will be insignificant (4 users, probably at most 1 or 2 at a time).

    The server is running Debian Linux (stable) on a P3 600mhz (or so). The files that need to be served are on a Linux software RAID-1 array (ext3 or reiserfs, don't remember).

    Thanks

  2. #2
    Officially An Architect brewbuck's Avatar
    Join Date
    Mar 2007
    Location
    Portland, OR
    Posts
    7,396
    I think network filesystems are the wrong model for sharing files over the Internet. I'd just use rsync or something like it to keep things synced between your travel workstation and the home network.
    Code:
    //try
    //{
    	if (a) do { f( b); } while(1);
    	else   do { f(!b); } while(1);
    //}

  3. #3
    Registered User
    Join Date
    Dec 2006
    Location
    Canada
    Posts
    3,229
    Yeah, I am afraid that's what I will have to do if all methods turn out to be too slow.

    I don't really want to do it this way, though, since it's a few (~20) GB of data, and I don't really want to haul that around. There are going to be a few client machines, too (yes, more machines than we have users ), and I think some of them don't even have that much free space.

    Keeping just 1 copy (excluding backups) of everything makes things easier, too, especially since I have periodic snapshot backup scripts running (unchanged files are hardlinked).

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. Replies: 26
    Last Post: 07-05-2010, 10:43 AM
  2. 3D Network Analysis Tool
    By durban in forum Projects and Job Recruitment
    Replies: 1
    Last Post: 11-08-2005, 06:33 PM
  3. Need help with easy Network setup
    By the dead tree in forum Tech Board
    Replies: 9
    Last Post: 04-08-2005, 07:44 PM
  4. network problems
    By lucy in forum Tech Board
    Replies: 6
    Last Post: 01-01-2003, 03:33 PM
  5. WinXP Network Connections pop-up
    By DavidP in forum Tech Board
    Replies: 1
    Last Post: 10-02-2002, 05:36 PM