Okay, so I'm working on my texture manager. I've come to the part where I rebind all the textures and changing various texture filters on a per-texture-basis. Of course this requires the pixel data... Should I leave the pixel data in memory or should I reload the image from disk everytime I change the filter on the texture?

I don't want to eat all the memory, but at the same time I don't want to eat the disk bandwidth.