Hi all,
could you kindly tell me how to erase duplicate lines in a text file? such as effective algorithm or data structure?

Thanks a lot!!!