I'm trying to make a program that simulates human interaction with a game. The program will need to be able to tell if something is on the ground, what is on the ground, where it is, and so on. Ofcourse this would totally depend on the game, but overall I was wondering what the best way to do this would be. Perhaps packets? I don't know. I'm at a loss.