It will mess up as soon as there is one single moment of pause during the game (lag, loading times, etc.) and the longer the file, the longer the offset will be. It's really not an option. Half a second wouldn't be so bad, but we're talking here probably about half a second every 10 seconds. :/