I switched form a 2500 rpm drill to a pnuematic die grinder because I wasn't generating enough sfpm with the drill, now I'm getting an oily residue left on my piece that I wasn't getting with the drill. I've raked and cleaned all my buffs and my piece several times but I'm still getting it, and it's not just certain wheels it's all of them

The only thing I can think of is that it's the moisture from the air mixing with the polish on the buff?
Anybody else run across this, know how to avoid it?? Is it going to hinder the polishing process?