Vitamin E condom safe?

So I see some water or silicone lubes have vitamin e in them I always thought vitamin e wasn't condom safe since it's vitamin e OIL. Anybody know anything this. Could you actually use vitamin e as a lubricant itself and be condom safe?