With the exception of a vacuum leak, the idle is affected by the throttle valve being open. What you need to do is figure out what is making the valve stay open.