Question did you ever install a cabin air filter? That sounds like their is a leaf or trash (in my case a sheet of paper) hitting your blower.
---------- Post added at 03:14 AM ---------- Previous post was at 03:08 AM ----------
http://www.scionxdforum.com/forum/sh...t=cabin+filter
This link should help if you have never opened up the glove box compartment.