Is poison ivy contagious if you just walk by the plant?

No, You must have direct contact with the urushiol oil in order to have a reaction. It is highly unlikely for you to get the rash from wind blowing on the plant.