After I spray poison ivy with weed killer, can I get a rash?

Yes. Even when the plants are dead, the resin that causes the rash remains active. Removing the plants entirely is the best way to avoid contact with them.