Where does the stolen spell go?
It goes to a separate zone as if the Pith Imp was carrying the spell; it does not go to your hand. You may look at the spell and your opponent may not (though they do get to see the spell at the moment you steal it).
If Pith Imp somehow gains Spellcaster, can it pretty please cast the spell it stole?
Yes, that does seem fun!
Market
$0.08
Low
$0.03
Median
$0.16