If they just left the box with you, then you don't have to pay anything. If you end up re-sending it to the buyer again, you (or the buyer) would have to pay shipping again.
I'd contact the buyer and see what's up - maybe their address is wrong, or they moved. Really weird that they didn't contact you about it though! You think they'd want their ponies.