Do all shift knobs work for any car?

Like if I purchase a different shift knob from ebay/amazon for my 2004 Scion xA, will it work or does it have to be car specific? Can I get any knob? And how hard is it to change knobs?