I do believe xserver is included with raspbian, so depending on how you installed your retropie setup you should already have it. That being said I doubt it would mess anything up as it is just the base for the gui. It might stop retropie from autobooting. Always a good idea to make a backup. You can use the windows sd card image program to write an image of you pi sd card that can re installed if you mess something up.
