If you use the configure menu in the retroarch-setup script it should create a new file in /opt/retropie/configs/all/retroarch.cfg
Can you post that up on pastebin.com? Then do it again but this time with the second controller? I think it may overwrite the first file, so thats why I say grab those details first.