oh man, i always ask this first so don’t get upset:
did you run the “Register RetroArch Controller” option in the setup?

if you did already, maybe you’re N64 emulator is not a “libretro/retroarch” compatible one. which means you may need to setup the controller manually…