Myself, and others are having this same issue with the same setup.

Frequent random freezing with bluetooth controller connected – how do I go about debugging this?
byu/thomasloven inRetroPie

Hoping for a proper fix soon, until then I just went back to using my pi2.