Quitting in hunting minigame

[GoldenTheory]

for several instances now i keep quitting the hunting mini game on accident. its too easy to quit with the caller on the left d button and while constantly hitting x to get around the map that i often hit the right d button and quit faster than i see the screen that asks if i even want to quit. ive gotten so close to gold many times and quit just before it, please this is so annoying , and a simple menu change would fix this.