XDJ-RX2 loads track already playing on other deck, instead of selected new track?

A bit of an odd problem I can't seem to find anyone else having.

This is using the deck in standalone mode with a USB stick.

Sometimes, not always, when I'm in the middle of a set, I will choose a new track in the browser and (for absolute sure) select the not currently playing deck to load it onto, and instead, it will load the song that is already playing on the other deck.

Just to clarify, this is using the white physical [1] and [2] buttons below the menu knob.

It won't auto-play it, nor is it an instant double.

It's really a minor hassle but it does kill a good 5-6 seconds while I have to realize it's the wrong track, and then re-select it from the browser, which usually works, but is a bit confusing.