XDJ R1 sometimes misloading hot cues / skipping hot cues

I'm having a weird problem with XDJ R1 loading hot cues from my USB drive, where one Hot Cue will start at the correct spot but then skip half a beat, sometimes the half beat skipping occurs only after 20 seconds, but it throws the whole mix off. 

1- it only happens sometimes, but enough times during a set to be unnerving and forcing me to listen to a good 30 seconds of the hot cue before mixing the song in and using that hot cue

2- usually only happens on only one Hot Cue (could be A, B, or C it's random), and it can happen on either deck A or B regardless if I'm avoiding to touch anything at all on the whole unit while it loads

3- if I hear the problem and then choose to reload the same track again into the same deck, the Hot Cues usually then load properly

4- if the hot cue that I press starts at 0:30 and (for example) creates that problem of skipping half a beat say at 0:45 of the track, if I don't use that specific hot cue (for instance, if I start the song from the beginning using the play button, or use another hot cue ctarting at 0:15) there is no bug or skipping at 0:45; if a hot cue is creating the problem, the track itself is fine if I start the playback not using that faulty hot cue

5- It happens on random songs, rarely on the same song twice, rarely on the same hot cue button, and happens with any USB drive with pre-set hot cues from Rekordbox 

I have checked online and couldn't find anyone else with the same issue. I found that not touching the deck at all during the loading does help with proper Hot Cue loading, but the problem still persists.I predd the load button and wait until everything is loaded and the problem still happens sometimes.

Should I do a factory reset? Should I attempt to re-install firmware? I'm a bit lost.