The “Midas Touch” problem has long been adifficult problem existing in gesture-based interaction. Thispaper proposes a visual attention-based method to addressthis problem from the perspective of cognitive psychology.There are three main contribution