I'm using hand tracking which works really nicely, but because you can't lock the boards location and scale. Any fists made during play cause the board to move and or change scale.

Like in the game BAM! a specific location should be used to move or change the scale. I can't imagine how annoying it would be to play local MP and have everyone unintentionally moving and rescaling the board.