I picked up my Quest 3 today and played Demeo with a friend. We encountered the same issue:
In AR mode, the game board drifted away from our seated positions, requiring us to manually drag it back each time (took forever to pull it back too).