I agree with you totally. Its a great feature to have in restaurants and places the require to pass food/drinks on to other users. However i do find it quite annoying when people just keep handing it to you, and as said before, ruins the game 'fridge races'
It's a shame Sulake did not implement a design where room owners can toggle the feature on or off. Perhaps they will in the future.