Touching restaurant food you don't take is offensive and possibly dangerous to other diners. Always use spoons, forks, tongs or other utensils to serve yourself. But even if you do bare hand but decide you don’t want bread, fruit, cake or other food, take it anyhow. Better to waste a roll than spread norovirus or other germs on other buffet diners.