Mice don't actually like cheese and are even repelled by many cheeses due to the smell. If they're hungry enough, they'll try to eat anything, but they won't actively seek out cheese.