To a certain subset of board game players, dice get this reaction. Not a specific use of them, but dice full stop. A less extreme, and significantly more common, version of this being "dice are fine, the roll and move mechanic isn't."
One reason players of board games object to dice more than players of Tabletop RPGs do is that board gamers are traditionally supposed to roll dice where everyone can see them (thus, no computer dice), and the makers of the games rarely provide a safe place to roll them. "Roll and move" can get ambiguous if your dice have just knocked your piece off the board.
Some board games (Trouble comes to mind) try to get around the wild dice by packing them inside a small plastic dome not much bigger than the dice. You press down to "roll." This has its own problems; you can get a numb palm with a long game of one of these, and the mechanism might malfunction, forcing you to either break it open to get at the dice, or roll dice obtained elsewhere.
Others, like Candy Land and Sorry!, eschew dice for a deck of specially-printed cards. Still random, but for some reason, card randomness is less hated than dice randomness.
Many players also prefer games to be mostly or entirely choice-driven, thus placing an emphasis on skill versus luck. It's quite disconcerting to see a hardcore boardgamer overturn a table and stalk away after winning a game on the luck of a draw.
It seems a little dubious that dice themselves are a scrappy mechanic.
Removed:
It seems a little dubious that dice themselves are a scrappy mechanic.