Pigeons chose a big payoff option that only hit 20 percent of the time over a small payoff that had better returns in the long run. Karen Hopkin reports