Check out this exchange between Arnie Weissmann, Travel Weekly's vice president and editor in chief, who moderated the discussion; Tim Zagat, co-founder of Zagat Surveys; and Arthur Frommer, founder of Frommer's Travel Guides:
"Weissmann: If a consumer sent something to the Zagat Survey that struck you as insightful and authoritative, but was the only person to voice that opinion, would you print it?
Zagat: If the opinion says what other people are saying, or more or less says what people are saying, we will print it. And we like to find opinions that are especially well said.
Weissmann: So if somebody had an observation that struck you as insightful, but they were a minority of one ...
Zagat: We would not print them. We never print a minority of one. But you don't find that. What you find is that there are themes. I mean, these reviews practically write themselves.
The average restaurant in New York has got 1,000 comments on the survey, but the first 100 people say it all, and the others say the same things again and again and again. Pick a restaurant. How many ways can you describe it? Or a hotel?
Frommer: Wasn't it Ibsen who said that the majority is always wrong?
Would you not rather rely on the prognostications or the appraisals by Frank Bruni, the ...
Frommer: ... restaurant critic ...
Frommer: ... of the New York Times ...
Frommer: ... than on 100 New Yorkers ...
Frommer: ...who have no ...
Zagat: No, no, I would absolutely not, and I will tell you why. First of all, 100 people who filled out our surveys on a specific restaurant will have gone there an average of 11 times each. That means the restaurant has been visited 1,100 times. Frank Bruni has to write another review next week, so he goes once, twice, three times, maybe four.
Frommer: But Frank Bruni has a basis for comparison.
Zagat: What the hell does he have? A Ph.D in taste buds?"
I love that last quote: "What the hell does he have? A Ph.D in taste buds?"
The answer for consumers -- and to travel businesses -- is that you should probably blend restaurant and hotel reviews from the Frank Brunis of this world with hotel reviews written by guests and restaurant patrons, too.
But, as you can see from the above exchange, people like Frommer, who as a guide-book publisher has a vested interest in promoting professional reviews, have a deep distrust for the opinions of average travelers because Joe and Betty Vacation haven't earned their Ph.Ds in room service or hotel-check-out.
Yes, Mr. Frommer, the majority can be wrong, and solitary and minority opinion can inform.
But, in hotel or restaurant reviews, don't dismiss the majority opinion, either.
After all, Joe and Betty Vacation may have an insight that Bruni wouldn't have considered in 5 million years.
@BeatofHawaii kicked off the latest -- what @UpTake characterizes as -- "@TripAdvisor review manipulation kerfuffle," by pointing to TripAdvisor's practice of posting warning notices alongside hotels that allegedly have gamed the hotel-review system.
And BeatofHawaii (Jeff) subsequently clarified his position, tweeting that he values traveler reviews, but "92 fraud badges don't scrape surface of problem. Feels like TripAdvisor wants traffic and reviews at virtually any cost."
We agree that TripAdvisor's reputation and business is at stake when hoteliers muck up the works and encourage fraudulent reviews so I'm sure TripAdvisor will do everything it can to police its hotel reviews.
I like Priceline's approach, which it recently modified.
Priceline stated: "Most hotels now feature a detailed guest scorecard. The scorecard ranks the hotel’s popularity among Priceline hotel guests and shows when a hotel is ranked among the top-rated hotels for a specific city. Also, each hotel receives a guest satisfaction score in 5 different satisfaction categories -- overall quality, cleanliness, staff, location and dining. Unlike other hotel review services that allow anyone to post a review, the priceline.com scorecards are based on surveys that priceline.com hotel guests receive after they’ve completed their stay."
In addition, Priceline took steps to make it easier to enable travelers to search reviews based on their own demographic profile or interest.
Priceline states: "Now, guest hotel reviews can be sorted and grouped according to 7 different traveler types -- solo travelers, groups, seniors, couples, families with teens, families with young children and business travelers. This gives potential hotel guests the ability to search their hotels through the eyes and experiences of like-minded travelers. Priceline.com also offers exclusive hotel and restaurant ratings and reviews from Zagat Survey, LLC."
Any hotel-review system can be manipulated to some extent, and that's especially true, as @RobertKCole pointed out, when it comes to smaller, non-chain properties.
Priceline's policy of limiting hotel reviews to authors who booked their stay on Priceline diminishes the number of potential reviews, but greatly enhances their credibility.
I don't know if TripAdvisor would be able to institute such a policy since it is a research and planning site and doesn't handle bookings.
But, one thing TripAdvisor could and should do immediately is to take the additional step of banning, for a set time frame, the display of hotels that haven't played by the rules and have earned review-manipulation notices.
Then, TripAdvisor, we'd know that you really are serious about the problem.