Menu
Search
Menu
Close

Vanilla Beans

From Cool and Creamy Desserts

How we tested

We tested five brands of vanilla beans sourced from Madagascar (the world’s largest producer)—three mail-order beans and two from the supermarket—wondering if the tides had turned since we rated them more than a decade ago. At that time, we couldn’t recommend any supermarket samples, finding them dried out and hardened, with few seeds and even less flavor.

To assess the differences, we sliced open a pod from each brand and scraped out the seeds. We then used the seeds in an uncooked cream cheese frosting and simmered both seeds and pods in dairy for use in a simple crème anglaise and in the base of our Vanilla Ice Cream.

This time around, in a surprising reversal, we found the supermarket beans not only improved, but also slightly better than the mail-order ones. While some variation can be expected from any agricultural product, most of the differences among beans likely came from how much of the flavor compound vanillin was developed during the curing process. For Madagascar beans, this involves dipping the pods in hot water to halt all growth, drying them in the sun, and placing them (wrapped in cloth and straw mats) in wooden boxes to sweat overnight. This cycle is repeated until a manufacturer decides that the beans are ready to be moved to holding rooms, where they rest until they’re shriveled, brown, and fragrant—an indication that they’re ready for sorting.

Bottom line: Although all of the brands were acceptable, we recommend splurging on our winner (at $15.99 for two, they’re more costly than the mail-order brands) when you want moist, seed-filled pods with complex flavor that tasters called exceptionally “robust” and “vivid.”

Try AmericasTestKitchen.com
FREE for 14 Days

START YOUR 14-DAY FREE TRIAL MEMBERSHIP

Get all 17 years of America's Test Kitchen:

  • Access to 17 seasons of America's Test Kitchen recipes
  • Complete 17 year video library--watch entire episodes or individual clips
  • Up-to-date taste tests and equipment reviews
  • Easy to print shopping lists, and more

The Results

Winner
Recommended

Skippy Peanut Butter

In a contest that hinged on texture, tasters thought this "smooth, "creamy" sample was "swell" and gave it top honors, both plain and baked into cookies. Its rave reviews even compensated for a slightly "weak" nut flavor that didn't come through as well as that of other brands in the pungent satay sauce.

$2.39 for 16.3-oz. jar (15 cents per oz.)*
Recommended

Jif Natural Peanut Butter Spread

The big favorite in satay sauce, this peanut butter's "dark, roasted flavor"—helped by the addition of molasses—stood out particularly well against the other heady ingredients, and it made cookies with "nice sweet-salty balance." Plus, as the top-rated palm oil-based sample, it was "creamy," "thick," and better emulsified than other "natural" contenders.

$2.29 for 18-oz. jar (13 cents per oz.)*

Reese's Peanut Butter

This is what peanut butter should be like, " declared one happy taster, noting specifically this product's "good," "thick" texture and "powerful peanut flavor." In satay sauce, however, some tasters felt that heavier body made for a "pasty" end result.

$2.59 for 18-oz. jar (14 cents per oz.)*

Skippy Natural Peanut Butter Spread

The only other palm oil-based peanut butter to make the "recommended" cut, this contender had a "looser" texture than its winning sibling but still won fans for being "super-smooth." Tasters thought it made an especially "well-balanced," "complex" peanut sauce.

$2.39 for 15-oz. jar (16 cents per oz.)*
Recommended with Reservations

Peanut Butter & Co. No-Stir Natural Smooth Operator

Though it says "no-stir" on the label, this "stiff" palm-oil enriched peanut butter was "weeping oil" and came across as "greasy" to some tasters. However, it turned out a respectable batch of cookies—"chewy in the center, crisp and short at the edge"—and made "perfectly good" satay sauce.

$4.49 for 18-oz. jar (25 cents per oz.)*

Maranatha Organic No Stir Peanut Butter

On the one hand, this organic peanut butter produced cookies that were "soft and sturdy" yet "moist," with "knockout peanut flavor." On the other hand, eating it straight from the jar was nearly impossible; its "loose," "liquid-y," and "dribbly" consistency had one taster wonder if it was "peanut soup."

$5.69 for 16-oz. jar (36 cents per oz.)*
Not Recommended

Smart Balance All Natural Rich Roast Peanut Butter

Besides being unpalatably "tacky" and "sludgy," this "natural" peanut butter suffered from an awful "fishy" flavor with a "weird acidic aftertaste" that tasters noted in all three applications. Our best guess as to the culprit? The inclusion of flax seed oil, an unsaturated fat that's highly susceptible to rancidity.

$3.59 for 16-oz. jar (22 cents per oz.)*

Smucker's Natural Peanut Butter

With its only additive a negligible amount of salt, the only truly natural peanut butter in the lineup elicited comments ranging from mild dissatisfaction ("needs enhancement with salt and sugar") to outright disgust ("slithery," "chalky," "inedible"). Cookies were "dry and crumbly" with a "hockey puck" texture, and the satay sauce was "stiff," "gritty," and "gloopy."

$2.69 for 16-oz. jar (17 cents per oz.)*