America's Test Kitchen TV Find TV Listings Listen To Our Radio Show
Follow Us

Vanilla Extract

From Season 3: New York Cheesecake

Overview:

In two past tastings of vanilla extract, we reached a conclusion that still amazes us: It matters not a whit whether you use real or imitation vanilla, because you can’t tell the difference when you bake. But at a recent editorial meeting, we took a poll: Did that mean anyone had stopped buying the real thing? No. Our test cooks believed firmly that natural vanilla is the best choice. So we returned to the test kitchen for a definitive tasting. In our newest quest for great vanilla, we sampled 12 of the country’s top-selling supermarket brands of vanilla extract, both fake and pure, this time stirring them into milk and pudding before trying a few choices in cake and cookies.

The Real Deal

Vanilla is a powerful “flavor potentiator,” meaning it enhances our ability to taste other foods including chocolate, coffee, fruit, and nuts, and boosts our perception of sweetness. While this is true for both pure and imitation vanilla, the choices are far from identical. Scientists have identified around 250 flavor and aroma compounds in real vanilla, while the artificial version has just one: vanillin, the predominant flavor in natural vanilla. Pure vanilla is made by steeping vanilla beans in water and ethyl alcohol, with the exact proportions of each mandated by the government. The beans are expensive, grown on flowering orchid vines in only a handful of tropical countries. They take time and painstaking labor to grow, process, and ship, even before they are converted to extract. Imitation vanilla, on the other hand, is a byproduct of paper production or a derivative of coal tar, chemically manufactured through fairly simple and inexpensive processes. Because it’s so cheap, annual global demand for imitation vastly outstrips that for natural vanilla, at 16,000 metric tons to just 40 metric tons for natural vanilla. In our supermarket lineup, imitation vanillas cost as little as 18 cents per ounce, compared with up to $4.50 per ounce for natural. In another strike against natural vanilla, most of those 250 flavor and aroma compounds are driven off by high heat during baking or cooking. So if that complex, natural vanilla flavor really can’t be detected, what’s the point of ever buying it? To answer these questions, we tested vanilla in a variety of cooked and uncooked preparations. First, we stripped away competing flavors to taste the extracts themselves. Vanilla experts do this by mixing them in milk; we used an 8-1 ratio of milk to vanilla. Tasted this way, real vanilla extracts clearly won the day. Their greater complexity shone through, with testers detecting everything from notes of honey and maple to licorice and prune. In this case, imitation vanillas all fell to the bottom half of the rankings. Tasters said they had a strong, pleasing aroma, “like vanilla cookies that have already been baked,” but little vanilla flavor and a taste that was bitter and medicinal. More research revealed that imitation vanilla is known to taste harsh if too much is used—which helps explain our tasters’ reaction. But you would never use vanilla extract in such a heavy concentration. So we sampled them again, in vanilla pudding. Now the ratio of dairy to vanilla was a whopping 56 to 1. Our recipe adds vanilla extract at the end of cooking, off the stove, to help preserve its flavor. Despite this precaution, many of those distinctions we had noted among vanillas in the milk tasting were dimmed. Some aroma and flavor still may have been driven off by the warmth of the cooked pudding and muted by the eggs, butter, and sugar. Our results shuffled, but only slightly—except for one imitation extract that shot from seventh place up to the top of the ranking. One of the most striking differences between pure and fake vanilla involved alcohol flavor. While federal guidelines require 35 percent alcohol in pure vanilla extract, there’s no minimum for alcohol in imitation vanilla, and manufacturers have an incentive to use as little as possible to make synthetic vanillin soluble: If they use more, it costs more to make. This explains why tasters kept describing real vanilla as “boozy,” an adjective rarely applied to fake vanilla. But they also found the real stuff nutty, spicy, and more complex.

The Heat Is On

Real vanilla’s advantage in milk and pudding was clear, but most of time, we’re using vanilla extract in cookies and cakes. To help our tasters focus, we limited our baked-goods tasting to just three samples. After averaging the scores from the milk and pudding tastings, we chose the top-ranked pure vanilla, the highest-ranked imitation, and the bottom-ranked imitation. If tasters couldn’t tell these three vanillas apart in baked goods, we knew the game was up; it really didn’t matter. We baked three yellow cakes and three batches of vanilla cookies—and waited. To our surprise, each recipe showed two distinct outcomes. In cake, the pure vanilla came out on top but just a hair ahead of the high-ranking imitation. In cookies, the pure vanilla dropped to last place, and that high-ranking imitation soared to first place. As it turns out, flavor and aroma compounds in vanilla begin to bake off at around 280 to 300 degrees. Cakes rarely exceed an internal temperature above 210 degrees; cookies become much hotter as they bake. As a result, pure vanilla kept a slight flavor advantage in the cake—but not in the cookies.

Tasters’ Choice

So what’s our conclusion? If you’re only buying one bottle of vanilla for cooking, baking, and making cold and creamy desserts, our top choice is a real extract. If you only use vanilla for baking, we have to admit there’s not much difference between a well-made synthetic vanilla and the real thing. Speaking to pastry chefs, we learned that many buy an arsenal of vanilla extracts, using cheaper imitation for baking and pure for confections made with moderate or no heat, such as puddings, pastry cream, and buttercream frosting. In the test kitchen, we go through so much vanilla extract that we buy it in bulk. So we’ll be ordering our winner by the case. We also recommend our top-rated imitation vanilla for its “mild and gentle” vanilla flavor.

Try AmericasTestKitchen.com
FREE for 14 Days

Start Your 14-Day Free Trial Membership

Get all 13 years of America’s Test Kitchen:

  • Full access to 13 seasons of America’s Test Kitchen recipes.
  • Complete 13 year video library — watch entire episodes or individual clips.
  • Up-to-date results for all our Taste Tests & Equipment Reviews.
  • Easy to print shopping lists, and more.

How we use your e-mail address
Christopher Kimball

Dear Friend,

It is hard to believe, but 2013 marks the thirteenth anniversary of the America’s Test Kitchen television show. Since our very first season, we have been public television’s most watched cooking show and have shared hundreds of our best recipes, equipment reviews, ingredient taste tests, and cooking techniques with our viewers. And, AmericasTestKitchen.com is the only place you’ll find everything we’ve ever featured on the show — every recipe, equipment rating, and taste test since the very first episode of America’s Test Kitchen.

As you may know, America’s Test Kitchen is the home of “Recipes That Work,” and our mission is to be your trusted source for recipes that work every time you use them. Our test cooks spend their days obsessively testing recipes until they offer consistently great results. As we like to say here, “We make the mistakes so you don’t have to.” So, try out our website for a 14-Day, No-Hassle Trial Offer. Whether you are new to America’s Test Kitchen or have been an avid viewer for years, I think you’ll find AmericasTestKitchen.com to be an invaluable resource.

Thanks for your consideration,

Signature

Christopher Kimball
Founder and Publisher

Product Tested Price*
Highly Recommended
Columela Extra Virgin Olive Oil
Columela Extra Virgin Olive Oil

Our favorite premium extra-virgin olive oil from a previous tasting, Columela is composed of a blend of intense Picual, mild Hojiblanca, Ocal, and Arbequina olives. This oil took top honors for its fruity flavor and excellent balance. Tasters praised its big olive aroma, big olive taste with a buttery flavor that is sweet and full, with a peppery finish. One taster said: Its very green and freshlike a squeezed olive. Another simply wrote: Fantastic.

$19 for 17 oz
Recommended
Lucini Italia Premium Select Extra Virgin Olive Oil
Lucini Italia Premium Select Extra Virgin Olive Oil

Tasters noted this oils flavor was much deeper than the other samples, describing it as fruity, with a slight peppery finish, buttery undertones, and a clean, green taste that was aromatic, with a good balance. It has the flavor that some good EVOOs have, said one admiring taster.

$19.99 for 500 ml ($39.98 per liter)
Colavita Extra Virgin Olive Oil
Colavita Extra Virgin Olive Oil

Virtually tied for second place, this oil was deemed round and buttery, with a light body and flavor that was briny and fruity, very fine and smooth, and almost herbal, with great balance. Good olive flavor. I could smell it and taste it, approved one taster. In a word, pleasant.

$17.99 for 750 ml ($23.98 per liter)
Recommended with Reservations
Bertolli Extra Virgin Olive Oil
Bertolli Extra Virgin Olive Oil

A clear step down from the top oils, tasters noted overall mild flavor and very little aroma, with only a hint of green olive and a hint of spiciness at the end. In pasta, it was initially not complex, but gradually bloomed in your mouth. Overall, it was worthy of a second bite.

$12.49 for 750 ml ($16.65 per liter)
Filippo Berio Extra Virgin Olive Oil
Filippo Berio Extra Virgin Olive Oil

While some tasters found this oil sweet and buttery with medium body and slight spice at the end, others complained that it had zero olive flavor and was so floral its almost like eating perfume; still others noted a bitter aftertaste. In pasta, it was extremely mild to the point of being boring.

$10.99 for 750 ml ($14.65 per liter)
Goya Extra Virgin Olive Oil
Goya Extra Virgin Olive Oil

Comments: The best comments tasters could muster were mild and neutral. Some liked it on pasta (though one called it Snoozeville), but complaints were myriad: metallic, soapy, briny, hints of dirt. Carped one taster, I cant imagine what is in here, but they have a nerve calling it EVOO.

$13.99 for 1 liter
Pompeian Extra Virgin Olive Oil
Pompeian Extra Virgin Olive Oil

Comments: While some tasters called this oil mild and smooth, others found it thin, greasy and not very interesting. I bet the cooking water had more olive flavor, speculated one taster; could be canolait is so bland, mused another. A few noted an objectionable aftertaste that was soapy, chemical or mentholthink

$9.99 for 473 ml ($21.12 per liter)
Botticelli Extra Virgin Olive Oil
Botticelli Extra Virgin Olive Oil

While a few tasters liked this potent oil, others said they detected mushroom, rotten walnuts, a Band-Aid wrapped in a cherry blossom, and a quality that was downright medicinalTriaminic, anyone? Several deemed it overpowering and musky, with a rank, off-flavor. Tastes not like olives but like the armpits of olive laborers, shuddered one.

$10.99 for 1 liter
Not Recommended
Carapelli Extra Virgin Olive Oil
Carapelli Extra Virgin Olive Oil

Italy, Greece, Spain, Tunisia, Turkey, Cyprus, Morocco, and Syria Comments: Nothing remarkable herejust greasy, no flavor, summarized one taster. Where did the olive go? said another. This oil was judged to have a kind of rancid aftertaste that was reminiscent of not only soil, tree resin, and ammonia and grass, but even kitty litter smells and a set of sweaty hockey pads.

$10.99 for 750 ml ($14.65 per liter)
DaVinci Extra Virgin Olive Oil
DaVinci Extra Virgin Olive Oil

Although this oil won top place in a previous tasting, because olive oil is an agricultural product, it can differ from year to year. This time, tasters found it washed out and muted, if nice, in a totally bland and unremarkable way. Tasted plain, objections ranged from insipid, with no real complexity to tastes like EVOO mixed with vegetable oil.

$17.99 for 1 liter
Star Extra Virgin Olive Oil
Star Extra Virgin Olive Oil

Origin: Spain, Italy, Greece, and Tunisia Comments: Boring and not very complex, this oil came across as plastic-y and industrial; some hint of olives, but it fades quickly. Tasters identified off-flavors that were unpleasant, dirty, like rubber and metal, with a sour aftertaste, or at least a bit funky, with a strange taste that was spicy, but in a motor oil kind of way. One simply wrote, Blech.

$11.99 for 750 ml ($15.99 per liter)
*Prices subject to change