A blog devoted to exploring wines made from unusual grape varieties and/or grown in unfamiliar regions all over the world. All wines are purchased by me from shops in the Boston metro area or directly from wineries that I have visited. If a reviewed bottle is a free sample, that fact is acknowledged prior to the bottle's review. I do not receive any compensation from any of the wineries, wine shops or companies that I mention on the blog.
Showing posts with label Soap Box. Show all posts
Showing posts with label Soap Box. Show all posts

Thursday, November 29, 2012

Book Review - Wine Grapes, by Robinson, Harding & Vouillamoz

When I first learned about the impending publication of the massive Wine Grapes, I was both excited and a little nervous.  I was excited because it looked to be just the kind of thing that could help me a lot in doing research for this blog, but at the same time, I worried that its publication would make me obsolete.  The book purported to be the ultimate guide to wine grapes, and I worried that everything interesting that could be said about many of the grapes that I try would already be said here and there would be no reason for me to continue with this site.  I pre-ordered the book many months in advance and began the waiting process.  That process ended a few months ago with the release (and delivery) of this massive tome, which I've now had some time to read through and put some thoughts together about.

Those who are unfamiliar with some of my other posts should note that I've had some issues in the past with the crew responsible for publishing this book.  This is the same editorial team that is responsible for maintaining the online version of the Oxford Companion to Wine, and many of the findings from this book were previously published through that venue.  In several of my prior posts, I've noted issues or problems that I've found in the online version of the OCW, some of which I addressed to the editors, but none of which were really satisfactorily resolved.  The first involved their entry on Hondarrabi Zuri (link goes to my discussion of the issue), where they claimed that it was actually the same as the American hybrid Noah, while the second involved their publication of an alternate parentage for Emerald Riesling, which turned out to be correct, but which they refused to divulge their source for.  I'm not going to delve back into either of those topics, as I've said all I card to say in those posts, so interested readers are advised to follow the links and read away.

Before I get into the issues I have with this new book, I do want to start out with a list of the things that I really liked about it.

1) It is gorgeous.  The layout is easy to follow and though there is a lot of information presented for most of the grapes, the book never feels overwhelming.  The slipcase is a nice touch as well and I much prefer the burgundy color for the US publication to the cream color for the UK.

2) Most of what is presented is accurate.  The book is thoroughly researched not only from a scientific standpoint, but from a historical and ampelographical one as well.  Much of the information provided is adequately cited and the bibliography is comprehensive.

3) The scope of the work is astounding.  It claims to be a "complete guide to 1,368 vine varieties," and while I didn't count to make sure they're telling the truth, the 7 pound weight and nearly 1,250 pages would seem to indicate that they are.  There is no other single volume available with more information on more grape varieties than this.  No really serious wine adventurer will want to be without this volume for very long.

4) The signed bookplates that the group gave away was a very nice touch.  All you had to do was email your address to someone affiliated with the publication team and they mailed out a book plate signed by all three authors for you to affix to the inside cover of your tome (for free!).  If you haven't ordered the book yet or haven't yet asked for a signed bookplate, you're probably too late, I'm afraid to say, as they only did a few hundred of them.  I'm happy to have received mine and think it was a nice way for the contributors to thank people for laying out some serious cash for this book.

All that said, there are some issues I have with the book.

1) The color plates.  There are 5 sections within the book that contain 8-10 pages of full color reprints of illustrations from a turn of the century (last century) work of ampelography.  These sections are evenly spaced throughout the book.  They're printed on a different kind of paper that is actually a different size (smaller) than the rest of the pages, and when you try to flip through the book, you inevitably land on one of these sections.  They're nice to look at, but they're completely unnecessary and kind of in the way.  The book retails for $175, and one wonders how much of that they could have shaved off by doing away with these.

2) It is sometimes difficult to find exactly the grape you're looking for.  They put a grape's main entry under its most common synonym in the country that is thought to be its ultimate home.  This is fine for most grapes, but you end up with some weird things like having Carignan listed under Mazuelo, which is a synonym I'm only familiar with in Rioja.  The index is helpful for navigating around this issue (which was probably inevitable given the book's scope), but flipping back and forth in a 1,250 page work is no picnic.  There are some guidepost entries throughout the text that redirect you to the proper name, but these are somewhat erratically placed.

3) The research.  This is my biggest issue, and it's what I'm going to spend the bulk of the rest of this review talking about.  If you don't care about it, feel free to close this browser window now and you'll be welcome back when I get back to reviewing unusual wines in the next few days.

The problems I have with the research for this volume fall into two broad categories.  The first category concerns research done by others that is reported in Wine Grapes.  As I mentioned earlier, most of the information in the book is accurate and is well researched, but there are a few places where the research is either sloppy or inaccurate for personal reasons.

For example, I recently wrote about the Fetească Albă grape from Romania, and in that post I lamented that the OCW mentioned that the long-accepted synonymy between this grape and the Leányka of Hungary was inaccurate, but I had some difficulty tracking down their source for the information since it was only cryptically mentioned and not cited.  This assertion is reprinted in Wine Grapes, and 2 citations are given.  One is the paper that I mentioned in my post on Fetească Albă, which has some serious methodological issues and can hardly be taken to be indisputable (please see that post for more details).  The other is this paper from a Hungarian team, which, while interesting, does not actually say anything at all about the relationship between Fetească Albă and Leányka.  It does say that Leányka and a grape called Leányszolo are not identical, but there is no mention at all of Fetească Albă anywhere in the paper.  Citations are great, but only if the research that you're pointing to actually says what you're claiming it says.

As for the charge of inaccuracies due to personal reasons, the example of Ciliegiolo and Sangiovese provides a nice example.  As mentioned in my previous post on the Ciliegiolo grape, the exact relationship between Ciliegiolo and Sangiovese is contentious.  It is known that the two grapes have a parent/offspring relationship, but there are two different theories as to which is the parent and which is the offspring.  The first was reported by Jose Vouillamoz (and several other Italian scientists) in 2007 and they claim that Sangiovese's parents are Ciliegiolo and a grape called Calabrese di Montenuovo (which Vouillamoz & crew supposedly just stumbled across somewhere in Calabria...it is unclear whether it exists in any holding facilities or even whether any other research teams have been able to obtain a sample to test for themselves, all of which will lead into my final issue in the following paragraph).  The second (authored by Di Vecchi Staraz and others, full citations are in my Ciliegiolo post linked above) shows that Sangiovese and a grape called Muscat Rouge de Madére are the parents of Ciliegiolo.  Vouillamoz's results have not been duplicated by any other group, but Di Vecchi Staraz's findings have been duplicated in at least 2 different studies.  Wine Grapes, whose scientific content was edited by Vouillmoz, presents Vouillamoz's findings as if they were the final word on the matter.  The book does make mention of Di Vecchi Staraz's findings, but dismisses them because they "do not fit with the parentage of Sangiovese (Vouillamoz, Monaco et al 2007)," which is question begging of the worst kind.  The book does note that there were other "discrepancies" in Di Vecchi Staraz's findings, but I've not seen those discrepancies indicated anywhere else, and, as mentioned above, there have been 2 studies in the past year that have shown that Di Vecchi Staraz's analysis is correct.*

All of which brings me to my major second concern with some of the research presented in Wine Grapes, which is that it is private research.  There are many posts where the citation for the information provided is given simply as (Vouillamoz).  Vouillamoz has several publications listed in the bibliography of the book, and when one of them is referenced, the year is always given.  These (Vouillamoz) citations represent something different, though, which isn't ever really fully explained in the text.  Vouillamoz maintains a private DNA microsatellite database with information on various grapes that he has either analyzed in the course of his research, or which may have come from other studies that he has read.  Much of the stuff that the OCW has published, and many of the relationships published in Wine Grapes, were "discovered" by Vouillamoz by sifting through the information in his private database, or by Vouillamoz conducting experiments on his own and publishing the results in Wine Grapes for the first time.

As an example, Wine Grapes publishes that Listán Prieto, aka Mission, and Listán Negro from the Canary Islands are actually two different grapes, despite the fact that they have long been considered to be the same variety. Vouillamoz claims that a "study" has shown that Listán Negro actually has a distinct DNA profile, but his citation is "(Vouillamoz; Jorge Zerolo, personal communication)," neither of which can be called a "study" in any meaningful sense.  The information is presented, though, in a way that makes it seem like the finding has been verified by DNA research (there is an icon in the book, that is probably supposed to look like a double-helix but which just looks like a circle with open semicircles on its top and bottom, used to represent when a synonym or a homonym has been "verified" by DNA studies, and that icon is used here), when in fact it seems that it has only been seen in one non-published "experiment."

Here's the problem with this: it isn't science**.  The information that Vouillamoz chooses to publish in this way may be interesting, but it's wrong to consider these findings "scientific" in any way.  There's a process that people have to go through in order for their ideas to be accepted by the wider scientific community.  That process involves not only performing the experiments and analyzing the results, but publishing them in a peer-reviewed journal as well.  If you read through any of the papers I link to on this site, you'll see that they aren't just a guy asking a question and then announcing that he's answered the question.  The paper goes through the entire set-up for the experiment and shows the data obtained from the experiment described.  This process exists so that other scientists (or anybody, really) can analyze your methodology and your results to see whether your experiment actually can give the kind of information that you claim it can and whether it actually does give the information that you claim it does.  The foundation of good science is reproducibility, which means that others should be able to read your paper and perform your experiments themselves to see whether they obtain the same results as you.  Just publishing findings doesn't fly.  You're not right when you make a discovery; you're right when someone else verifies your results.***

I'm not suggesting Vouillamoz doesn't know what he's doing or that he has fabricated results.  What I am saying is that any information that he provides from private research or from any source that is not a scientific journal is unverified.  My issue isn't the publication of unverified findings, but rather that this information is presented to the reader in such a way that is difficult to separate from the more thoroughly researched findings.  It is given to the reader in a format that very closely resembles properly cited findings, so the lazy reader notes the parentheses and moves on, seeing a citation where none exists.  When citing the published results of others, readers can consult that source and decide for themselves whether the findings seem accurate given the description of the experiment and the publication of the data.  This empty citation, though, leads nowhere and does not even have a corresponding entry in the Bibliography.  It is telling us that Vouillamoz did something, but there's no way for us to see what it was.  By just giving the conclusion for this private research, the book is essentially asking us to take Vouillamoz's word that he did everything correctly and that his experiments and/or his interpretations are sound.  Given some of the issues I've encountered previously in his work, that doesn't feel like a safe assumption to make.

I'm not saying that Wine Grapes is worthless because of these issues.  As I said before, the overwhelming majority of the information in the book is accurate, interesting and informative.  What I am saying is that some of the information they present as if it were scientific fact is not that at all and should be taken with a grain of salt.  I feel that the book could have been better if some of the controversies were more thoroughly explained or if some of the posts had less of the authoritarian air that they carry.  Jose Vouillamoz is a good scientist, but asking a single scientist to compile all of the information for this book was probably not the best idea.  What you get is a single expert's bias, which doesn't produce a very scientific result.

My bottom line is that this book is now my first line of research for pretty much every post I'll write from here on out.  It's an incredible resource that I look forward to enjoying for many years.  But like any first line resource, I'm not going to be content to stop my research there, and I will pursue any questions I have as far as I can, or until I feel that they have been thoroughly answered.  Grape genetics is a rapidly moving field that I enjoy following along on the sidelines.  I think in about another decade, the 2nd or 3rd edition of this work may end up being definitive, but we're just not quite there yet.

*The first is mentioned in my post on Ciliegiolo. Citation is: Cipriani, G. et al. The SSR-based molecular profile of 1005 grapevine (Vitis vinifera L.) accessions uncovers new synonymy and parentages, and reveals a large admixture amongst varieties of different geographic origin. 2010. Theoretical and Applied Genetics. 121: 1569-1585.

The second is Lacombe, T., Boursiquot, J.M., Laucou, V., Di Vecchi-Staraz, M., Peros, J.P., & This, P. 2012. Large scale parentage analysis in an extended set of grapevine cultivars (Vitis vinifera L.). Theoretical and Applied Genetics. In press.

**You may argue that I'm missing the point here.  This book is for entertainment purposes and is not intended to be a scientific treatise, you may say.  And you may be right.  But the book is being marketed in such a way and its content is arranged in such a way that the authors clearly want you to think that what they are publishing has been "scientifically proven."  I am arguing that this insinuation is dishonest on their part, as much of the data they are publishing is unproven in a scientific sense. Think I'm overstating their case? The following is the publisher's blurb for Wine Grapes from Amazon.com:

"Using cutting-edge DNA analysis and detailing almost 1,400 distinct grape varieties, as well as myriad correct (and incorrect) synonyms, this book examines grapes and wine as never before. Here is a complete, alphabetically presented profile of all grape varieties of relevance to the wine lover, charting the relationships between them and including unique and astounding family trees, their characteristics in the vineyard, and—most important—what the wines made from them taste like."

Their claim is that they have used "science" or some "science-like substance" to show the truth about many grapes and how they are or are not related to one another.  All I am trying to show is that their methodology isn't always sound, and as a result, some of the conclusions that they reach are hardly as definitive as the confident tone of the blurb and the text itself would lead you to believe.

***As I've pointed out numerous times on this site and a few times in this post, this isn't insignificant stuff (well, it may be in a cosmic sense, but you know what I mean).  Vouillamoz's claim regarding Fetească Albă and Leányka comes from a paper that used samples from a holding facility known to have labeling errors.  This is a methodological issue that requires follow-up research, but we wouldn't know that without the full published paper.  I don't believe that the follow-up research has been done, which only means that the question is currently open until proven otherwise (but if forced to make a decision, you're probably wiser staying away from the findings of a flawed study and opting instead for the belief that the prior hypothesis was correct).  Additionally, Vouillamoz's claim about the relationship between Ciliegiolo and Sangiovese has not been replicated by any other group, and it is unclear whether it can be because of the special nature of one of the purported parents.  If other groups cannot test Calabrese di Montenuovo themselves (and I do not know whether they can or not, but no one else has, as far as I can tell), then we just have to take Vouillamoz's word for it that the grape that he happened to stumble across (he himself says it was "fortuitously sampled") is the long-lost parent of one of the most famous wine grapes in the world. The thing is, we don't have to take his word for it, because we have information from three other publications from three other labs that have all independently shown that Vouillamoz's findings cannot possibly be right, since Sangiovese is itself a parent to Ciliegiolo and is not one of its offspring.  Their methodologies and results relied on grapes and samples that other labs could access and test themselves rather than on one-off field samples and private databases.

UPDATE: I uncovered a bit more on the Ciliegiolo/Sangiovese issue recently, and posted my findings in the comments to this post.  You can read the relevant information here.  

Monday, July 9, 2012

The Truth about Emerald Riesling

A few months ago, I wrote a post about the Emerald Riesling grape, which was created by Dr. Harold Olmo at UC Davis and released to the public in the 1940's.  In that post, I wrote that the parentage given for Emerald Riesling by Dr. Olmo and by virtually every other source online was Muscadelle x Riesling.  Only one source that I could find dissented from this view: the online version of the Oxford Companion to Wine listed the grape's parentage as Muscadelle x Grenache.

I had been in touch with Julia Harding MW and Dr. Jose Vouillamoz, both of whom work not only on the online version of the OCW but also on this massive new book on Wine Grapes due out in October, regarding their entry on Hondarrabi Zuri, which I was able to help them clean up a bit.  I sent the following email to Julia asking for clarification on their Emerald Riesling post:

"Hi Julia:

While researching Emerald Riesling for my most recent post, I saw that
the OCW had the grape's parentage listed as muscadelle  x grenache,
though every other source I found has it as riesling x muscadelle
(most notably the VIVC database:
http://www.vivc.de/datasheet/dataResult.php?data=3894).  Is this
something else that was found during your recent research for your
book or is this a mistake?

Rob"


To which Julia responded:

"Muscadelle x Riesling is wrong but you will have to wait for the grape book for the full story. We can't give you all our scoops!"


I wrote an aggrieved response to this in my second post on Hondarrabi Zuri, where I expressed my frustration that the OCW refused to provide any source material for the information that they were publishing, and were further insisting that in order to get that information, I would have to order their forthcoming book (which at the time retailed for $125, but now retails for $175).  For those who don't wish to read that entire post, the relevant bit is here:

"I would be fine with this if I wasn't already paying (dearly and annually, I might add) for the electronic version of the OCW, which they are coyly updating on the fly as they find new information, whether it is correct or not.  If I were paying for an online version of the book I also have on my shelf at home, that's one thing, as static reference materials go out of date all the time.  But since they are updating the work online, it doesn't seem unreasonable to ask for clarification on a matter where the information that they are printing is in opposition to every other resource currently available, including a written statement from the man who created the grape himself.  The OCW is a valuable resource, but they're not infallible, as I hope I've shown in this post.  If you are going to charge people for access to information, I feel that you should be prepared to justify that information if asked and should not point them to another place where they can give you more money for the whole story.  If you're willing to publish part of the story in the OCW and take people's money for it, you should be willing to publish the whole story instead of using premium content as a teaser for more premium content."


I was annoyed at the time, but after this weekend, I'm legitimately angry.  I had been working under the assumption that the new parentage for Emerald Riesling was something that the editorial group had discovered in doing their own private analyses.  Dr. Vouillamoz was the curator for several years of the Swiss Vitis Microsatellite Database and in some of my prior email correspondences he had referenced data held within this database.  I was assuming that Dr. Vouillamoz or someone affiliated with the OCW had conducted the parentage analysis on Emerald Riesling based on some of his own data, and that rather than publish the data through scientific journals, they were electing to publish it in the new book due out later this year.  I wasn't thrilled about this particular arrangement, but if it was their own original research, they're free to do with it what they will and if they elect to sell it rather than make it available for other scientists, researchers, and general enthusiasts that's their own prerogative.

It turns out, though, that this isn't the case.  On Friday evening, reader George sent me an email entitled "Emerald Riesling - the truth," wherein he included a link to a newsletter published by UC Davis in 2006.  On page five of that newsletter, in an article entitled "Vouchers Hold the Key to Successful Grape DNA Identification," is the following paragraph:

This method of analysis has been used to verify the
identification of all of Dr. Olmo’s named varieties at
FPS. The parental analysis described above was consistent
for all of his varieties except ‘Emerald Riesling,’
recorded as a selection from the cross of “Muscadelle
(CA)” and ‘Riesling’. We had previously determined that
the cryptic “Muscadelle (CA)” was a vine labeled “Muscadelle
du Bordelais” from an old block of vines in the
Department of Viticulture and Enology’s collection that
served as one parent for ‘Emerald Riesling.’ ‘Riesling,’
however, had DNA markers that were not consistent
with what would be expected from the other parent.
Dr. Andy Walker of the Department of Viticulture and
Enology suggested that ‘Grenache’ be considered, since
it has traits in common with ‘Emerald Riesling.’ Analysis
of our database verified that ‘Grenache’ and “Muscadelle
du Bordelais,” were the true parents of ‘Emerald Riesling.’

While I was unable to find this during the course of my research (this article is a PDF and I'm not sure how well Google is able to search inside PDF documents online), it is available for free online through the UC Davis website.  Now, I can't prove that this is the source that the OCW was using (UPDATE - it is, as cited in their new book Wine Grapes, which I've reviewed here), and I can't prove that they didn't happen to stumble across the correct parentage for Emerald Riesling on their own and that this line of research is what they are using to justify their entry.  I can say that the second explanation there seems very unlikely to me and that this whole situation has made me angry for a handful of reasons.

1) The first reason is the same reason that I listed above.  The online version of the OCW is updating their entries on the fly as new information is made available, which I am fully supportive of, so long as the sources are good and the new information is reliable.  The problem that I have is in their unwillingness to provide information about these sources when pressed.  If you are charging people so that they can access your reference material, you should have to provide some justification of that material when asked.  The entries really should have references within them anyway, but short of that, if a reader challenges an entry, that reader is entitled to a justification beyond "you're wrong."  

2) The form of that justification cannot be an invitation to purchase another extravagantly expensive reference material from you which you swear will be adequately annotated and will contain all the answers that I'm currently asking for.  I paid for my initial subscription to the OCW with the expectation that the content is good and factually accurate.  After I've found an error in one of your posts, it's reasonable for me to doubt other things that you've published without providing any kind of backup.  Inviting me to purchase more of your reference materials doesn't address the fact that the current reference material that I'm paying you for contains claims that you are unwilling to justify. 

3) If the justification for the claim is original research, I don't have a problem with you saying that it's original research and that I'll have to wait for the new book to read all about it.  If you want to sell original research, that's your business, but at least be up front about it and tell me that rather than just telling me I'm wrong.

4) The big issue in this case, though, is that the justification is actually research done by someone else, which is freely available online.  Further, the person who did that initial research isn't affiliated with the publication of this new book at all, as far as I can tell, so the OCW is essentially trying to profit from the freely available research of someone else.  I understand that this new book doesn't hinge on this particular piece of research and that this bit of research forms a very small part of the book as a whole, but it doesn't change the fact that they are at least directly trying to sell me this new book based on someone else's work.  

5) I'm not saying that you can't publish someone else's research in a book that you then charge money for.  It happens all the time and it's OK.  What I am saying is that when you do use someone else's research, you must properly cite them for it.  Without a citation, the reader is invited to believe that the material being presented is from the author.  If an author presents information knowingly taken from someone else's research and doesn't properly cite the original research, that's plagiarism.  If they sell someone else's research as their own, that's theft.  I understand that the entries in this new book will be immaculately cited and all referenced materials will be accounted for, but that doesn't change the fact that in the OCW, this information is not only presented without citations, but is sold without citations and when I asked for additional information, I was essentially told to buy another one of their products for access to the proper citation.  

In an email to me, Julia Harding addressed this issue of citations, as she read about my frustrations on this front in my first piece on Hondarrabi Zuri.  This was her response:

"Having read your point about lack of sources in the Oxford Companion, I have to say that it would have involved just too much work to add in all the new sources that we have uncovered and referred to while working on the grape book (where ALL sources of DNA info are given, leading to an enormous bibliography). When we are next able to devote a few years to a full update of the Oxford Companion, I will certainly bear in mind the need for more sources for DNA assertions."

"Too much work" is not a valid excuse for using other people's research without attribution, especially when people are paying you for that information.  

Look, I understand that in the grand scheme of things, this really isn't that big a deal.  That doesn't change the fact that I think what the OCW has done in this case is wrong.  The email from Julia specifically says "We can't give you all our scoops!"  The implication here is clearly that this is something that they feel they have discovered and that they will be using their upcoming book as the vehicle to transmit this information.  The fact of the matter is that this isn't actually a "scoop" at all.  This information was originally published in 2006 by someone not affiliated with their publication, but they are claiming it as their own and are using it to try and drive up their own sales.  

I understand that they are in the publishing business and that selling books and selling online subscriptions is how they make their money.  I do still subscribe to the online OCW, I have a hard copy of the book at home and I have pre-ordered their new grape book.  My problem is that in addition to selling books, one of their implicit missions is, or at least should be, the dissemination of factual information to their subscribers and customers.  Disseminating this information means being respectful of where the information came from in the first place and, whenever possible, giving proper credit to those whose findings you're incorporating into your own work.  Part of this is giving proper citations within the work itself, but another part of it is providing these citations or references when a reader challenges something you've published.  Just being the Oxford Companion to Wine isn't a suitable justification.  Forcing a reader to purchase another work in order to obtain the proper citation is just mean.  

Treat not only the information itself with respect, but also treat your readers and your customers with respect.  Don't treat information and knowledge like mere commodities and don't treat your readers merely as potential book sales or potential subscriber fees.  Be honest and be nice.  That's all.