john hawks weblog

paleoanthropology, genetics and evolution

journals

  • Agitating for open science

    Wed, 2011-09-07 20:13 -- John Hawks

    Cameron Neylon in New Scientist: "Time for total scientific openness".

    Above all, you should care because science thrives on new ideas and critical analysis, wherever they come from. Open science is better science. There will be growing pains as we figure out how best to enable that. But if we believe that science enriches society then we must accept that society can, and perhaps should, enrich our research. And that can only happen if it is open.

    Open science will not work unless it is better science. I think it will be better. I think the history in paleoanthropology shows very clearly that keeping results behind closed doors for years is not good enough. The results speak for themselves.

    We're already getting some incredible feedback on the Malapa Soft Tissue Project, and it has just gotten started. If you've got a lead and haven't written yet, why not?

  • Open access barriers

    Wed, 2011-08-31 11:16 -- John Hawks

    Richard Poynder discusses how Open Access policies may be perversely costing universities even more money, in the lead-in to an interview about the Wellcome Trust's support of open access publication: "The Open Access Interviews: Wellcome Trust’s Robert Kiley".

    If institutions now start to cancel their OA membership schemes (which some believe provide pretty poor value anyway), the question inevitably arises: in light of the continuing financial squeeze, who on earth is going to pay for the “dramatic growth of Open Access” — as some characterise it?

    I continue to maintain that price to the reader is only one barrier to accessibility.

    Many open access journals now fund their activities with upfront author fees, which are exorbitant to any author not on federal grant money. I'm not questioning that those journals use the money -- they've obviously been spending it. But it obviously can be done for much less, as some open access journals have no author fees at all.

    Many journals wrap their content in scripts and presentation -- often for the purpose of guiding readers to premium content -- provide content that is not easily read on multiple devices and put multiple clicks between a search and results.

    Barriers to readability and comprehension are more important than barriers to access. Most of the research being published each year is a giant slush pile, from which postdocs use search engines to pick out small nuggets of utility.

  • Make journals work better

    Mon, 2011-08-29 17:51 -- John Hawks

    George Monbiot writes in the Guardian with some sobering statistics about academic publishing: "Academic publishers make Murdoch look like a socialist"

    The publishers claim that they have to charge these fees as a result of the costs of production and distribution, and that they add value (in Springer's words) because they "develop journal brands and maintain and improve the digital infrastructure which has revolutionised scientific communication in the past 15 years". But an analysis by Deutsche Bank reaches different conclusions. "We believe the publisher adds relatively little value to the publishing process … if the process really were as complex, costly and value-added as the publishers protest that it is, 40% margins wouldn't be available." Far from assisting the dissemination of research, the big publishers impede it, as their long turnaround times can delay the release of findings by a year or more.

    All of this money has gone into creating a publishing system that isn't even usable or accessible to the volunteer laborers that create the content. People who have good journal access at research universities (and I'm fortunate to be one of these) still have to burn minutes every time we access an article to go through the ridiculous paywalls. Then there's the crazy rigmarole of linking online discussion to these paywall-ridden papers.

    Could somebody please let Amazon take charge of this? They have a system that maintains content at varying levels of pay/free, recognizes its users across multiple devices, and presents text material in an easy-to-read format. Every research author can publish to the e-book format as easily as an export from a word processor. Let's suppose that editors charged for the service of managing peer review, at levels that vary with the prestige that they have earned. Some editors would charge a fee that enabled them to pay reviewers, some would be paid or subsidized by universities. Then authors could choose to pay for a prestigious editor, and recoup that cost by grants or charging per-access, again, possibly subsidized by libraries.

    The solution to the collective action problem isn't complaining about the journals, it's providing a solution that works better.

    UPDATE (2011-08-29): Noah Gray comments on Monbiot's article, sharing his perspective from inside Nature Publishing Group (but not speaking for the company). I thought he made a useful contribution, and contributed my own comment, including:

    Most of the participants in this process are uncompensated, or are at best compensated only indirectly. The indirect compensation at present is tightly linked to prestige: publishing, editing and reviewing for the right journals. Secrecy and control have been routes to reinforce prestige, as are the traditional methods of advertising, sponsorship and signing "big names" by giving preferred treatment. These methods are design flaws from the perspective of promoting good science, as they exclude by institution, by nationality, and by arbitrary tastes.

  • An academic journal copyright story

    Sat, 2011-08-20 08:30 -- John Hawks

    In a post from earlier this summer, info/library scientist Jeffrey Pomerantz describes his attempts to secure a less restrictive copyright agreement for a scholarly article in a special journal volume: "My copyfight".

    I have to stop again briefly here, to point out something very important. [Taylor and Francis] has — had all along — a License to Publish form. Why had Stacy not mentioned this before? This email exchange had, by this time, been going on for a month. Let’s give Stacy the benefit of the doubt: let’s assume that she was not being malicious, but that she simply did not know about this License to Publish form until she ran my version by T&F’s lawyers. This is a very significant piece of information for the rep to a journal (almost certainly more than one journal) to not possess. Which means that this is a very significant oversight on the part of T&F, not keeping their journal reps informed. The result of which was that the rep to a journal was unprepared for a situation in which the author demands a less-restrictive copyright agreement.

    That didn't have a happy ending. Pomerantz returned later to the topic, responding to reader suggestions, especially the point about institutional preprint repositories:

    Part of the point of OA publication is that the publication is freely accessible to the reader, but equally important is that it’s discoverable. Freely accessible without discoverability is, quite frankly, close to useless. The problem with most IRs is that they their contents are not discoverable through Google.

    They also don't solve the citation indexing problem. Why can't institutions manage something with academic papers that is so easily accomplished with blogs?

  • Open science link

    Thu, 2011-05-12 07:08 -- John Hawks

    David Dobbs writes about the structural barriers to more open science: "Free Science, One Paper at a Time". Summing up a large collaboration on Alzheimer's research, he writes:

    The language used here — everything entering the public domain, the dismantling of silos, the parking of egos and IP padlocks — might have been lifted from an open-science manifesto. And even Big Science appreciated the outcome. To open-science advocates, this raises a good and somewhat obvious question: Why don’t we do science like this all the time?

    Part of the answer, strangely, is the very thing at the center of science: the paper. Once science’s main conduit, the paper has become its choke point.

    He discusses a number of new initiatives to assess researchers' activity in areas other than paper publishing, as well as strategies for post-publication review of research -- the kinds of incentives and technologies that might ease the paper publication bottleneck.

    Dobbs doesn't explicitly mention the high pressure to cram significant results into a single high-profile publication. I find this pressure in paleoanthropology to be worse than most other factors. Researchers hold up results so that they will have enough to get that Science or Nature publication. And then, the results are reported in a highly obfuscated way, because they are tacked into a supplement without much editing or review. The paper itself is usually all conclusions and discussion, with no discussion of methods. This allows some research groups to claim that a Science or Nature publication isn't a "real" publication of their results, because a more detailed monograph is necessary to report them fully.

    In other words, it's six different kinds of barrier to open science, all rolled up into one basic problem.

  • Retractions and grants

    Thu, 2011-04-21 10:46 -- John Hawks

    Pascale Lane reviews a paper about retraction rates in top journals: "Papers 'Not Meant to Be Factual'".

    Rigorous peer review may help uncover fraud or fabrication, but, as the editor of Science wrote, "It is asking too much of peer review to expect it to immunize us against clever fraud."

    I'm just noting this because, on the subject of my previous post about grant applications, the rate of fabulism must be much higher in that system than in the top journals. Nobody will retract your money if your "preliminary results" fail to play out. And the top journals (or "glamour mags" as many call them) have a shockingly high rate of retractions.

  • Kin selection strikes back

    Thu, 2011-03-24 19:37 -- John Hawks

    Last year I noted the publication of a paper in Nature by Martin Nowak, Corina Tarnita and Edward O. Wilson, which claimed that kin selection is not a sufficient explanation for anything in biology. My post ("Inclusive fitness works") basically expressed my incredulity that Nature published the thing.

    This week, Nature published several comments on the paper, including one signed by 137 evolutionary biologists. I think the best source to read is Jerry Coyne's post about the commentary ("Big dust-up about kin selection"):

    If the Nowak et al. paper is so bad, why was it published? That’s obvious, and is an object lesson in the sociology of science. If Joe Schmo et al. from Buggerall State University had submitted such a misguided paper to Nature, it would have been rejected within an hour (yes, Nature sometimes does that with online submissions!). The only reason this paper was published is because it has two big-name authors, Nowak and Wilson, hailing from Mother Harvard. That, and the fact that such a contrarian paper, flying in the face of accepted evolutionary theory, was bound to cause controversy. Well, Nature got its controversy but lost its intellectual integrity, becoming something of a scientific National Enquirer. Oh, and boo to the Templeton Foundation, who funded the whole Nowak et al. mess and highlighted the paper on their website.

    "Scientific National Enquirer"...wow, harsh words, but then the Weekly World News was unavailable for comment...

    Oh, and Richard Dawkins shows up in Coyne's comments section, including the awesome response, "You are still wrecked among heathen dreams."

  • Mailbag: More on megajournals

    Tue, 2011-01-25 02:02 -- John Hawks

    Re: Megajournals

    Hi, John!

    Another quicky comment on your blog without comments :-)

    The drawback is obvious -- why the heck are we generating these data, if we're not going to seriously test hypotheses about mechanisms?

    I think you misunderstood the idea behind this trend. The Plos ONE business model, now followed by many others, is simply to publish a lot more in a lot less discriminatory manner (and charge A LOT MORE for that, too). It makes sense from a money-making point of view.

    A larger, more important, view of this model is that it implicitely admits and explicitly tries to correct the problem everyone else is aware of: "subjective selectionism" is what I call it (in its extreme it manifests itself in all the problems with glamor mags; I can tell quite a few anecdotes about that part). So instead of trying to [mis]judge importance of the work, they are now lowering their pretense and only try to [mis]judge its technical quality. Of course even that modest goal is not truly feasible under traditional peer review and publication formats. Witness Plos ONE which ends up publishing a lot of utter BS.

    I see all this as a good thing because it puts the whole business into a slippery slope. Next it will be obvious that the single most important task of journals and peer reviews--credentialing--is completely bankrupt. So once we are all done slipping down, the end result will be "anything goes". We could publish our results anywhere! And the results will be judged by peers through citations and general recognition anyway and, eventually, by what they mean in a larger context (be it an important dataset or an ingenious interpretation of thereof).

    It's a part of a bigger trend made possible by Internet - elimination of middle men of all kinds (cf. music, news).

    More cynical than me, probably, but I think you're close to the mark. I'm more than halfway to "anything goes" already.

    I wonder about archaeological site reports, which are fundamentally uninteresting and hard to get information out of to do meta-analysis. Some kind of self-published format with standard database would be enormously more useful for citation and further work. What I wonder is what kind of change in incentive structure could get people to actually do this kind of publication.

  • Open access megajournals

    Sun, 2011-01-23 16:14 -- John Hawks

    The Occasional Pamphlet reflects on the new megajournal trend in open access: "A ray of sunshine in the open-access future". PLoS ONE is being joined by SAGE Open and Scientific Reports from Nature Publishing Group.

    The mega-journal trend means that strong traditional publishers with name recognition are entering open-access publishing in a big way. They’ll be hard pressed to trot out their hackneyed canards (vanity press, disenfranchisement). And these journals will provide coverage of a huge swathe of academic fields. Between SAGE Open, PLoS ONE, and Scientific Reports, essentially all of the social sciences, humanities, and natural sciences are covered. In addition, the breadth of these journals means that they will be competing for the same pool of articles. Authors will have a choice between submitting papers in genetics, say, to PLoS One or G3, in physics to AIP Advances or Scientific Reports, and so forth. Publishers will have to compete in order to attract authors, either on price or publisher services or both. They’ll have to market these journals to authors, using their intellectual capital to convince authors that OA journals (at least their OA journals) are a Good Thing. As authors and promotion committees get used to using the new article-level metrics (as they already increasingly are, with download counts and h-index), journal brand name — whether of these mega-journals or traditional journals — will become less important, and authors will feel freer to publish in these and other OA journals, again based on publisher services rather than journal brand name.

    I find G3 very interesting. A journal devoted to "emphasis on data quality and utility, rather than detailed mechanistic insight or subjective assessment of immediate impact." It seems to me that the theme reflects the reality of a division in the field between data generators and data consumers. The advantage is that it enables recognition and citation for data generation without requiring long-term working relationships between groups. The drawback is obvious -- why the heck are we generating these data, if we're not going to seriously test hypotheses about mechanisms?

  • Scholarly communication

    Fri, 2010-09-10 15:46 -- John Hawks

    Savage Minds:

    Wiley has posted double digit gains in revenue this last quarter. What will all you anthropologists who have worked for Wiley-Blackwell for free (reviewing, editing and promoting W-B publications) do with this windfall?

    heh...

Pages

Subscribe to journals

Neandertals

For years, I've worked on their bones. Now I'm working on their genes. Read more about the science studying these ancient people.

Denisova

From a finger bone of an ancient human came the record of a completely unexpected population. My lab is working on the science of the Denisova genome.

Acceleration

The advent of agriculture caused natural selection to speed up greatly in humans. We're uncovering some of the ways that populations have rapidly changed during the last 10,000 years.

Malapa

Just outside Johannesburg, the Malapa site is producing some of the most exciting finds in human evolution. This site is the headquarters of the Malapa Soft Tissue Project.