1. confessions
  2. Some perspective on "predatory" open access journals

Some perspective on "predatory" open access journals

By jdupuis on March 30, 2015.

Predatory open access journals seem to be a hot topic these days. In fact, there seems to be kind of a moral panic surrounding them. I would like to counter the admittedly shocking and scary stories around that moral panic by pointing out that perhaps we shouldn't be worrying so much about a fairly small number of admittedly bad actors and that we should be more concerned with the larger issues around the limitations of peer review and how scientific error and fraud leak through that system.

I'm hoping my methodology here will be helpful. I hope to counter the predatory open access (OA) journal story with a different and hopefully just as compelling narrative. Fist of all, after gathering together some of the stories about predatory OA journals, I will present some of what's been written recently about issues in scientific peer review, it's problems and potential solutions.

Then I'll be presenting a more direct counter narrative to the predatory one. First of all, I'll present some information about the fantastic resource Retraction Watch. Then I'll present some concrete case studies on how traditional peer reviewed commercial publishing fails in all the same way that supposedly predatory publishing fails.

Finally, using the incredible work of Walt Crawford and others, I'll gather some resources that will further debunk the whole "predatory" open access moral panic and further suggest that perhaps it isn't the bogus OA journals that are the main source of "predatory" publishing, but rather that the big commercial and society publishers perhaps deserve that label more.

I want to be perfectly clear. My issue isn't with the necessity of peer review and it's importance in science. Issues like climate change and vaccination panics highlight why trusting in peer reviewed science is most responsible thing to do. After all, “Research misconduct accounts for a small percentage of total funding”. I think it's probably safe to say that at the end of the day, peer review and scientific publishing work fairly well as far as fraud and general quality levels go.

But.

Both peer review in particular and the scholarly communications ecosystem in general are human systems with all the potential for the full range of human weaknesses that implies: folly, error, bias, fallibility and bad faith. This post will explore some of the dimensions of folly, error, bias and bad faith in scholarly communication.

Let's start our adventures with some media stories and cases studies of bad faith -- true predatory open access journals.

Predatory journals are a real problem, of course, as we can see from the list above. However, I think the moral panic about their extent and impact tends to be exaggerated. I would really love to see more balance in reporting about predatory journals that contrast the real issues with scam journals with what I think are the far more pressing issues in scholarly communications. In other words, the flaws and limitations in the peer review system and the far more "predatory" traditional system of scholarly publishing that's controlled by the big commercial and society publishers. It's those publishers that are the leeches affecting the system.

These stories and anecdotes about predatory journals tend to acquire the mythic stature of the stories and anecdotes about vaccination that drive the anti-vaccine movement. Those tragic, personal stories take on a weight and social impact that's disproportional to the actual scientific and statistical significance.

 

Time to explore bias and human fallibility a little bit. Here are some resources about the general state of peer review, talking in general about the issues around peer review and the potential for reform. This list is meant to contrast the moral panic about "predatory" open access journals with a sober discussion of the strengths and weaknesses of peer review across all of science publishing, not just some fairly specific issues with a limited number of open access journals.

General Resources on Quality in Scientific Publishing, particularly on Issues with and Reform of Peer Review

(The Shit My Reviewers Say tumblr is a lighter-side exploration of some of these issues.)

 

More importantly perhaps, there is another set. There is no shortage of fairly well publicized cases of significant retractions or scientific fraud that got past the peer review process in traditionally published, peer reviewed journals, mostly from the big commercial or society publishers. In other words, where peer review was the issue, not the subscription model.

The brain child of Ivan Oransky, Retraction Watch is an amazing resource in this area, so before we get to the main event here are some advanced reading from and about that fine resource.

If you want to know about the failing of the big publishers when it comes to quality control or about researcher perpetrating scientific fraud, Retraction Watch is the definitive site on the web.

Resources by and about Retraction Watch

The site Science Fraud was taken down by various legal threats. While it existed, it was an amazing resource for uncovering practices such as falsified images or tables. Some posts are retrievable via the Internet Archive.

SCIgen is a website that allow anyone to automatically generate a bogus paper. It is often used to generate garbage papers for predatory open access journal stings. SCIgenDetection is one site that detects SCIgen papers. The SCIgen page has a number of examples and other resources related to automatically generated bogus scientific pages.

Springer has recently teamed up with Université Joseph Fourier to release the a generalized open source software package SciDetect which tries to detect fake scientific papers such as those generated by SCIGen.

 

And yes, the main event where we explore a different dimension of bad faith and human folly and weakness. This time on the side of the supposedly "good guys."

Bellow are examples where big commercial or society traditional, subscription-based peer review have fallen short, either due to careless or insufficient review or fraud on the part of scientists. Of course, peer review will rarely catch genuine fraud as the books are cooked. But even fraud cases demonstrate the limits of peer review across all scholarly communication, not just in "predatory" open access journals.

I would like to emphasize that this list is extremely selective. I'm mostly only highlighting particularly egregious examples that have made their way into the mass media or onto popular blogs. As above, for much much more, please visit Retraction Watch for more complete coverage. For example, The top 10 retractions of 2014.

This list is meant to contrast in number and severity to the list of examples of "predatory" open access publishing crisis and stings above.

Failure in Scholarly Communications Ecosystem through Stupidity, Error or Fraud

As noted above, this is the tip of the iceberg. Please see Retraction Watch for the rest of the iceberg.

And here are some books about academic fraud.

 

And as a bit of a desert, let's take a brief look at who we should perhaps be considering predatory journals, those big commercial and society journals that soak the library world for every penny of obscene profit.

Oh yes, some resources from this blog and beyond that highlight some of the issues with the big, traditional journals, some of which are society, some of which are commercial. And finally, some resources about the real predatory publishing, the big commercial and society publishers who control so much of scholarly publishing.

This list is extremely partial. Please feel free to add your own suggestions in the comments.

Hearing complaints and panic about predatory open access journals? Send them here for a hopefully more complete and honest picture.

(As usual, if I've mis-characterized or misunderstood any of the incidents or if I'm missing any significant items for any of the lists above, please let me know in the comments or by email at jdupuis at yorku dot ca. Hey, think of this as post-publication open peer review on this blog post. The wave of the future!)

Tags
acad lib future
culture of science
Open Access
scholarly publishing
Uncategorized
Categories
Physical Sciences

More like this

The Canadian War on Science: A long, unexaggerated, devastating chronological indictment
This is a brief chronology of the current Conservative Canadian government's long campaign to undermine evidence-based scientific, environmental and technical decision-making. It is a government that is beholden to big business, particularly big oil, and that makes every attempt to shape public…
The Canadian War on Science: The #Altmetrics impact of a science policy blog post
On May 20th, 2013 I published my most popular post ever. It was The Canadian War on Science: A long, unexaggerated, devastating chronological indictment. In it, I chronicled at some considerable length the various anti-science measures by the current Canadian Conservative government. The…
The Canadian War on Science: More updates to the chronology of the Conservative government’s anti-science actions
It has been a year since I last updated my chronological listing of the Harper Conservative government's war on science. The newly updated master list is here, where you can also read more about this project in general. The previous update from October 2013 is here. Some preliminary metrics about…
The Canadian War on Science: Updates to the chronology of the Conservative government's anti-science actions
How bad is it? Even the New York Times has noticed what is going on with Canadian science, comparing the situation here unfavourably with the situation in the US under George W. Bush. It began badly enough in 2008 when scientists working for Environment Canada, the federal agency, were told to…

Great read! I would differ a bit: I don't think the peer review systems is as broken as people often say, and some of your links about "problems" with peer review I don't really think reveal problems at all. Iaonnidis' paper, for instance (Why Most Published Research Findings Are False), has always bothered me, because I don't think we should expect every published finding to be "True" in isolation - that's a naive view of how science operates. I have a few thoughts about that at http://bit.ly/1wVSkmk , and I'm working on a future blog post that will tackle it more directly.

Still, specific carps aside, thanks for a thorough and well-thought-out post!

By Steve Heard (not verified) on 31 Mar 2015 #permalink

Thanks, Steve. I guess where I'm coming from is that I see the issues with predatory OA journals more as symptoms of larger issues in the scholarly communications ecosystem, one of which is dealing with the human limitation of a system like peer review. I agree that overall peer review is very important to science (and all scholarlship) and is something we couldn't do without.

Hello, I wrote the "A Personal Academic Journal: Why is a major academic publisher printing a journal that seems a lot like the newsletter of the editor’s fan club?" piece.

l enjoyed this post, but I do think that predatory journals are a real problem, not a mere moral panic.

I don't think it makes much sense to debate whether they are a bigger or a smaller problem than the issues in traditional journals. It's a different kind of problem. But you only have to browse Jeffrey Beall's blog to see how utterly outrageous the behaviour of these predatory publishers can be - and yet hundreds or thousands of academics (many from low-income countries) are paying them good money. That is a serious problem in my view.

By Neuroskeptic (not verified) on 31 Mar 2015 #permalink

Hi Neuroskeptic. Point taken. I agree that predatory journals are a real problem and one we should all work on to limit and control. The point I was hoping to make (and perhaps could have made better) is that taken in perspective, predatory journals aren't as big a problem as larger issues in managing peer review in an exploding publication landscape with "traditional" publishers being as guilty of lax standards as anyone. That, and we can also see perhaps the true predators are those rapacious publishers who such up so much of the money that's flowing in the ecosystem, a number that's often quoted as being in excess of $ 10 billion per year.

These are all important issues around predatory open access, but the "moral panic" may miss another important issue noted by Neutroskeptic.

Why are the journals so filled with articles from developing countries? Certainly there is an absurd publish or don't-graduate model in India and elsewhere, and yes, that generates a lot of rally bad research.

But I also see a great deal of potentially useful data being collected with some integrity by universities trying to do research with very limited means. This data isn't glamorous, or uses the latest equipment or techniques, but comes close to what we might consider really good undergrad level research data. Data, for example, related to agricultural observations might be useful in some bigger context, if someone with more means could collate it and analyse it properly.

I can't help but feel that as university populations and reputations grow in developing countries, that many researchers who mean well and just can't get their modest data in mainstream journals, are throwing a lot of good data to the predatory wolves.

So long as Western researchers have access to more expensive gadgets and money for methods development than non-Western researchers, the latter are always going to find themselves scrambling to catch up with constantly changing standards - not just for what methods must be used to generate and analyze data, but for what details must be incorporated into manuscripts, how data must be presented, etc. If they send a high-quality Western journal a manuscript of a sort that would have been published without question a couple of decades previously, it will meet with contemptuous rejection - and by the time they can meet today's standards, those standards will no longer suffice.

The root cause is the feeling of university administrations and bureaucrats that international, preferably Western presentations and publications are the ultimate mark of status. But publication in Western journals is not the best place for many non-Western studies. Data related to agricultural observations in Africa, to use Thad's example, would be of infinitely more value to Africans than to the readers of an American or Indian journal. Much better to publish them in a cheap, low-status African journal than to send them to a foreign predatory publisher. But this requires a social adjustment.

India seems to be getting good at this. I know of an Indian journal that publishes mostly rather terse papers of the sort that would have been considered just fine when the same field was at the same stage of development in Europe. The paper quality is terrible. I bet that means it is printed cheaply enough that Indian academic libraries can afford it. Not a lot of Americans read this journal, but then they don't much care what is happening in India.

Thad, Jane, Very good points. Thank you very much.

Thanks for putting all of this together John. We really appreciate it as it comes at just the right time for us and our efforts with OA advocacy and our OA press.

By Mal Booth (not verified) on 31 Mar 2015 #permalink

News from Brazil:

"The almost absolute silence of Brazilian researchers in relation to predatory journals is due not only to the complicity or the risk of embarrassment with those who use this type of publication. The biggest problem is the holes that they reveal in the the Qualis [database of the federal agency CAPES, of the Ministry of Education].

These holes expose an important part of the performance evaluation system as a whole. And, based on this system, in recent years, not only academic careers and reputations were built, but also investments were made and institutional priorities were established."

From: "The Qualis and the silence of the Brazilian researchers"
(http://mauriciotuffani.blogfolha.uol.com.br/the-qualis-and-the-silence-…)

Last update: "Brazilian graduate system counts now 235 predatory journals)
(http://mauriciotuffani.blogfolha.uol.com.br/brazilian-graduate-system-c…)

By Joey Ramone (not verified) on 04 Apr 2015 #permalink

I recently ended my tenure as the chair of our college of education personnel committee. My public U has over 25,000 students, so we're decently sized. Perhaps predatory journal stories are being overblown as you claim, but it was the single biggest issue I dealt with when we decided to deny tenure and/or promotion. Faculty on the margins who are desperate for publications are increasingly turning to predatory publishers where articles can be published nearly instantly without any review at all. I tried multiple times to create a policy against predatory journals, but this is much more difficult than it sounds and my efforts failed each time. Now, we are trying again using something like the criteria that Jeffrey Beall provides on his site: https://scholarlyoa.files.wordpress.com/2015/01/criteria-2015.pdf - The actual criteria are fairly good even if you don't agree with Beall's efforts (and I suspect you don't based on the inclusion of the article criticizing him from 2013). Our librarians used to be in the same boat, but just a few months ago decided that they would promote the criteria that Beall publishes as good practice for selecting journals for publication. In the meantime, we have denied a few people who went the predatory route, but it's hard to do when there is no policy in place. Perhaps there are problems in the more traditional journals as well, but those issues seem to be more anomalies than the standard practice like we see from predatory publishers.

Sean, I'm very sensitive to your situation. I don't mean to imply that predatory publishers aren't a problem, they are. But in your case the predatory publishers that are preying on your colleagues are a symptom of a deeper problem rather than the disease itself.

AASCIT are complete spammers beware. Recently i sent an article to the American journal of science and technology. After a bogus review they replied they have accepted my article. they asked me to pay article processing charges. The bank transfer address is Hong Kong while the journal is American! I transferred USD 200. After acknowledging the receipt of the money they refused to publish my article. I pleaded with them but since then they refused to reply. The address aascit002@gmail.com. there is no person full name, no address, no contact. Only Gmail address. These are complete spammers. Do not ever send your journal to AASCIT. I have all the evidence of the communication i had with them. If need be i can give you the details.

By Sam Kagawa (not verified) on 04 May 2016 #permalink

Just because Elsevier et al. aren't capable of preventing fraud, doesn't mean they are comparable to the likes of OMICS publishing and similarly spammy, scammy and predatory publishers. In the first case, fraudulent and low quality publications do not constitute the majority of content published, unlike in the second case.

Elsevier et al. sometimes publish crap despite the fact that they try to prevent that from happening; OMICS publishing et al. don't really care too much about what they are publishing at all, as long as they get paid.

Notice that you've never seen Elsevier et al. accept blatantly ridiculous papers such as the widely-known "Get me off your fucking mailing list." one. The same cannot be said of *actually* predatory publishers, which seem to have even automated the manuscript acceptance process.

Also, the fact that you (a librarian whose native language is, I guess, English) can't seem to distinguish between "its" and "it's" does not work in your favor, I'll tell you that...

By Random Scientist (not verified) on 26 Sep 2017 #permalink

Hi RS,

Elsevier may not have been so obviously pranked, but Springer and IEEE were: https://www.nature.com/news/publishers-withdraw-more-than-120-gibberish…

Not to mention that Elsevier also published fake journals: https://scholarlykitchen.sspnet.org/2009/05/07/elsevier-published-fake-…

Scam publishers are a problem. I've never denied that. But the real problem is the academic evaluation and incentive system that favours CV padding rather than quality research. That's why authors are such easy prey for these publishers.

Who is really harmed by predatory publishers? http://www.triple-c.at/index.php/tripleC/article/view/867