Digital History

Reinventing the Academic Journal: The ‘Digital Turn’, Open Access, & Peer Review

The Digital Turn

Historians love hard copy manuscripts, books and journals. These materials are the very stuff of academic research and production. And for at least the last 30 years, historians have turned their minds and pens to creating a self-conscious history of these objects. We have defined them, and described them. And in the resulting literature it is entirely clear that books, journals and other text objects form a distinct and sophisticated technology for validating and conveying information. This is not, however, how we normally speak about hard-copy text objects, books and journals in particular. We do not look on them as technologies at all.

OA-logo

Instead, we fetishise them. We wax lyrical over their feel and smell; the sound of their rustling pages and haptic beauty. And we invoke the journey into the library and archive, and into print, as shared experiences – as rituals of initiation into a community of scholarship. In the process, we tend to lose sight of that book historian’s simple and self-evident observation, that hard copy text is a technology for moving and exchanging information.

And, it is a very good technology. A well-made book, properly bound and lying perfectly flat; a book whose wide margins invite notes and marginalia; a book that can be held and flipped and dropped and thumbed and marked and ripped, and still convey the information with which it is charged uncorrupted for hundreds of years is a technological marvel. When compared to digital technologies for conveying information, hard-copy books and journals are impressive.

The first scholarly journals incorporated not just the aesthetic perfection of a well-crafted object, but also embodied the structures and form of a well-articulated form of professional practice. They evolved in dialogue with the early professional academies and societies from the late seventeenth century and came to serve a distinct role in defining the narrowing membership of an academic ‘public sphere’. By the nineteenth century historians had their own journals, starting with Historische Zeitschrift, founded in 1859. It was explicitly designed to ‘represent the true method of historical research and to point out the deviations therefrom’. Embedding the process of peer review, and dedicated to upholding and promoting the values and practises of a specific academic community, these first history journals are almost indistinguishable from those published today.

But, as the ‘digital turn’ gradually transforms our publishing practises and ways of defining an academic community (whether we choose to self-consciously adopt a pro-digital stance or not), it becomes increasingly important to take seriously the fundamental observation that books, and more particularly academic journals, are technologies designed to a purpose. And that purpose is two-fold:

1) to disseminate academic research as efficiently and broadly as possible, providing a forum for debate and exchange relevant to the academic community;

and

2) to guarantee high academic standards (achieved through the process of peer review).

There is no reason why achieving these goals is incumbent upon the format of the journal, or indeed, the existence of a hard-copy object. In this moment of the ‘digital turn’, it is worthwhile reflecting on whether our technologies and processes – both in print and digital forms – are serving our ultimate objectives. Doing so reveals two things. First, the publication process designed for the print world has the tendency to be both inefficient and to reinforce the intellectual status quo. Secondly, academics are translating the limitations of print to the digital environment.

Print journals impose limits on authors that undermine both quick and broad dissemination and high academic standards. Most history and humanities journals, for instance, are painfully inefficient, taking years to manage the process of transforming a submitted manuscript into a peer-reviewed ‘publication’. Consequently, academic exchanges and debates take place over years rather than months. Subscription costs, generally established to satisfy the needs of a commercial business model built on producing and distributing hard copy, actively limit the dissemination of scholarship, ensuring an ever-narrowing readership. And perhaps most obviously, the 7,000 to 12,000-word length that has come to define the format of the academic journal article, reinforces a kind of generic conservatism, and substantially works against intellectual innovation. Likewise, double-blind peer review adds many months – sometimes up to a year – to the publication process, all for the input of two or three professionals whose labours may or may not substantively alter or improve the final product. And, in all cases, their comments, which can be quite substantial, are soon shuffled into a filing cabinet and lost to posterity. Furthermore, the peer review process has the tendency to limit intellectual innovation and experiment, disciplining authors to traditions, standards, and hierarchies that may or may not produce the best scholarship.

The technological limitations of print have been a powerful historical force in shaping the processes associated with the academic journal. However, we all now work in a digital environment using electronic tools. The computer has replaced the pen, and the rhythms of the printing press – the galleys, the arcane symbols of the proof reader, the bindery, warehouse and academic bookshop – are but distant memories. Journals are produced from electronic files, passed via email, and are read (or searched) as PDFs downloaded from the university library. But this has neither changed the processes for producing academic journals nor altered the essential character of the journals we produce and read. We have even transposed the technological limitations of print into thousands of born digital academic journals.

In other words, traditional standards of practise have become ossified into rigid norms. Digital publishing processes mirror those created for early modern technologies. Most digital articles are little more than ghosts of print articles, comprising a standard twenty to thirty-five pages, few images, a linear narrative. On the whole, interactive features are left to reside exclusively in the mind’s eye of the reader. Lag times in the publication process make it almost impossible to manage a constructive and timely public and academic dialogue. Despite the ability to publish our findings and data sets immediately – not to mention, the valuable contributions of peer reviewers – it usually takes years for work to find its way online. And, the supporting data sets and peer reviews often remain on hard drives and in filing cabinets. The problem is that in allowing the deus ex machina of the printing press to manage a modern publication process, we have increasingly failed to satisfy the primary purposes of journal publication suggested above: to efficiently disseminate good history to the widest possible community of readers.

Open Access

Breaking the historical binds of traditional processes and professional practices requires a radical re-imagining of academic scholarship for the twenty-first century. This process has been set into motion by grassroots and institutional stakeholders who are advocating for open access. There are a variety of open access models, but the overall thrust of the open access movement is to make digital scholarly publications freely available to the public. The major debates centre around two things: economic sustainability and academic quality.

In academia, the open access movement has been gaining traction for many years, led by libraries and scholars, who have faced increased fees from journal publishers, and those who believe that research should be free and readily accessible to everybody. Articles locked behind paywalls cost universities millions of dollars each year, leading to outcries over price gouging. In a notable protest over fees, over 13,000 researchers recently signed the ‘Cost of Knowledge’ petition to boycott the for-profit publisher Elsevier. So-called ‘hacktivists’ – most notably the late Aaron Swartz – have even freed thousands of academic journal articles locked behind paywalls.

Governments and NGOs have also responded to the need and desire for open access. The Berlin Declaration on Open Access to Knowledge in the Sciences and Humanities (2003) which has over 400 signatures from libraries, professional organizations, research institutes, and universities describes its goals as follows:

Our mission of disseminating knowledge is only half complete if the information is not made widely and readily available to society. New possibilities of knowledge dissemination not only through the classical form but also and increasingly through the open access paradigm via the Internet have to be supported. We define open access as a comprehensive source of human knowledge and cultural heritage that has been approved by the scientific community.

In order to realize the vision of a global and accessible representation of knowledge, the future Web has to be sustainable, interactive, and transparent. Content and software tools must be openly accessible and compatible.

US-based researchers funded by the National Institutes of Health grants are obligated to place their work in the open access repository PubMed Central. In the UK, the Finch Report (2012), a government commissioned study, made the recommendation that open access should be a requirement for any publicly funded research. And most recently, the Obama administration’s Office of Science and Technology Policy has mandated open access publication of all publicly funded US research.

Nevertheless, the ideal of freely available academic scholarship is entangled in socio-economic realities. Financial and institutional interests, concerns over hierarchies, the protection of turf, and simple traditionalism work together to maintain the status quo. And, importantly, those individuals most interested in the future of academic research are often those most likely to question open access.

Academic publishers, for example, find their institutions stretched between their missions to disseminate academic work and their commercial interests. Income from subscriptions finances their operations. Scholarly societies, often the organizations that produce academic journals, have budgets tied to revenue from journal subscriptions. And, since they have historically been essential to academia – hosting conferences, serving as advocates for the profession, and providing a variety of supplementary benefits – declines in revenue from the journals have the potential to undermine their viability. Governments, which fund much academic research, have a desire for scholarship to be public, but they also have a stake in preserving commercial operations. In the notable case of the Finch Report, this can lead to unwieldy solutions. In the Finch model, authors who receive public funds must make their work open access. But, in order to preserve the commercial operations of publishers, it recommends an open access model that charges authors to publish – even while asking the same scholars to edit the journals and review articles without compensation. While common in the sciences, this pay-to-publish model has little precedent in the humanities and has the capacity to make academic hierarchies more rigid, initiate opaque funding mechanisms, and charge the government twice (first for funding research, then to subsidize publication).

Despite this, it is clear that open access will help redefine the publishing landscape and help disseminate scholarship more broadly. The question is, however, what will this scholarship look like? If the vast majority of open access journals are any indication, they will parallel print journals both in publication processes and in final form. They will reproduce the socio-cultural hierarchies of traditional publication, and they will remain embedded in a market economy. If this is the outcome, then a valuable opportunity will have been lost. At this moment of disruption there is an opportunity to better match the goals of the academic journal: efficient and widely available high quality scholarship.

Open Peer Review and Open Access Models

A twenty-first-century academic journal need not reproduce traditional models in new forms. There have already been experiments that promise to improve both access and quality. Some of these come from the realm of science and technology. STEM fields have been at the forefront of developing open access repositories. For example, arXiv at Cornell University hosts scientific papers, providing them as open access documents. Founded in 1991, it now provides over 800,000 works to the public. The Public Library of Science (PLOS) works in a similar fashion, with the added oversight of peer review. GitHub, created in San Francisco in 2008, is a peer-to-peer sharing site for coders. It allows them to post their open source code so that it can be developed by others. Its innovation is a system that allows branching and versioning of the code while maintaining a database of authors’ contributions.

In the humanities, experiments have, not unsurprisingly, been particularly concerned with peer review. While most open access publications follow the traditional modes of pre-publication peer review, there have been some fruitful attempts to both increase speed and quality in the peer review process. For example, CommentPress and Digress.it, themes designed by Eddie Tejeda to work within the WordPress CMS, allow reviewers to mark up online text on a paragraph-by-paragraph basis. Excellent examples of their use include Kathleen Fitzpatrick’s Planned Obsolescence: Publishing, Technology, and the Future of the Academy and Jack Dougherty and Kristen Nawrotzki’s Writing History in the Digital Age. Another approach to peer review is that of the Roy Rosenzweig Center for History and New Media’s Digital Humanities Now. Rather than publishing, the editors aggregate, review, and curate online content by digital humanists, highlighting works published in non-traditional formats. In effect, the author first publishes their work online and then asks the editors at Digital Humanities Now to review it.

While these models all have their strengths, there is much room to improve and develop processes that better conform to the overall goals of academic research and publication. The Open Scholarship Project (OSP), a project directed by the authors of this essay, is focused on creating a flexible system for publishing academic articles in the humanities and social sciences. The guiding principle is to match the technology to its function, or

1) to disseminate academic research as efficiently and broadly as possible, providing a forum for debate and exchange relevant to the academic community;

and

2) to guarantee high academic standards (achieved through the process of peer review).

As, such, OSP is guided by four design principles that set it apart from other approaches.

1. Diamond Open Access
Currently, open access systems are of two types: gold and green. Gold Open Access refers to a journal’s online policy, which may allow immediate open access to the final edited version of a peer-reviewed journal publication, usually funded through author-pays or institutional subscription models. Green Open Access refers to repositories for scholarly work, which may or may not have gone through peer review. Some journals have policies that allow scholars to upload an earlier version of their article to a digital repository, often at their universities.

OSP provides an alternative – Diamond Open Access. Diamond Open Access rejects both the author-pay model as well as the paywall model. This is essential to academic freedom, removing important financial barriers that have the potential to limit free thought. But, unlike Green Open Access, the diamond model offers peer review and hosts the final version of the author’s paper. In other words, it takes the best of the Green and Gold models and fuses them.

2. Versioning
OSP offers scholars a place to post their work as part of their scholarly workflow. Rather than submitting a final draft version to an editor at the end of a long writing process, scholars can post their early drafts in OSP, including conference papers. While they work, they can solicit input from peers, who help them refine their ideas from first draft to final draft. The model for versioning is available in GitHub, an open source repository for computer code, but this model has not been used in the academic research context. As reviewers contribute to an author’s scholarship, they receive recognition for their contribution in each of the versions.

3. Open Peer Review
While some journals have experimented with open peer review, using systems such as CommentPress, journals have not integrated open peer review as part of the standard workflow. OSP allows scholars to ask for peer review on every draft of their writing on a paragraph-by-paragraph basis – in form, it is similar to digital marginalia. Comments are threaded, which allows authors and readers to have discussions. Furthermore, each comment receives a unique URL so that other scholars can cite any important ideas that emerge from the conversation. The OSP open peer review process does several things. First, each reviewer receives public credit for their participation in developing the authors’ work, and they are referenced in each version of the text. Secondly, peer reviews no longer disappear into filing cabinets and drawers. The valuable contributions of peer reviewers become published works themselves, further developing the scholarly dialogue. Thirdly, by opening up the peer review process, it becomes more transparent, avoiding some of the problems inherent to the traditional peer review process.

4. Badging
OSP takes advantage of the Mozilla Open Badges Framework which allows the project to create an entirely new model for publishing. Rather than submitting to a traditional print journal, authors who use OSP will ask journal editors, institutions, professional societies, or consortia of scholars to ‘badge’ their work. In other words, like many of the publications of the seventeenth- and eighteenth-century Royal Society, organizations will add their imprimatur without carrying the burden of publication costs. These organizations can peer review the work using their own standards and reviewers. They may choose to use the OSP system of open review or commission anonymous reviewers. They may refuse to offer a badge, ask for revisions, or badge the work immediately. An author may ask several groups to badge their work, especially if it is interdisciplinary. Once a group offers their badge, it will be affixed to the relevant version of the author’s piece.

The OSP represents just one model of how we might transform academic publishing for the better, responding to both the technological innovations of the last twenty years and the more recent political imperatives created by government policy.

***

Academia is facing a moment of rare opportunity – a moment when technological sophistication, public opinions, and collective wills might effect dramatic change to the benefit of both academia and its publics. But if academia takes a reactive and reactionary approach – seeking to simply defend current practice rather than innovating – a unique moment will have passed. Choices will be made for academia, not by academia, quite possibly to the detriment of scholarship.

Matching our scholarly goals to our methods and processes requires us to rethink our institutions as well as our institutionalized practices. It will require us to question the role that some of our cherished traditions and beloved material objects play in our work. We will need to ask ourselves: to what extent are we working for them, and to what extent are they working for us?

It is not easy to question the institutions and objects that have had 400 years to embed themselves into our socio-cultural frameworks. But, as historians, we must remind ourselves that at one point, these were also revolutionary and disconcerting. Over the centuries, we have ‘naturalized’ them to the point that they seem essential to what we do and how we do it. They are not, however. There are other scholarly modes. It is time for experiments – time to see what works best for twenty-first-century academia. Perhaps there is not a single answer; perhaps there are several best solutions that match the varying needs of academia and its publics.

15 Comments

  1. Thanks for sharing this thoughtful essay on the Open Scholarship Project and introducing the phrase, “Diamond Open Access,” which is new to me. You write that “The major debates centre around two things: economic sustainability and academic quality,” and pose Diamond as an alternative that merges the best of Gold (publication fees) and Green (self-archiving institutional repositories) models. But it was not clear to me how the Diamond approach deals with publication costs of hosting and editing. Perhaps you’ve addressed this elsewhere?

    Two additional small points:

    First, you write that “the Obama administration’s Office of Science and Technology Policy has mandated open access publication of all publicly funded US research.” But that’s too optimistic a reading of US federal policy at this point. In Feb 2013, the White House issued a narrower statement: “OSTP Director John Holdren has directed Federal agencies with more than $100M in R&D expenditures to develop plans to make the published results of federally funded research freely available to the public within one year of publication. . . ”
    http://www.whitehouse.gov/blog/2013/02/22/expanding-public-access-results-federally-funded-research
    Some observers have questioned whether the directive extends beyond “scientific research” and legally applies to the National Endowment for the Humanities (NEH): see Tim McCormick’s comment on Peter Suber’s post, Feb 2013, https://plus.google.com/109377556796183035206/posts/8hzviMJeVHJ
    However, NEH chairman Jim Leach has publicly supported the OA directive. See Suber’s March 2013 OA newsletter: http://legacy.earlham.edu/~peters/fos/newsletter/03-02-13.htm

    Second, since your essay mentions (more than once) the CommentPress plugin for page-or-paragraph-level commenting, it’s important to credit Christian Wach (UK), who has led open-source software development for the past couple of years. See newest version at http://wordpress.org/extend/plugins/commentpress-core/

    1. Thanks for the comments, Jack. I appreciate it. Tim Gowers was the one who coined “diamond open access” earlier this year. (https://gowers.wordpress.com/2013/01/16/why-ive-also-joined-the-good-guys/)

      For now, the funding for OSP will be a combination of institutional support (for things like hosting) and philanthropy. We are considering some models for editing. I personally prefer an approach as follows. In order to post your work, you have some responsibility for reviewing and editing other people’s work. That way, the entire community is invested in more than just their own essays.

      Thanks for the notes on the federal policies. These are quite useful. And another thank you for noting Christian Wach’s work. If we get a chance to revise this essay, I will make sure that his name goes into the text above.

  2. Look, I will begin by disclaiming that I am deeply distrustful of open access for a lot of reasons, which I will not go into in great detail here, other than to say that like a lot of instances of “creative destruction” where enthusiasts focus on the “creation” half, the “destruction” half gets severely backgrounded. I hear calls to destroy a lot of things that we should be thinking much more carefully about protecting and keeping. But, take what I say with a grain of salt; I am suspicious of all initiatives that use the word “open,” as I think that’s become a buzzword that often points us unthinkingly down exactly the roads we don’t want to go down.

    Here are six points that seem vital to me:

    1) every study I know has found that, contrary to what you at least imply here, online publishing is at least as expensive as paper publishing.

    2) most humanities and even social sciences publishers are non-profits. that is, their costs go solely to paying for their services. suggesting that they can no longer charge for those services is depriving a vital institution of the bare income it needs.

    3) the idea that government funding deprives the recipient of the ability to profit off his or her work is a terrible philosophical and practical argument to make. it is factually incorrect, despite sounding good. In the US, at least, there are a huge number of things that are directly federally- or state-funded that nevertheless charge user fees and licenses, and/or impose access restrictions, and until now nobody has made the argument that these structures are illegal. National parks, toll roads, museums, charge for access. Many Federal institutions charge for access or services, do not necessarily allow citizens to freely use those services, or do not allow the public access at all.

    4) while the notion that public funding implies free public access has gained some traction in the medical sciences for what appear to be humanitarian reasons, even there it is troubling, because the effect is to make research results freely available to for-profit corporations without even the minimal subscription payments to publishers they made previously. The effect is to make the rich even richer.

    5) Lastly, but perhaps most importantly, making philosophical arguments for requiring free access to publications puts articles in the spotlight and ignores books. Some people counter by saying “academics don’t earn money off of books,” but that is wildly incorrect. At any given time, about half of the books on both the NYTimes Fiction and Nonfiction bestseller lists are written by academics, sometimes with NEH or NEA grants. Suggesting that these folks–and you know their names–must choose between their academic jobs or their publishing careers is tremendously bad news for the academy. take a look at the faculty roster of any university’s English, History, and many other departments–many of the faculty have published mass market books. Creative Writing is a particularly notable case. Further, many more have published articles in for-profit magazines that pay authors directly and charge for access. Preventing authors from accessing these revenue streams is an awful idea. If you tell Toni Morrison (at Princeton last I heard) that she had to give away her books if she continues to teach at Princeton, I would think it likely that she would quit her Princeton job. Who wins that way?

    6) One more, connected issue regarding the public-funding notion is that many Universities, like Princeton, are private. If the argument is accepted all the way down, we could have this equation: teach at Princeton, you can keep the income from your writing. Teach at University of Michigan, you must give your work away for free. That is a recipe for destroying what is left of public-funded education and handing the remainder over to the already-richer private institutions. Why is that desirable?

    Finally, as a general note, the presumption that publishing equals restricting access to information is turning 400 years of history on its head. Publishing is what got us here. Publishing is *providing* access to information. It may not be freely open to everyone, but it seems to me that Stephen King, Stephen Hawking, Richard Dawkins, Toni Morrison, Robert Caro, and many others have reached millions and milliions of people despite having their work “paywalled” by “gatekeepers”–or, actually, published by professional information distributors.

    1. There are some interesting issues raised here – the implications for commercially successful scholarship (and the people who produce it) will certainly need to be addressed as we move to open-access platforms.

      That said, I’m not entirely sure that academic publishers still qualify as ‘vital institutions.’ The production of research, the editing of journals, and peer review are all done by scholars (usually for free). The only vital contribution that publishers have made to this process is the dissemination of research – something that we can now do much more effectively using open access platforms. I’m also sceptical about your claims that removing the publisher does nothing to reduce the cost of academic publishing. The cost of hosting 7,000 words of plain text cannot possibly approach the £1000+ fees that have recently been proposed for gold open access.

      I want my work to be accessible to the largest possible audience, and for it to be published as soon as possible after I’ve finished writing it. However, I also want it to be peer reviewed and imbued with academic credibility. I think most researchers feel the same way. The Diamond Open Access model proposed here has long seemed like the obvious solution, and I’m glad that we’re finally making progress in this direction. You’re right to highlight its destructive implications, but the benefits of freely accessible information surely outweigh these problems.

    2. While I have my own issues about Open Access, I can’t say that I find your arguments against it terribly convincing. In order:

      1) I’ve seen plenty of studies that say the opposite – here’s one http://www.nature.com/news/open-access-the-true-cost-of-science-publishing-1.12676 .The ones that claim the costs are the same tend to be the result of vested interests in the status quo.

      2) While the societies are non-profits, they mostly out source the publishing to profit making companies. And they make big profits, which are not returned to scholarship, education or the authors. The added cost is the thing that makes people angry.

      3) The vast majority of authors do not charge or get financial returns for their work in journals (which is what this article is about). So I’m not sure what you are talking about here.

      4) While some for-profits would stand to save money by not having to pay subscriptions, so would all educational institutions. Win-win.

      5) Once again, you are muddying the waters between journals and books. This article is talking about academic journal articles, which the vast majority of authors receive zero monetary reward for. I reckon Toni Morrison will sleep easy.

      6) The question is not whether Princeton is a private institution – the question is who paid for the research, and what the funders deserve in return. Last year Princeton received just under $44.5million from the NIH – http://report.nih.gov/award/index.cfm so the same rules should apply to them as Michigan.

      Final point: Of course publishing is about *providing* access to information – the question here is about whether there is a better way of doing it than a system invented for the technology of the eighteenth century.

  3. You write:

    “Scholarly societies, often the organizations that produce academic
    journals, have budgets tied to revenue from journal subscriptions. And,
    since they have historically been essential to academia – hosting
    conferences, serving as advocates for the profession, and providing a
    variety of supplementary benefits – declines in revenue from the
    journals have the potential to undermine their viability.”

    The service to academics, especially the intangible benefits of interacting with other scholars at conferences is especially valuable to me. I love the idea of open access journals. But I worry that professional societies would collapse to the detriment of their fields if they lose the ability to generate revenue from publishing. (I’m coming from the STEM world, so my views are colored with those lenses. I don’t pretend to know how professional societies in the humanities would be affected.)

Your email address will not be published. Required fields are marked *