TL; DR: I have analysed the submitted/accepted/online dates for 1023 papers published in 18 GIScience journals to determine the median lag from submission to publication for each journal. Several ranked lists of journals are presented as plots. On average it takes 6.9 months to get a paper reviewed and published online since submission, and about 2.8 more months to have it included in an issue. php
Edit on 18 Sep 2015: this blog post attracted substantial interest (thanks everyone for spreading it around). In the meantime two new journals have been added to the analysis. html
Edit on 18 Jan 2016: I have published a related (scientometric)study in IJGIS which investigates many more different aspects related to GIScience publishing. react
Introduction git
Scholarly publishing can be an annoying process due to an often slow peer-review stage, editorial decision, and inert typesetting procedure. This processing time is known also as publication delay: the chronological distance between the moment a paper is submitted and its publication (Amat, 2009). It can take several months (or years?) to see one’s paper published in an issue of the journal. Naturally, publishing great papers takes time, but long publication delays are frequently caused by the inefficiency of journals and publishers (not to mention reviewers), and are frowned upon by authors. They have been cited to considerably influence one’s decision where to submit a paper (Strevens 2003,Dong et al 2006, Carroll 2001, Swan and Brown 2003, Rousseau and Rousseau 2012, Solomon and Björk 2012). Therefore it comes as no surprise that publishers started to boast about their processing times. spring
Publication delay is a principal topic in scientometrics, with many analyses and papers written on this topic. Long story short, while a long publication delay is a source of frustration for authors, actually it can benefit journals to boost their impact factor (Tort et al, 2012), hence the interest from the scientometric community. The goal of this analysis is to expose the publication delay of journals in GIScience (Geographical Information Science), as done in similar analyses, e.g. analysis for PLOS journals, and various disciplines. api
Terminology app
There is not a firm consensus on the measures about the publication delay. Some researchers consider the publication delay the time from submission to publication, and some distinguish the publication online and publication in an issue. Some people consider only the delay from the paper available online to the date when it becomes paginated and in print (allocated to a volume, assigned with page numbers, and distributed to readers). less
In the digital age the publication in issue is becoming less and less important, and to me (as author) what matters most is the moment the paper becomes available online. However, when the paper is published in print is still the authoritative epoch for determining the impact factor, hence it is of relevance to scientometrics. electron
Let’s consider all the aforementioned measures: ide
The following figure illustrates the typical process of publishing, with the considered lags.
Methodology
Data has been acquired from publishers’ records. 18 GIScience journals have been considered for this analysis. These are the journals I usually consider when preparing a paper, with some additions for added diversity. The list is a subset of the extensive list compiled at my department. The selected journals are listed below (alphabetically):
All articles published in 2014 have been selected, except those published in special issues. This results in 1023 papers included in the analysis, enough to draw a solid conclusion about the publication delay.
Luckily most publishers are fully transparent about the chronological record of each paper (although for some papers the data was missing). However, the analysis for is limited for some journals because their publishers do not state the dates of the submission and acceptance of each paper:
Not enough information to derive the publication delay; only C can be calculated. Example of Wiley / Transactions in GIS
Results
Because of the multiple metrics, multiple ranking lists of journals can be derived, and there are multiple aspects to look at.
The results are shown graphically, with a table with all the data in the end. The plots show the distribution of individual papers in each journal. The small white point denotes the median, and the thick stroke the interquartile range.
Let’s start with the A: the median time from submission of the paper to its acceptance per journal, i.e. peer review:
Exhibit A: Time from the submission of the paper to its acceptance. Entries are sorted by median. (Violin plot made possible by Matplotlib and Seaborn, and inspired by Daniel Himmelstein.)
The ISPRS International Journal of Geo-Information is a clear winner here with a median of 79 days: less than 3 months from a paper submission to acceptance. No wonder this fairly new journal is rapidly gaining popularity. The plot also shows that there is a substantial difference between journals.
After a paper is accepted, it takes some time to get it published online (B):
The ranking differs from the previous one, and Computers & Geosciences emerges as the quickest one (median of 11 days). This can be explained by the practice, that upon acceptance, the journal posts online the accepted manuscript while the final publisher-formatted version is being prepared. This is not the final version of the paper, but having the accepted version available in the meantime is a favourable measure to alleviate publication delay. Kudos to those journals that make their papers accessible as soon as possible.
AAG and GEAN do not fit the plot due to their pitiful performance: their medians are 7.3 and 14.7 months, respectively. Yes, it took Geographical Analysis more than a year to publish an already accepted paper. Shameful. However, it seems that this practice was not continued in 2015.
The lag from submission to publication online of a paper (A+B) is what most people care about (PD: publication delay). Another ranking summing the two above metrics is exposed:
IJGI is first with a median of 92 days, JAG comes second with 161 days, and C&G is third with 186 days. Again, a substantial discrepancy between journals is exposed, ending withGeographical Analysis with a performance of almost two years.
The presented three plots also reveal something else of interest: it seems that some journals have a limit on the duration of the process, e.g. for IJGI and JAG almost no paper took more than approx. 6 and 12 months, respectively, to get published. Furthermore, their narrow distributions reveal a consistent process. For other journals, some papers seem to be stuck in peer review much much longer than others.
After a paper is accepted and published online most authors don’t care anymore. But we are not done yet: the following plot shows the lag from publication online to publication in an issue and print (C). A long online-to-print lag can artificially boost a journal’s impact factor, so technically, editors may hold a paper online for a very long time to manipulate their impact factor.
Again, another ranking is exposed: with GIScience & Remote Sensing, Cartography and Geographic Information Science, and Annals of the Association of American Geographers being the quickest three when it comes to the time between online posting and publication in print. IJDE does not fit the plot owing to its slow reaction, with the median of 18.6 months. The story withGEAN is a bit different. Apparently the papers are published online only when they are published in the issue, so technically C is always zero. Of course this poor practice is reflected in the very long B. Note that this plot debuts JSS and TGIS, the latter not being particularly quick. However, the impact factor of TGIShas recently increased by nearly 40%. Coincidence?
The C (online-to-print) delay, while overlooked by most authors, appears to be exploited by journals to boost their impact factor. For instance, JAG, which has recently increased its impact factor by 36.7%, at the time of this blog post (September 2015) has already its February 2016 issue almost ready with a dozen papers:
I don’t see a reason why to hold unpaginated papers online formonths, except for impact factor related reasons. Not to mention the lack of other explanation behind publishing a 2016 issue when we are still chronologically far from it.
Finally, the total publication delay (TPD) is given below (from submitting the paper to get it published in issue):
As illustrated in the plot, a paper submitted to a GIS journal can take anywhere from a few months to a few years to see it published in an issue.
The results for some journals are stimulating and for some are appalling, prompting me to reconsider my list of GIScience journals. The key takeaways:
Finally, here are the medians in a table. First the three metrics A, B, C, and the publication delays PD and TPD.
Journal | A | B | C | PD | TPD |
---|---|---|---|---|---|
AAG | 8.0 | 7.3 | 1.4 | 16.9 | 17.9 |
CaGIS | 4.9 | 1.3 | 1.3 | 6.3 | 8.3 |
CEUS | 8.5 | 0.9 | 2.3 | 9.4 | 11.8 |
CG | 5.6 | 0.4 | 2.9 | 6.1 | 9.0 |
EPB | 3.7 | 20.5 | 24.0 | ||
GEAN | 11.5 | 14.7 | 0.0 | 23.3 | 23.3 |
GEIN | 8.6 | 1.2 | 8.4 | 9.6 | 17.9 |
GRS | 4.6 | 1.5 | 1.1 | 6.6 | 7.3 |
IJDE | 7.0 | 0.9 | 18.6 | 7.6 | 27.7 |
IJGI | 2.6 | 0.5 | 1.8 | 3.0 | 4.1 |
IJGIS | 6.5 | 1.4 | 3.8 | 8.5 | 12.3 |
JAG | 4.0 | 1.0 | 4.9 | 5.3 | 10.6 |
JGS | 9.9 | 0.8 | 5.9 | 10.7 | 15.8 |
JSS | 1.3 | ||||
PERS | 6.1 | 11.4 | |||
PRS | 5.8 | 1.0 | 1.6 | 7.0 | 8.4 |
SCC | 5.6 | 0.5 | 2.2 | 5.9 | 9.1 |
TGIS | 10.5 | ||||
All papers | 5.6 | 1.0 | 2.8 | 6.9 | 10.7 |
And here is a stacked bar plot with the medians of the three components (A, B, C):
Decomposing the metrics A, B, and C (medians) for the selected journals. The sum of these metrics corresponds to the total publication delay (TPD), however, the sum of medians may slightly deviate from the median of TPD.
The last line of the table above exposes the median of all analysed GIS papers. How does that compare to other disciplines? Björk and Solomon (2013) conducted an extensive cross-disciplinary experiment. I incorporated my findings in their data:
Comparing the publication delay in GIS with other disciplines: could be better. Data source: doi:10.1016/j.joi.2013.09.001
Comparing the results reveals that the total publication delay of GIS is exactly at the average of the considered disciplines (slightly longer than one year). However, the metric A is longer than the cross-disciplinary average. Furthermore, the delay found in GIS is considerably longer than the average of engineering, but not far from earth sciences, to which GIS could be partly assigned. The longer delay may also be explained by the fact that some GIS journals are closer to social sciences, which rank among the disciplines with the longest publication delay.
Now let’s examine individual papers. What are the fastest and slowest papers? Here are some extremes:
I didn’t know it was possible to get a paper accepted the same day (ironic considering that GEAN is the slowest journal in the sample; note that it took it one and half year to publish it after acceptance). An explanation is that it could be a paper resubmitted to the same journal after a prolonged revision. Our champion is followed by a few papers accepted within a month:
On the other side of the axis, we have a Geoinformatica paper that took more than 4 years from its submission to be published in an issue. Mind you, it takes less time to complete a PhD.
Finally, an interesting thing to explore is the relation between the following two measures:
They are not so much related (weak correlation of 0.20).
Conclusion
Publishing in GIS can be slow. Choose your journal wisely.
References and further reading
Amat, C. B. (2009). Editorial and publication delay of papers submitted to 14 selected Food Research journals. Influence of online posting. Scientometrics, 74(3), 379–389.http://doi.org/10.1007/s11192-007-1823-8
Björk, B.-C., & Solomon, D. (2013). The publishing delay in scholarly peer-reviewed journals. Journal of Informetrics, 7(4), 914–923.
http://doi.org/10.1016/j.joi.2013.09.001
Carroll, R. J. (2001). Review times in statistical journals: Tilting at windmills? Biometrics, 57(1), 1–6.
http://doi.org/10.1111/j.0006-341X.2001.00001.x
Dong, P., Loh, M., & Mondry, A. (2006). Publication lag in biomedical journals varies due to the periodical’s publishing model. Scientometrics, 69(2), 271–286.
http://doi.org/10.1007/s11192-006-0148-3
Rousseau, S., & Rousseau, R. (2012). Interactions between journal attributes and authors’ willingness to wait for editorial decisions.Journal of the American Society for Information Science and Technology, 63(6), 1213–1225.
http://doi.org/10.1002/asi.22637
Strevens, M. (2003). The role of the priority rule in science. The Journal of Philosophy, 100(2), 55–79.
http://doi.org/10.2307/3655792
Solomon, D. J., & Björk, B.-C. (2012). Publication fees in open access publishing: Sources of funding and factors influencing choice of journal. Journal of the American Society for Information Science and Technology, 63(1), 98–107.
http://doi.org/10.1002/asi.21660
Swan, A., & Brown, S. (2003). Authors and electronic publishing: what authors want from the new technology. Learned Publishing, 16(1), 28–33.
http://doi.org/10.1087/095315103320995069
Tort, A. B. L., Targino, Z. H., & Amaral, O. B. (2012). Rising Publication Delays Inflate Journal Impact Factors. PLOS One, 7(12), e53374.
http://doi.org/10.1371/journal.pone.0053374
Trivedi, P. K. (1993). An analysis of publication lags in econometrics. Journal of Applied Econometrics, 8(1), 93–100.
http://doi.org/10.1002/jae.3950080108
Woolston, C. (2015): Long wait for publication plagues many journals. Nature, 523(7559), 131.
http://doi.org/10.1038/523131f
Disclaimer and further information: