Publication Details
Title: Findings and Implications from Data Mining the IMC Review Process
Author: R. Beverly and M. Allman
Group: Networking
Date: January 2013
PDF: http://www.icsi.berkeley.edu/pubs/networking/findingsimplications12.pdf
Overview:
The computer science research paper review process is largely human and time-intensive. More worrisome, review processes are frequently questioned, and often non-transparent. This work advocates applying computer science methods and tools to the computer science review process. As an initial exploration, we data mine the submissions, bids, reviews, and decisions from a recent top-tier computer networking conference. We empirically test several common hypotheses, including the existence of readability, citation, call-for-paper adherence, and topical bias. From our findings, we hypothesize review process methods to improve fairness, efficiency, and transparency.
Bibliographic Information:
ACM SIGCOMM Computer Communication Review, Vol. 3, No. 1, pp. 23-29
Bibliographic Reference:
R. Beverly and M. Allman. Findings and Implications from Data Mining the IMC Review Process. ACM SIGCOMM Computer Communication Review, Vol. 3, No. 1, pp. 23-29, January 2013
Author: R. Beverly and M. Allman
Group: Networking
Date: January 2013
PDF: http://www.icsi.berkeley.edu/pubs/networking/findingsimplications12.pdf
Overview:
The computer science research paper review process is largely human and time-intensive. More worrisome, review processes are frequently questioned, and often non-transparent. This work advocates applying computer science methods and tools to the computer science review process. As an initial exploration, we data mine the submissions, bids, reviews, and decisions from a recent top-tier computer networking conference. We empirically test several common hypotheses, including the existence of readability, citation, call-for-paper adherence, and topical bias. From our findings, we hypothesize review process methods to improve fairness, efficiency, and transparency.
Bibliographic Information:
ACM SIGCOMM Computer Communication Review, Vol. 3, No. 1, pp. 23-29
Bibliographic Reference:
R. Beverly and M. Allman. Findings and Implications from Data Mining the IMC Review Process. ACM SIGCOMM Computer Communication Review, Vol. 3, No. 1, pp. 23-29, January 2013