Judgment Bases
Quality of data and validity of analytical techniques
Is the paper technically sound?
Does the paper evaluate the strengths and limitations of the work described?
Are performance metrics clearly stated?
Are results clearly described?
Is relevant previous research discussed adequately?
Are all assumptions referenced by previous proven works?
Long-term reference value
Would this paper's content still be relevant and likely to be cited in future work?
Are the results and interpretation of lasting scientific value?
Is the topic important to the field?
Does the paper strengthen or extend the state of the art?
Technically new, innovative, or a constructive review
Does the subject matter have an interested audience today?
Are ideas/information and methods worthwhile, new, or creative?
Is the author the source of new information?
Are analytical, numerical, or experimental results and interpretation original?
Is the impact of the results clearly stated?
Professional integrity
Is the paper free from commercialism?
Is the paper free from personalities and bias?
Is the paper clear and balanced?
Is prior work of others adequately credited?
Does the author avoid disparaging competitive methods or products?
Are references to previous work presented constructively, in a fair and balanced manner?
Clear presentation
Does the introductory section explain motivation and orient the reader?
Does the paper describe what was done, how it was done, and the key results?
Does the paper stay focused on its subject?
Are tables and figures clear, relevant and correct?
Are the concepts clearly presented?
Is the paper logically organized?
Are titles and keywords used appropriately?
Is the paper's length appropriate to its scope?
Does the author demonstrate knowledge of basic composition skills, including word choice, sentence structure, paragraph development, grammar, punctuation, spelling, and citation of references?
Soundness of conclusions
Are the claims of the paper firmly established?
Are conclusions sound theoretically or experimentally?
Are conclusions supported by the facts presented?