Based on comprehensive academic research, I have compiled a detailed overview of scholarly articles and frameworks that can strengthen your developmental editor evaluation criteria. This research spans multiple disciplines including literary analysis, manuscript evaluation, academic publishing, and narrative assessment.
The academic literature reveals several critical gaps in your current YAML criteria structure, particularly in areas of narrative complexity, structural assessment methodologies, and systematic evaluation frameworks. The research indicates that effective developmental editing requires more nuanced criteria that address both macro-level narrative elements and micro-level textual features.
Your original criteria covered four main elements: Plot Structure, Pacing, Character Development, and Thematic Cohesion. Academic research suggests expanding these to include:
"Towards Evaluating Narrative Quality In Student Writing"[1] - Summary: This research establishes automated assessment of narrative quality through manual scoring of narrative-relevant traits and sub-traits, measuring inter-annotator agreement and developing linguistic features for narrative quality evaluation. - Potential Usage: Can inform the development of more specific criteria for evaluating narrative coherence and quality in manuscripts. - Section Reference: Character Development and Plot Structure enhancement
"Quality of Narratives in Assessment: Piloting a List of Evidence-Based Quality Indicators"[2] - Summary: Addresses the challenge of evaluating narrative quality in assessment contexts, proposing standardized quality indicators based on evidence-based criteria. - Potential Usage: Provides methodology for developing operational quality indicators that can be systematically applied in developmental editing. - Section Reference: All evaluation criteria sections
"Annotation Guidelines for Narrative Levels and Narrative Acts"[3] - Summary: Operationalizes narrative level concepts for machine learning applications, separating "level" and "narrative" into dedicated subcategories with vertical and horizontal story alignment. - Potential Usage: Can inform the development of more sophisticated plot structure evaluation criteria that account for narrative complexity. - Section Reference: Plot Structure - complexity and layering assessment
"DeltaScore: Fine-Grained Story Evaluation with Perturbations"[4] - Summary: Introduces a novel methodology employing perturbation techniques for evaluating nuanced story aspects like fluency and interestingness. - Potential Usage: Provides systematic approach for evaluating subtle narrative elements that traditional metrics might miss. - Section Reference: All criteria sections - methodology enhancement
"How to Write Your First Research Paper"[5] - Summary: Comprehensive guide outlining seven rules for manuscript preparation, including structured approaches to drafting, revision strategies, and quality improvement techniques. - Potential Usage: Can inform the development of process-oriented evaluation criteria that assess manuscript development stages. - Section Reference: Overall framework methodology
"A novel 'conceive, design, implement, operate (CDIO)' framework for evaluating artificial intelligence–generated scholarly manuscripts"[6] - Summary: Adapts the CDIO framework for editorial review processes, providing systematic methodology for comprehensive manuscript evaluation. - Potential Usage: Offers structured approach for organizing developmental editing criteria into coherent evaluation stages. - Section Reference: Framework organization and implementation
"How to perform a high-quality peer review"[7] - Summary: Provides comprehensive overview of best practices, responsibilities, and evaluation criteria for peer reviewers, emphasizing objectivity, rigor, and professionalism. - Potential Usage: Can inform the development of standardized evaluation procedures and quality control measures. - Section Reference: Quality assurance and consistency measures
"Fundamental problems in the peer‐review process and stakeholders' perceptions of potential suggestions for improvement"[8] - Summary: Identifies key issues in peer review including bias, transparency, and standardization challenges, with proposed solutions for improvement. - Potential Usage: Helps identify potential weaknesses in evaluation criteria and suggests improvements for consistency and fairness. - Section Reference: Process improvement and bias reduction
"Assessing Writing: A Review of the Main Trends"[9] - Summary: Comprehensive review of writing assessment approaches, classifying them into a priori scoring systems (holistic and analytic) and a posteriori trait-based systems. - Potential Usage: Provides foundation for developing more sophisticated scoring methodologies for developmental editing. - Section Reference: Assessment methodology and scoring systems
"Review of automated writing evaluation systems"[10] - Summary: Examines various automated writing evaluation systems, their underlying technologies, and applications in educational contexts. - Potential Usage: Can inform the development of systematic evaluation criteria that could potentially be automated or standardized. - Section Reference: Consistency and scalability improvements
Based on this research, I recommend expanding your evaluation criteria to include:
Narrative Complexity Assessment
Literary Quality Indicators
Process-Oriented Evaluation
Quality Assurance Framework
The research suggests that effective developmental editing criteria should: - Incorporate evidence-based quality indicators - Maintain consistency across different evaluators - Address both macro-level narrative structure and micro-level textual features - Include systematic revision and improvement processes - Provide clear operational definitions for each criterion
This enhanced framework will provide more rigorous, comprehensive, and academically-grounded evaluation criteria for your developmental editing applications.
[1] http://www.mitpressjournals.org/doi/pdf/10.1162/tacl_a_00007 [2] https://pmejournal.org/articles/10.5334/pme.925/ [3] https://culturalanalytics.org/article/30701.pdf [4] https://culturalanalytics.org/article/30704.pdf [5] https://pmc.ncbi.nlm.nih.gov/articles/PMC3178846/ [6] http://escienceediting.org/journal/view.php?doi=10.6087/kcse.348 [7] https://pmc.ncbi.nlm.nih.gov/articles/PMC11797007/ [8] https://ese.arphahub.com/article/99151/ [9] http://jurnal.unsyiah.ac.id/SiELE/article/download/1831/1727 [10] https://www.degruyter.com/document/doi/10.1515/jccall-2021-2007/pdf [11] https://francis-press.com/papers/8624 [12] https://www.semanticscholar.org/paper/e3fe036c8734fe28469a43dae34ce345c6aa2d54 [13] https://www.semanticscholar.org/paper/50a147f23f8ffeb6e87de89bdc62b90a2d1e75c3 [14] https://www.semanticscholar.org/paper/89fb890847035cc7f56abb285ff173e392941bf1 [15] https://www.mdpi.com/2073-4425/14/3/612 [16] https://www.emerald.com/insight/content/doi/10.1108/EBR-09-2017-0162/full/html [17] https://www.semanticscholar.org/paper/d3f97e2ea8f4f27a36551fc6b091853d38c77318 [18] https://www.semanticscholar.org/paper/8be6ae8ee1f5d2a3dfeab89fc674ff3d35e389b8 [19] https://www.semanticscholar.org/paper/fdb8e00415c05d184de62d34e779bb789de81084 [20] https://academic.oup.com/jrr/article/62/Supplement_1/i53/6263883 [21] https://pmc.ncbi.nlm.nih.gov/articles/PMC4332929/ [22] https://pmc.ncbi.nlm.nih.gov/articles/PMC11197521/ [23] https://www.frontiersin.org/journals/pharmacology/articles/10.3389/fphar.2024.1364135/pdf [24] https://pmc.ncbi.nlm.nih.gov/articles/PMC11133854/ [25] https://www.mdpi.com/2073-4409/11/17/2682/pdf?version=1661739486 [26] https://pmc.ncbi.nlm.nih.gov/articles/PMC9454589/ [27] https://pmc.ncbi.nlm.nih.gov/articles/PMC8668112/ [28] https://www.fbscience.com/Landmark/articles/pdf/Landmark4997.pdf [29] https://pmc.ncbi.nlm.nih.gov/articles/PMC11946880/ [30] https://pmc.ncbi.nlm.nih.gov/articles/PMC6941877/ [31] https://ijccd.umsida.ac.id/index.php/ijccd/article/view/1190 [32] https://www.paradigmpress.org/SSSH/article/view/1575 [33] https://www.termedia.pl/doi/10.5114/biolsport.2023.125623 [34] https://www.americaspg.com/articleinfo/3/show/3047 [35] https://onlinelibrary.wiley.com/doi/10.1002/ece3.3200 [36] https://www.ijfmr.com/research-paper.php?id=40848 [37] https://eac.elpub.ru/jour/article/view/23 [38] https://ejournal.uin-suka.ac.id/ushuluddin/alquran/article/view/3571 [39] https://www.semanticscholar.org/paper/81770390693c891f704371d8f8e582684d425fc6 [40] https://www.semanticscholar.org/paper/b70795746b106b45e48f4e5c7efbc65b35e57fec [41] https://downloads.hindawi.com/journals/bri/2022/1492058.pdf [42] https://pmc.ncbi.nlm.nih.gov/articles/PMC9458406/ [43] https://pmc.ncbi.nlm.nih.gov/articles/PMC2528624/ [44] https://pmc.ncbi.nlm.nih.gov/articles/PMC6059534/ [45] https://pmc.ncbi.nlm.nih.gov/articles/PMC4260692/ [46] https://pmc.ncbi.nlm.nih.gov/articles/PMC5405644/ [47] https://www.frontiersin.org/articles/10.3389/fspor.2021.648929/pdf [48] https://pmc.ncbi.nlm.nih.gov/articles/PMC6016396/ [49] https://pmc.ncbi.nlm.nih.gov/articles/PMC11681961/ [50] https://scholar.kyobobook.co.kr/article/detail/4010068268069 [51] https://goldncloudpublications.com/index.php/irjaem/article/view/226 [52] https://ejournal.ppsdp.org/index.php/pijed/article/view/310 [53] https://www.mdpi.com/2076-393X/12/8/852 [54] https://www.mdpi.com/2075-5309/13/2/339 [55] https://www.mdpi.com/2075-4663/12/10/278 [56] https://openjournals.library.sydney.edu.au/CAL/article/view/15780 [57] https://journals.sagepub.com/doi/10.33151/ajp.18.820 [58] https://hrcak.srce.hr/280917 [59] https://dl.acm.org/doi/10.1145/2968220.2968242 [60] https://onlinelibrary.wiley.com/doi/10.1002/jrsm.1751 [61] https://www.tandfonline.com/doi/full/10.1080/00223891.2024.2425663 [62] https://culturalanalytics.org/article/11473.pdf [63] https://pmc.ncbi.nlm.nih.gov/articles/PMC3952029/ [64] https://journal.unuha.ac.id/index.php/Channing/article/download/2786/785 [65] https://pmc.ncbi.nlm.nih.gov/articles/PMC7413736/ [66] https://arxiv.org/pdf/2205.00299.pdf [67] https://journals.urfu.ru/index.php/Izvestia2/article/view/5170 [68] https://www.frontiersin.org/articles/10.3389/fbioe.2022.1118506/full [69] https://journal.inceif.edu.my/index.php/ijif/article/view/753 [70] https://www.frontiersin.org/articles/10.3389/fsysb.2023.1176588/full [71] https://www.semanticscholar.org/paper/c8cfb0217de19436e81eec6b8fe359e712f140e9 [72] https://onlinelibrary.wiley.com/doi/10.1002/nau.25225 [73] https://muse.jhu.edu/article/963707 [74] https://www.degruyter.com/document/doi/10.1515/medgen-2023-2029/html [75] https://link.springer.com/10.1007/s11192-022-04327-4 [76] https://www.frontiersin.org/articles/10.3389/fncom.2011.00056/pdf [77] https://pmc.ncbi.nlm.nih.gov/articles/PMC3237011/ [78] https://www.mdpi.com/2304-6775/10/1/12/pdf?version=1647522801 [79] https://arxiv.org/html/2502.11368v1 [80] https://arxiv.org/html/2503.05244 [81] https://pmc.ncbi.nlm.nih.gov/articles/PMC4750571/ [82] https://pmc.ncbi.nlm.nih.gov/articles/PMC3385586/ [83] https://pmc.ncbi.nlm.nih.gov/articles/PMC11332108/ [84] https://www.tarupublications.com/doi/10.47974/CJSIM-2020-0077 [85] https://onlinelibrary.wiley.com/doi/10.1002/leap.1637 [86] https://link.springer.com/10.1007/s10115-025-02435-0 [87] https://penerbitadm.pubmedia.id/index.php/JIM/article/view/2570 [88] https://iopscience.iop.org/article/10.1088/1757-899X/1216/1/011002 [89] https://iopscience.iop.org/article/10.1088/1757-899X/1159/1/011002 [90] https://iopscience.iop.org/article/10.1088/1742-6596/2061/1/011002 [91] https://iopscience.iop.org/article/10.1088/1755-1315/868/1/011002 [92] https://iopscience.iop.org/article/10.1088/1755-1315/866/1/011002 [93] https://onlinelibrary.wiley.com/doi/pdfdirect/10.1002/nop2.51 [94] https://pmc.ncbi.nlm.nih.gov/articles/PMC7944958/ [95] https://pmc.ncbi.nlm.nih.gov/articles/PMC6296274/ [96] https://chi.scholasticahq.com/article/128601-how-to-perform-a-high-quality-peer-review [97] https://pmc.ncbi.nlm.nih.gov/articles/PMC5010053/ [98] https://pmc.ncbi.nlm.nih.gov/articles/PMC11108116/ [99] https://pmc.ncbi.nlm.nih.gov/articles/PMC9257857/ [100] https://pmc.ncbi.nlm.nih.gov/articles/PMC9135384/ [101] https://pmc.ncbi.nlm.nih.gov/articles/PMC5050543/ [102] https://www.semanticscholar.org/paper/4bae03c712fe1c1a668089e17fa19c3f418e37ac [103] https://link.springer.com/10.1007/s41062-023-01287-3 [104] https://www.mdpi.com/2075-5309/10/6/102 [105] https://stroy-mex.narod.ru/ [106] http://ijraset.com/fileserve.php?FID=17884 [107] https://www.semanticscholar.org/paper/7b8454074932add2141ff19fdbb246f46481f984 [108] http://koreascience.or.kr/journal/view.jsp?kj=GCSGBX&py=2015&vnc=v15n6&sp=569 [109] https://onlinelibrary.wiley.com/doi/10.1155/2022/6718796 [110] https://www.semanticscholar.org/paper/5a0d609dc6972a081bce9a84aac6534ba60b61aa [111] https://iopscience.iop.org/article/10.1088/1755-1315/769/3/032081 [112] https://aclanthology.org/2023.findings-emnlp.353.pdf [113] https://aclanthology.org/2022.emnlp-main.114.pdf [114] https://culturalanalytics.org/article/30703.pdf [115] https://pmc.ncbi.nlm.nih.gov/articles/PMC10215990/ [116] https://arxiv.org/pdf/2303.08991.pdf [117] https://www.frontiersin.org/articles/10.3389/fpsyg.2022.916214/pdf [118] https://social.ist-journals.com/index.php/journal/article/view/23 [119] https://psyjournals.ru/en/journals/psyedu/archive/2024_n4/Adaskina_Zaretskaya [120] http://www.dovkil-zdorov.kiev.ua/publ/dovkil.nsf/all/article_e?opendocument&stype=3CFB3CACE36D0067C2258BF1002CAA5D [121] https://www.semanticscholar.org/paper/9341b9e6ff127c696fea3ad5981be6ca3ef7064a [122] https://czasopisma.uwm.edu.pl/index.php/pl/article/view/9623 [123] https://www.semanticscholar.org/paper/e25294c5b5b71e1c582a748932f61c9de704c7f8 [124] http://vestnik.osu.ru/2024_2/12.pdf [125] https://znp.nmu.org.ua/index.php/en/archives/53-72en/747-72en08 [126] http://pytlit.chnu.edu.ua/article/view/271932 [127] https://caer.narxoz.kz/jour/article/view/1343 [128] https://www.mdpi.com/2226-471X/7/2/76/pdf [129] https://pmc.ncbi.nlm.nih.gov/articles/PMC1959203/ [130] https://www.mdpi.com/2304-6775/11/1/2/pdf?version=1673013477 [131] https://www.aclweb.org/anthology/E17-1115.pdf [132] https://journal.uny.ac.id/index.php/cp/article/download/55900/pdf [133] https://ccsenet.org/journal/index.php/elt/article/download/9665/6911 [134] https://www.eu-jer.com/core.php?ajax=count&link=EU-JER_9_2_523.pdf [135] http://journal.ucyp.edu.my/index.php/ASHREJ/article/download/46/38