Maryland Assessment Research Center (MARC)

Technical Reports

  • Jiao, H., Yadav, C., & Sharh, N. (2023). Automated scoring of the NAEP math constructed-response items (Technical Report). Submitted to the 2023 NAEP Math Item Automated Scoring Competition.

  • Xu*, S., Fisk*, C., Jiao, H., & Lissitz, R. W. (2023). Comparison of pre-smoothing and post-smoothing using Equate (R package) and LEGS (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Li*, G., Jiao, H., & Lissitz, R. W. (2023). Comparing propensity matching and weighting in producing equivalent groups for linking (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H., Xu*, S., Fisk*, C., & Lissitz, R. W. (2023). Investigating Maryland students’ high school academic performance indictors as college and career readiness measures (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Ren*, J., Jiao, H., Han*, Y., & Lissitz, R. W. (2022). Further exploration of the relationship between Maryland students’ high school academic performance and their post-secondary academic achievements (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Tian*, C, Xu*, S., Jiao, H., Han*, Y., Yang*, H., & Lissitz, R. W. (2022). Exploring the relationship between Maryland students’ high school academic performance and their post- secondary academic achievements (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland

  • Tian*, C, Jiao, H., Han*, Y., & Lissitz, R. W. (2022). Exploring the relationship between Advanced Placement (AP) exam performance and the post-secondary academic achievements (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Xu*, S., Tian*, C, Jiao, H., Han*, Y., Yang*, H., & Lissitz, R. W. (2021). Combining instructionally embedded test scores to obtain scores equivalent to year-end test scores (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Xu*, S., Tian*, C, Xin*, Q., Jiao, H., & Lissitz, R. W. (2021). Alignment of the SAT mathematics items and the PARCC Algebra I items to the Maryland Algebra I College and Career Ready Standards (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R. W. (2021). Student engagement in remote testing (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Xu*, S., Jiao, H., & Lissitz, R. W. (2021). Virtual standard setting: Issues and practices (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Tian*, C., Jiao, H., & Lissitz, R. W. (2021). Detection of cheating in remote testing (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed test content (ARL-1917 Obj. 10 Technical Report). College Park: ÀÖ²¥´«Ã½ of Maryland Applied Research Lab for Intelligence & Security.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed test format (ARL-1917 Obj. 8 Technical Report). College Park: ÀÖ²¥´«Ã½ of Maryland Applied Research Lab for Intelligence & Security.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed scoring levels & outcomes (ARL-1917 Obj. 9 Technical Report). College Park: ÀÖ²¥´«Ã½ of Maryland Applied Research Lab for Intelligence & Security.

  • Qiao*, X., Liao*, M., Jiao, H., & Lissitz, R. W. (2020). Transition weights in value tables for growth measure (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R. W. (2019). Investigating the relationship between SAT scores and post-secondary outcomes (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R.W. (2019). Investigating the Concordance Relationship Between the HSA Cut Scores and the PARCC Cut Scores Using the 2018 PARCC Test Data. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R. W. (2019). Investigating the relationship between the PARCC test scores and post-secondary outcomes (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, M., Lee*, J., Jiao, H., & Lissitz, R. W. (2019). Maryland state student growth percentile on Multi-State Alternate Assessment (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R.W. (2017). Combined Score Options for High School Graduation Assessment. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, D., Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R.W. (2017). Investigating the Concordance Relationship Between the HSA Cut Scores and the PARCC Cut Scores Using the 2017 PARCC Test Data. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, M., Liao*, D., Jiao, H., & Lissitz, R. W. (2017). The relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Zou*, J., Liao*, D., Liao*, M., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the concordance relationship between the HSA cut scores and PARCC cut scores using the 2017 test data (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, M., Liao*, D., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT across years (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Chen*, L., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the concordance relationship between the MSA cut scores and PARCC cut scores across years (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Chen*, L., Liao*, M., Liao*, D., Zou*, J., Jiao, H., & Lissitz, R. W. (2016). Maryland State student subgroup performance on 2016 PARCC tests (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Zou*, J., Liao*, M., Jiao, H., & Lissitz, R. W. (2016). Maryland State student performance on 2016 PARCC tests (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Chen*, L., Zou*, J. Jiao, H., & Lissitz, R. W. (2016). Investigating the concordance relationship between the MSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H., Zou*, J., Liao*, D., Li*, C., & Lissitz, R. W. (2016). Investigating the concordance relationship between the HSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Bryant*, R., Jiao, H., & Lissitz, R. W. (2016). An investigation of NYC students’ performance and experience with the 2015 PARCC pilot tests (Research report submitted to PARCC Inc.). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, D., Li*, C., Jiao, H., & Lissitz, R. W. (2015). Investigating the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Liao*, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of different approaches to dealing with directional local item dependence in multipart items (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Li*, M., Jiao, H., & Lissitz, R. W. (2015). The impact of ignoring multiple-group structure in testlet-based tests on ability estimation (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Kang*, Y., Jiao, H., & Lissitz, R. W. (2015). The impact of ignoring the multiple-group structure of item response data (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Lee*, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of latent trait and latent class-based models for cognitive diagnosis (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H. (2014). Differential item functioning analysis for testlet-based assessments. (Research Report submitted to the Governing Board for the AERA Grants Program). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H., Haynie, K., & Liu*, J. (2011). A partial credit modeling study of the NCLEX innovative items. (Research Report submitted to the Joint Research Committee, NCSBN). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H., Lissitz, R., & Hou*, X. (2010). Computer-based testing in the K-12 state assessments. (MARCES Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Lissitz, R., Li*, Y., & Jiao, H. (2009). Investigation of Factorial Structure of the 2009 HSA Biology Test across Accommodated and non-accommodated Students. (MARCES Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.

  • Jiao, H., Wang, S., Johnson, M., & Jiang, J. (2007). Investigation of 2006 FCAT Reading Grade 3 Test. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2007). The calibration, equating, and scaling specification for the spring 2007 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Technical Report for the Michigan Educational Assessment Program 2006-2007 Cycle. (2007). Harcourt Assessment Inc. San Antonio, TX.

  • Technical Report for the Michigan Merit Exit Program 2006-2007 Cycle. (2007). Harcourt Assessment Inc. San Antonio, TX.

  • Jiao, H. (2007). The calibration, equating, and scaling specification for the fall 2006 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). Sampling Design for the Michigan Educational Assessment Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Vukmirovic, Z., & Jiao, H. (2006). Calibration and equating options for FCAT writing + assessment. (White Paper). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). Test Construction Specification for the Michigan Educational Assessment Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S., He, W., & Vukmirovic, Z. (2006). The comparability of the spring 2006 online pilot test and the paper-and-pencil tests for the Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). The test construction specification for the fall 2006 and spring 2007 test administrations for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). The calibration, equating, and scaling specification for the spring 2006 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2006). The calibration, equating, and scaling specification for the Fall 2005 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Vukmirovic, Z., Jiang, J., & Jiao, H. (2005). Comparison of different scoring methods of FCAT writing + assessments. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2005). The comparability of the spring 2005 online pilot test and the paper-and-pencil tests for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2005). The test construction specification for the fall 2005 and spring 2006 test administrations for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2005). The calibration, equating, and scaling specification for the spring 2005 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Ayres, G, & Vukmirovic, Z. (2005). Pre-equating vs. post-equating for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Ayres, G., & Vukmirovic, Z. (2005). Impact of removing open-ended items from live administration for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Chu, K., & Vukmirovic, Z. (2005). Comparison of writing prompts in field-test and live administration for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S, Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2005). The effect of computerized test vs. paper-and-pencil test on K-12 student reading achievement: A meta-analysis. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S., Vukmirovic, Z., & Young, M. (2004). A Study to Establishing the Vertical Scale for MCA-II Using the Stanford Achievement Test 10. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S. & Vukmirovic, Z. (2004). Dimensionality Assessment for MCAS Grade 4, 7, and 10 ELA 2003 Test Administration. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2004). Test construction specifications for Minnesota Academic Assessments-II 2005 pilot test administration. (Technical report). Harcourt Assessment, Inc. San Antonio, TX.

  • Wang, S., Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2004). The effect of computerized test vs. paper-and-pencil test on K-12 student mathematics achievement: A meta-analysis. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S., Jiao, H., Brooks, T., & Young, M. J. (2004). Construct equivalence of Stanford Diagnostic Reading Test (Fourth Edition) between two administration modes. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S., Jiao, H., Young, M. J., & Brooks, T. (2004). Construct equivalence between customized and original Stanford Achievement Reading Comprehension Tests (Tenth Edition). (Research Report). San Antonio, TX: Harcourt Assessment.

  • Davis, J., Jiao, H., Vukmirovic, A., & Young, M. J. (2004). Comparison between pre-equating and post-equating for large-scale state assessment program. (Research report), Harcourt Assessment Inc. San Antonio, TX.

  • Stephenson, A., Jiao, H., & Wall, N. (2004). A performance comparison of native and Non- native speakers of English on an English Language Proficiency Test. (Research report). Harcourt Assessment, Inc. San Antonio, TX.

  • Nevada Technical Report for the CRT and HSPE Assessments 2002-2003 Cycle. (2004). Harcourt Assessment Inc. San Antonio, TX.

  • Jiao, H., & Paek, I. (2002). Examining the relationship between the full and the abbreviated versions of the Stanford Diagnostic Tests for Reading and Mathematics. Harcourt Educational Measurement. San Antonio, TX.

  • Cerrillo, T., Young, M. J., Skorupski, W., Jiao, H., Paek, I., Shin, S., & Turner, J. (2002). Performance Assessment research program: Analyses of bias and Differential Item Functioning on the New Standards Reference Examinations (Form E). Harcourt Educational Measurement, San Antonio, TX.*

  • Jiao, H. (2018, June). Development and modeling of technology-enhanced innovative assessment. Presented at East China Normal ÀÖ²¥´«Ã½, Shanghai, China.

  • Jiao, H. (2018, June). Modeling of technology-enhanced innovative assessment data. Presented at Beijing Normal ÀÖ²¥´«Ã½, Beijing, China.

  • Jiao, H. (2018, June). Joint modeling for product data and process data for cognitive diagnosis. Presented at Jianxi Normal ÀÖ²¥´«Ã½, Nanchang, Jiangxi Province, China.

  • Jiao, H& Zhan, P. (2018, July). Technology-enhanced innovative science assessment. Presented at the National Conference on STEM Education in China, Shenzhen, China.

  • Liao, D., Liao, M., Qiao, X., Jiao, H., & Lissitz, R.W. (2017). Investigating the concordance relationship between the HSA cut scores and the PARCC cut scores using the 2017 PARCC test data. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Liao, M., Liao, D., Jiao, H., & Lissitz, R.W. (2017). The relationship between the PARCC test scores and the college admission tests using the 2017 PARCC: SAT/ACT/PSAT. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Liao, M., Liao, D., Jiao, H., & Lissitz, R.W. (2017). Validating the relationship between the PARCC test scores and the college admission tests. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Qiao, X., Jiao, H., & Lissitz, R.W. (2017). Combined Score Options for High School Graduation Assessment. (MARC research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Jiao, H., Zhan, P., Liao, M., & Man, K. (2017, November). A joint multigroup testlet model for responses and response time accounting for differential item and speed functioning. Presented at the fifth conference on the statistical methods in psychometrics. Columbia ÀÖ²¥´«Ã½, New York.
  • Chen, L., Liao, M., Liao, D., Zou, J., Jiao, H., & Lissitz, R. W. (2016). Maryland State student subgroup performance on 2016 PARCC tests (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Zou, J., Liao, M., Jiao, H., & Lissitz, R. W. (2016). Maryland State student performance on 2016 PARCC tests (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Jiao, H., Zou, J., Liao, D., Li, C., & Lissitz, R. W. (2016). Investigating the concordance relationship between the HSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Liao, D., Li, C., Jiao, H., & Lissitz, R. W. (2015). Investigating the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Liao, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of different approaches to dealing with directional local item dependence in multipart items (MARC Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Jiao, H. (2014). Differential item functioning analysis for testlet-based assessments. (Research Report submitted to the Governing Board for the AERA Grants Program). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Jiao, H., Lissitz, R., & Hou, X. (2010). Computer-based testing in the K-12 state assessments. (MARCES Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Lissitz, R., Li, Y., & Jiao, H. (2009). Investigation of Factorial Structure of the 2009 HSA Biology Test across Accommodated and non-accommodated Students. (MARCES Technical Report). College Park, MD: ÀÖ²¥´«Ã½ of Maryland.
  • Jiao, H., & Lissitz, R. (2014, October). Exploring psychometric models for calibrating innovative items embedded in situations. Presented at the Fourteenth Annual Maryland Assessment Conference: Technology enhanced innovative assessment: Development, modeling, and scoring from an interdisciplinary perspective. ÀÖ²¥´«Ã½ of Maryland, College Park.
  • Jiao, H., Kamata, A., & Xie, C. (2014, November). Multilevel cross-classified testlet model for complex item and person clustering in item response modeling. To be presented at the conference on Advances in multilevel modeling for educational research: Addressing practical issues found in real-world applications. ÀÖ²¥´«Ã½ of Maryland, College Park.
  • Jiao, H., & Yang, X. (2014, May). A multicomponent testlet model. Presented at the Third Workshop on Statistical Methods in Cognitive Assessments. Fudan ÀÖ²¥´«Ã½, Shanghai, China.
  • Jiao, H. (2014, February). Polytomous multilevel testlet models for testlet-based assessments with complex sampling designs. Presented at the Joint Program in Survey Methodology, ÀÖ²¥´«Ã½ of Maryland, College Park.