Experience
Dr. Ellen Julian, a seasoned certification executive and psychometrician, has assisted or partnered with the following companies:
- National Board of Medical Examiners and its clients (Psychometrician)
- National Council of State Boards of Nursing (Psychometrician)
- Association of American Medical Colleges – MCAT (Associate Vice President and Director of the MCAT)
- American Registry for Diagnostic Medical Sonography (ARDMS, now Inteleos) (Director of Testing and Senior Director of Psychometric Services)
- American Board of Vascular Medicine (consultant through ARDMS)
- National American Registry of Midwives (consultant through ARDMS)
- Graduate Management Admissions Council (Technical Advisory Committee)
- American Council on Education (assessor)
- American National Standards Institute (psychometric assessor)
- American Society of Clinical Pathologists (Technical Advisory Committee)
- National Board of Osteopathic Medical Examiners (consultant)
- American Board of Echocardiography (consultant)
- Association of American Colleges of Nursing (consultant)
- University of Kentucky College of Pharmacy (consultant)
- Strasz Assessment Systems (consultant)
- Wendt Consulting (partner)
- Touchstone Consulting (partner)
- Caviart Group (consultant and partner)
- Society for Clinical Data Management (consultant)
- American Academy of Sleep Medicine (consultant)
- Associated Equipment Distributors (consultant)
In all these roles, Dr. Julian has provided practical and psychometrically-sound advice for improving examination quality and efficiency. She is an ongoing psychometric assessor for certification clients of ANSI and has prepared both NCCA and ANSI/ISO 17024 accreditation applications for several of organizations.
As an ISO 17024 contracted psychometric assessor, she has extensive experience reviewing a certification organization’s documents and efficiently building a comprehensive picture of the examination’s strengths and weaknesses. While acting as an assessor, she is not allowed to provide advice. That restriction makes her new role of psychometric-strategy consultant a particular joy because now she can use her skills to help certification organizations improve their examinations and processes.
Associations
Performance Testing Council (PTC) – President
Certification Networking Group (CNG) – Program Committee
Institute for Credentialing Excellence (ICE) – Speaker
Association of Test Publishers (ATP) – Committee member and speaker
American Society of Association Executives (ASAE)
Selected Publications
See Google.Scholar for a more complete list
Julian, E.R. & Bontempo, B. (2017) Communication with Candidates and Other Stakeholders. In S. Davis-Becker & C. Buckendahl (Eds.), Testing in the Professions: Credentialing Policies and Practice. New York: Routledge.
Julian, E.R. (September, 2005) Validity of the Medical College Admission Test for Predicting Medical School Performance. Academic Medicine, 80: 910-917.
Julian E.R., Ingersoll, D.J., Etienne, P.M., Hilger, A.E. (April, 2004)
The Impact of Testing Accommodations on MCAT Scores: Descriptive Results. Academic Medicine. 79(4):360-364.
Julian, E., Wendt, A., Way, D. & Zara, A. (2001) Moving a National Licensure Examination to Computer. NurseEducator, 26 (6), pp. 264-267.
Julian, E.R., Way, D.L., Zara, T., & Wendt, A. (2001) Researching Computerized-Adaptive Testing for Implementation in a National Licensure Examination. Nursing Educator, 26 (6), pp.264-267.
Hojat, M. Erdmann, J.B., Veloski, J.J., Nasca, T.J., Callahan, C.A., Julian, E. & Peck, J. (October, 2000) A validity study of the writing sample section of the Medical College Admission Test. Academic Medicine, 75 (10 Suppl), 25-27.
Clyman, S.G., Melnick, D.E., Julian, E.R., Orr, N.A. & Cotton, K.E. (1991) The National Board of Medical Examiners’ computer-based examination
clinical simulation (CBX). Philadelphia: National Board of Medical Examiners.
Julian, E.R. & Wright, B.D. (1988) Using computerized patient
simulations to measure the clinical competence of physicians. Applied Measurement in Education, 1 (4), pp. 299‑318.
