Agricultural Reviews

Agricultural Reviews cover
Volume 47 · Issue 4 · 2026/01/27

Systematic Evaluation of ChatGPT-3.5 and ChatGPT-4.0 for Accuracy and Reliability in Veterinary and Animal Science Education

Priya Dhattarwal
Vivek Sahu
Yashwant Singh
101 Views

Submitted

2025/04/01

First Online

2026/01/27

doi

10.18805/ag.R-2794

Cite article - Priya Dhattarwal, Vivek Sahu, Yashwant Singh. (2026). Systematic Evaluation of ChatGPT-3.5 and ChatGPT-4.0 for Accuracy and Reliability in Veterinary and Animal Science Education. Agricultural Reviews. 47(4): 618–625. doi: 10.18805/ag.R-2794

Abstract

Large Language Models (LLMs) such as ChatGPT are increasingly used in veterinary and animal sciences education, yet systematic performance evaluations across academic domains remain limited. This study quantitatively compared ChatGPT-3.5 and ChatGPT-4.0 in terms of answer accuracy across Animal Sciences, Paraclinical Sciences and Clinical Sciences. A dataset comprising domain-specific questions was presented to both models and responses were scored on a 10-point accuracy scale by subject matter experts. Statistical analyses including mean scores, standard deviations, paired t-tests and one-way and two-way ANOVAs were applied to assess performance differences. Results showed that ChatGPT-4.0 consistently outperformed ChatGPT-3.5 across all domains, with mean differences of +2.0 in Animal Sciences, +2.0 in Paraclinical Sciences and +1.9 in Clinical Sciences, all statistically significant (p<0.001). Moreover, ChatGPT-4.0 exhibited lower variability, indicating more stable accuracy. The overall two-way ANOVA revealed significant main effects for both model version (p<0.001) and academic domain (p = 0.002), with no significant interaction effect. These findings demonstrate that ChatGPT-4.0 provides superior and more consistent performance in veterinary education question-answering compared to ChatGPT-3.5, supporting its adoption as a supplementary learning tool in domain-specific curricula.

References

  1. AlZubi, A.A. and Al-Zu’bi, M. (2023). Application of artificial intelligence in monitoring of animal health and welfare. Indian Journal of Animal Research . 57(11): 1550-1555. doi: 10.18805/IJAR.BF-1698 . Choudhary, O.P., Saini, J., Challana, A., Choudhary, O., Saini, J. and Challana, A. (2023). ChatGPT for veterinary anatomy education: An overview of the prospects and drawbacks. Int J Morphol. 41(4): 1198-1202. Kung, T.H. Cheatham, M., Medenilla, A., Sillos, C.J., Leon, L.D., Elepa&ntilde;o, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J.J., Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health . 2(2): e0000198. Leiter, C., Zhang, R., Chen, Y., Belouadi, J., Larionov, D., Fresen, V. and Eger, S. (2024). Chatgpt: A meta-analysis after 2.5 months. Machine Learning with Applications . 16: 100541. McHugh, M.L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica . 22(3): 276-282. Nori, H., King, N., McKinney, S.M., Carignan, D. and Horvitz, E. (2023). Capabilities of GPT-4 on medical challenge problems. arXiv preprint arXiv:2303.13375. OpenAI. (2024). [online]. Website https://openai.com/ [accessed 1 February, 2024]. Priya, D., Triveni, D., Singh, M., Gyanendra, G.K. and Vivek, S. (2024). Artificial intelligence: As an intelligent tool for the future animal production and better management: A review. Agricultural Reviews . 45(2): 229-238. doi: 10.18805/ag.R-2297 . Reuters. (2023). ChatGPT sets record for fastest growing use base - analyst note [online]. Website https://economictimes. indiatimes.com/tech/technology/chatgpt-sets-record- for-fastest-growing-user-base-analyst note/articleshow/ 97542869.cms?from=mdr. [accessed 3 February, 2024]. Samala, A.D. and Amanda, M. (2023). Immersive learning experience design (ILXD): Augmented reality mobile application for placing and interacting with 3D learning objects in engineering education. International Journal of Interactive Mobile Technologies . 17(5): 22-35. doi: 10.3991/ijim.v17i05. 37067. Samala, A.D., Zhai, X., Aoki, K., Bojic, L. and Zikic, S. (2024). An In- depth review of ChatGPT’s Pros and cons for learning and teaching in education. International Journal of Interactive Mobile Technologies . 18(2): 96-117. doi: 10.3991/ijim. v18i02.46509 Van Dis, E.A., Bollen, J., Zuidema, W., Van Rooij, R. and Bockting, C.L. (2023). ChatGPT: Five priorities for research. Nature. 614(7947): 224-226. Wulcan, J.M., Jacques, K.L., Lee, M.A., Kovacs, S.L., Dausend, N., Prince, L.E. and Keller, S.M. (2025). Classification performance and reproducibility of GPT-4 omni for information extraction from veterinary electronic health records. Frontiers in Veterinary Science. 11: 1490030. Zhai, X. (2022). ChatGPT user experience: Implications for education. Available at SSRN 4312418. Zhang, C., Liu, S., Zhou, X., Zhou, S., Tian, Y., Wang, S. and Li, W. (2024). Examining the role of large language models in orthopedics: Systematic review. Journal of Medical Internet Research . 26: e59607.
EDITORIAL BOARD

Guided by Experienced Academic Leadership

Distinguished scholars and subject experts committed to editorial excellence, scientific integrity and rigorous peer review.

View Full Board
Parvender Sheoran
Chief Editor

Parvender Sheoran

DirectorICAR- Agricultural Technology Application Research Institute, Zone, Ludhiana, India

Jagdish Prasad
Associate chief editor

Jagdish Prasad

Retd., Pr. ScientistICAR-National Bureau of Soil Survey and Land Use Planning Amravati Road, Nagpur, India

Jaspinder Singh
Editor

Jaspinder Singh

Sr. ScientistBayer Crop Sciences, Chesterfield, UNITED STATES

Arun Gupta
Editor

Arun Gupta

ProfessorUniversiti Malaysia Pahang, MALAYSIA