.Attributes Medicine, Released online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although huge language models (LLMs) present commitment in controlled settings, a study currently exposes their limitations in real-world scientific treatments as well as directs the means towards durable examination and also benchmarking prior to professional use.