Chengdu, China, July 4, 2023 (WAM) — Recently, the first consistency assessment between an AI doctor and a real doctor was conducted at Chengdu Haiersen Hospital in Sichuan Province, southwestern China. In the 91 cases investigated, the AI physician “MedGPT” and the attending physicians reached 96 percent agreement on the case outcome. The Global Times quoted the hospital as saying on Monday.
According to the organizer, Haier Sen Hospital, more than 120 patients and 10 attending physicians from West China Hospital participated in the evaluation study. According to event organizers, this was the first assessment exercise by AI doctors in China.
There were 8 consultation desks in 7 departments, including 2 departments of cardiology, urology, and orthopedics on the premises. Physician assistants were placed at each consultation desk, and the AI doctor “MedGPT” was informed of the patient’s symptoms in writing, and the actual doctor also received the patient’s information in synchronization with the consultation system.
According to China News, “This evaluation is not a competition between AI and real doctors. The aim of MedGPT development is to preferably utilize this AI doctor to assist real doctors in their visits through continuous optimization. ‘ said a hospital staff member.
“MedGPT” primarily serves the primary diagnosis of patients, such as common ailments such as headaches and fevers, to help practical physicians understand and judge the range of possible ailments. Medical AI helps patients better understand their symptoms and how to manage their diet during treatment. In this assessment, both MedGPT and real-world physicians analyzed the same cases and their responses were compared in real-time on separate screens.
Seven experts from Peking University People’s Hospital, Sino-Japanese Friendship Hospital, Beijing Friendship Hospital, and Fuwei Hospital reviewed 91 cases, AI doctor consultation, diagnosis, treatment suggestions, auxiliary examination schemes, data analysis accuracy , provision of explainable information, and evaluation were scored. Be able to speak fluently in natural language during consultation.
As a result, the average score of the real doctor was 7.5 points, and the average score of the AI doctor “MedGPT” was 7.2 points. The consistency of scoring results between AI doctors and attending physicians at Huaxi Hospital has reached 96%.
At present, the AI doctor “MedGPT” can diagnose more than 3,000 common diseases, and the number of diseases that can be diagnosed will increase significantly by the end of the year when the first phase of testing is completed, a staff member told Global Times. Monday.
Currently, the use of AI in clinical practice is becoming more and more common, and the benefits of related technologies in disease diagnosis and minor surgery such as surgery are still very pronounced. A doctor at Peking University Third Hospital told Global. times. For example, AI can make an unambiguous diagnosis based on a series of test results, such as patient films, with very surprising success rates.
But AI technology still has room for improvement, and current technology cannot fully replace trained professionals, he said. Physicians also need to supervise and coordinate the entire AI technology application process, as current AI technology can only be implemented according to prescribed procedures, and one mistake can have serious consequences.
