โก Quick Summary
A recent study explored the adoption of Large Language Model (LLM) AI tools among hospital administrators in China, revealing that only 22.6% reported high familiarity with these tools. The findings highlight both the barriers and enablers influencing their use in daily administrative tasks.
๐ Key Details
- ๐ Locations: Three tertiary hospitals in Beijing, Shenzhen, and Chengdu
- ๐ฅ Participants: 31 middle-level hospital administrators
- ๐๏ธ Data Collection: June 11 to August 16, 2024, through semi-structured interviews
- ๐ Analysis Method: Colaizzi’s thematic analysis
๐ Key Takeaways
- ๐ Low Familiarity: Only 22.6% of participants reported high familiarity with LLM AI tools.
- ๐ ๏ธ Usage Patterns: 25.8% were frequent users, while 45.2% were rare users.
- ๐ Site Variability: Adoption rates varied significantly across the three sites.
- ๐ก Positive Experiences: Early positive experiences and prior tech expertise facilitated adoption.
- ๐ซ Barriers: Mistrust in tool accuracy and insufficient training hindered broader use.
- ๐ Primary Use: Tools were mainly used for document drafting.
- ๐ Need for Training: Structured tutorials and institutional support are essential for enhancing usage.
- ๐ฎ Future Research: Calls for quantitative studies to validate adoption rates and influencing factors.
๐ Background
The integration of artificial intelligence in healthcare administration holds great promise for improving efficiency and communication. However, the adoption of these technologies, particularly among hospital administrators, remains a complex issue. Understanding the factors that influence their use is crucial for maximizing the benefits of LLM AI tools in healthcare settings.
๐๏ธ Study
This study employed a multi-center, cross-sectional qualitative design to investigate the adoption of LLM AI tools among hospital administrators in China. By conducting face-to-face interviews with 31 middle-level administrators across three diverse hospitals, the researchers aimed to uncover the enablers and barriers to the effective use of these tools in daily administrative tasks.
๐ Results
The results indicated that only 22.6% of participants were highly familiar with LLM AI tools, with 25.8% using them frequently. Notably, Site 3 had the highest proportion of users with significant familiarity. The qualitative analysis revealed that while positive early experiences and prior technological expertise were beneficial, barriers such as mistrust in tool accuracy and limited training were prevalent.
๐ Impact and Implications
The findings of this study underscore the need for targeted training programs and institutional support to enhance the adoption of LLM AI tools in healthcare administration. By addressing the barriers identified, hospitals can improve the efficiency of administrative tasks and ultimately enhance patient care. The potential for broader applications of these technologies in healthcare is significant, paving the way for a more innovative future.
๐ฎ Conclusion
This study highlights the critical role of familiarity and positive experiences in the adoption of LLM AI tools among hospital administrators. While the current usage is primarily limited to basic tasks, there is a clear opportunity for growth through structured training and support. As the healthcare sector continues to evolve, embracing these technologies will be essential for improving administrative efficiency and patient outcomes.
๐ฌ Your comments
What are your thoughts on the adoption of AI tools in healthcare administration? We would love to hear your insights! ๐ฌ Share your comments below or connect with us on social media:
Adoption of LLM AI tools in everyday tasks: A multi-site cross-sectional qualitative study of Chinese hospital administrators.
Abstract
BACKGROUND: Large Language Model (LLM) artificial intelligence (AI) tools have the potential to streamline healthcare administration by enhancing efficiency in document drafting, resource allocation, and communication tasks. Despite this potential, the adoption of such tools among hospital administrators remains understudied, particularly at the individual level.
OBJECTIVE: To explore factors influencing the adoption and utilization of LLM AI tools among hospital administrators in China, focusing on enablers, barriers, and practical applications in daily administrative tasks.
METHODS: A multi-center, cross-sectional, descriptive qualitative design was employed. Three tertiary hospitals located in Beijing (Site 1), Shenzhen (Site 2), and Chengdu (Site 3) were selected to represent diverse geographic regions and institutional profiles. Middle-level administrators were recruited using purposive sampling. Data were collected from June 11 to August 16, 2024 through face-to-face semi-structured interviews guided by a collaboratively developed and piloted interview guide. Each interview was audio-recorded and transcribed verbatim. Colaizzi’s method was employed for thematic analysis. Data saturation was determined on a per-site basis by continuously reviewing transcripts during biweekly meetings until no new themes emerged from additional interviews.
RESULTS: A total of 31 participants (Site 1: 9; Site 2: 10; Site 3: 12) completed interviews lasting an average of 27.3 min (range: 21-39 min). Only 22.6% of participants reported high familiarity with LLM AI tools, and 25.8% were frequent users while 45.2% were rare users. Adoption varied by site. Site 3 had the highest proportion of high-familiarity participants who consistently used the tools more frequently. Qualitative analysis revealed that positive early experiences and prior technological expertise facilitated adoption, whereas mistrust in tool accuracy, limited prompting skills, and insufficient training were significant barriers. Participants predominantly used the tools for document drafting and strongly advocated for structured tutorials and institutional support to enhance broader utilization.
CONCLUSIONS: Familiarity with technology, positive early experiences, and openness to innovation may facilitate adoption, while barriers such as limited knowledge, mistrust in tool accuracy, and insufficient prompting skills can hinder broader use. LLM AI tools are now primarily used for basic tasks such as document drafting, with limited application to more advanced functionalities due to a lack of training and confidence. Structured tutorials and institutional support are needed to enhance usability and integration. Targeted training programs, combined with organizational strategies to build trust and improve accessibility, could enhance adoption rates and broaden tool usage. Future quantitative investigations should validate the adoption rate and influencing factors.
Author: [‘Chen J’, ‘Liu Y’, ‘Liu P’, ‘Zhao Y’, ‘Zuo Y’, ‘Duan H’]
Journal: J Med Internet Res
Citation: Chen J, et al. Adoption of LLM AI tools in everyday tasks: A multi-site cross-sectional qualitative study of Chinese hospital administrators. Adoption of LLM AI tools in everyday tasks: A multi-site cross-sectional qualitative study of Chinese hospital administrators. 2025; (unknown volume):(unknown pages). doi: 10.2196/70789