AI | VALIANT /valiant Vanderbilt Advanced Lab for Immersive AI Translation (VALIANT) Tue, 28 Jul 2026 20:58:05 +0000 en-US hourly 1 Retaining Emotions, Removing Identity: Valence-Arousal Guided De-Identification for Educational Applications /valiant/2026/07/28/retaining-emotions-removing-identity-valence-arousal-guided-de-identification-for-educational-applications/ Tue, 28 Jul 2026 20:58:05 +0000 /valiant/?p=7240

Ashwin, T. S.; Sanda, Nihar; Coursey, Austin; Gupta, Vaibhav; Biswas, Gautam. (2026)..Proceedings of the ACM Symposium on Applied Computing, 87–94.

Artificial intelligence (AI) systems are increasingly being used to analyze students’ facial expressions to better understand engagement and emotions in classroom settings. However, using images of children raises important privacy and ethical concerns, making it essential to protect students’ identities without losing the emotional information needed for analysis. This study presents a new facede-identificationmethod that replaces a person’s face with a realistic synthetic face while preserving the original facial expressions. The approach usesStyleGAN, an AI model for generating realistic images, to select synthetic faces that match the emotional characteristics of the original face while removing identifying features. The method was evaluated using a real-world dataset of 40 middle school students and the publicly availableDAiSEEdataset. Compared with conventional anonymization techniques, it achieved nearly 90% accuracy in protecting identity while maintaining high fidelity of facial expressions, with more than 92% agreement in manual evaluations and minimal loss of facial movement information. These findings suggest that the approach can better balance privacy protection with emotion recognition, supporting the development of privacy-preserving AI tools for classroom analytics and educational research.

]]>
An evaluation of ambient artificial intelligence scribes at two academic medical centers /valiant/2026/07/28/an-evaluation-of-ambient-artificial-intelligence-scribes-at-two-academic-medical-centers/ Tue, 28 Jul 2026 18:30:53 +0000 /valiant/?p=7170

Franklin, Jacob; Chu, Ling; McDonald, Samuel A.; Turer, Robert W.; Webb, Janet; Steitz, Bryan D.; Yi, Haoyang; Chen, Qingxia; McCoy, Allison B.; Nall, Carolynn; Chen, Catherine; Rousseau, Justin F.; Lehmann, Christoph U.; Willett, Duwayne L.; Kumah-Crystal, Yaa A.; Mize, Dara E. (2026)..Discover Artificial Intelligence, 6(1), 550.

Ambient AI scribesare designed to reduce the time clinicians spend documenting patient visits by automatically generating clinical notes during appointments. To better understand how these tools perform in real-world practice, this study evaluatedDragon Copilotacross two academic medical centers. A total of 120 physicians and advanced practice providers completed surveys assessing the system’s usability, documentation quality, and overall satisfaction. Overall, clinicians rated Dragon Copilot as highly usable and reported that it fit well into their clinical workflows. Many participants said the tool reduced the time spent on documentation, improved their ability to focus on patients during visits, and enhanced the overall patient encounter. However, the AI scribe did not eliminate broader challenges such as burnout, frustration with electronic health records, work-life balance, or cognitive workload. Overall satisfaction with the tool was positive but mixed, indicating that experiences varied among users. As one of the first multi-site evaluations of an ambient AI scribe, the findings suggest that Dragon Copilot can improve documentation workflows and support clinician well-being, while also highlighting that it is not a complete solution to the broader challenges clinicians face in everyday practice.

]]>
HAT-SAM3: endoscopy-aware adaptation of a foundation segmentation model for generalizable polyp segmentation /valiant/2026/07/28/hat-sam3-endoscopy-aware-adaptation-of-a-foundation-segmentation-model-for-generalizable-polyp-segmentation/ Tue, 28 Jul 2026 15:56:26 +0000 /valiant/?p=7153 Li, Hao; Masood, Anum. (2026)..The Visual Computer, 42(9), 371.

This study addresses the challenge ofautomatic polyp segmentation, the process of identifying and outlining polyps in colonoscopy images. While many artificial intelligence (AI) models perform well on the data they were trained on, they often struggle when tested on images from different hospitals or datasets because polyps can vary widely in size, shape, color, and appearance. Differences in image quality, such as glare from reflected light, blur, fluid, and changes in lighting during colonoscopy, add to this challenge. To improve performance across different datasets, the researchers developedHAT-SAM3, an adaptation of theSegment Anything Model 3 (SAM 3), a large pre-trained AI model originally designed for image segmentation. HAT-SAM3 uses a training technique calledhighlight-aware training (HAT), which helps the model better handle bright reflections commonly seen in endoscopy images without changing how the model operates during testing. When evaluated on five publicly available datasets, HAT-SAM3 achieved an averageDice score(a measure of how closely the model’s predicted outlines match the true polyp boundaries) of 0.884 and produced the best reported results on four of the five datasets. In additional testing, where the model was trained on one dataset and evaluated on three completely separate datasets without further training, HAT-SAM3 consistently outperformed the strongest previously reported method. These results suggest that adapting a pre-trained foundation model with endoscopy-specific training techniques can improve the accuracy and reliability of automated polyp segmentation across a wide range of clinical datasets. The researchers have also made their code publicly available to support future research.

 

Fig 1: Motivation of HAT-SAM3. A task-specific polyp segmenter can perform well when training and test images come from the same visual distribution, but degrade under cross-domain changes in illumination, blur, specular reflection, and polyp appearance. HAT-SAM3 uses a broad segmentation prior with endoscopy-aware adaptation to improve cross-domain polyp segmentation

]]>
Factors influencing the effectiveness of artificial intelligence-assisted decision-making in medicine: a scoping review /valiant/2026/05/26/factors-influencing-the-effectiveness-of-artificial-intelligence-assisted-decision-making-in-medicine-a-scoping-review/ Tue, 26 May 2026 21:23:41 +0000 /valiant/?p=6794 Jackson, Nicholas J.; Brown, Katherine E.; Miller, Rachael.; Murrow, Matthew.; Cauley, Michael R.; Collins, Benjamin X.; Novak, Laurie L.; Benda, Natalie C.; Ancker, Jessica S. (2026)..Journal of the American Medical Informatics Association, 33(5), 1054–1064.

Research on artificial intelligence tools that help clinicians make decisions has had mixed results: sometimes these tools improve decision-making, and sometimes they do not, and it is not always clear why. This review looked at what factors affect how well AI-based clinical decision-support systems, or AI-CDS, work in medicine. The authors searched three medical databases and found 45 relevant studies out of 5,850 screened articles. They focused on how both clinician factors and technology design features influenced three things: how clinicians feel about AI, whether they accept AI recommendations, and how well they perform when using AI. The review found that experienced clinicians may gain less from AI support than less experienced clinicians, although the results were not consistent across studies. It also found that explainable AI, meaning AI that gives reasons for its suggestions, can increase trust, but it may also lead clinicians to trust incorrect recommendations too much, which can hurt performance when humans and AI work together. Clinicians’ existing attitudes toward AI also influenced whether they accepted its advice. Overall, the review suggests that future research should focus on “appropriate trust,” meaning clinicians should rely on AI only when the advice is actually trustworthy, rather than simply trying to increase trust in AI overall.

Figure 1.

PRISMA diagram for study inclusion.

]]>
Policy Search, Retrieval, and Composition via Task Similarity in Collaborative Agentic Systems /valiant/2026/04/29/policy-search-retrieval-and-composition-via-task-similarity-in-collaborative-agentic-systems/ Wed, 29 Apr 2026 03:52:07 +0000 /valiant/?p=6564 Nath, Saptarshi; Peridis, Christos; Benjamin, Eseoghene; Liu, Xinran; Kolouri, Soheil; Kinnell, Peter; Li, Zexin; Liu, Cong; Dora, Shirin; Soltoggio, Andrea (2026)..Proceedings of the AAAI Conference on Artificial Intelligence, 40(29), 24504–24512.

Agentic AIrefers to systems that can set their own goals, adapt to new situations, and improve over time through experience. This study explores how such systems can learn more efficiently by sharing knowledge with one another, instead of learning everything from scratch. In particular, it looks at how an AI agent can decidewhat knowledge to reuse, which other agents to learn from, and how to incorporate that knowledgeinto its own decision-making process (often called apolicy, or strategy for choosing actions).

The researchers introduce a new method calledMOSAIC (Modular Sharing and Composition in Collective Learning). This approach allows agents to compare tasks using mathematical representations, select useful knowledge from others based on performance and similarity, and integrate it using flexible, modular neural network components. In simple terms, agents can “borrow” and adapt pieces of what others have already learned.

The results show that agents using MOSAIC learn faster and perform better than those learning alone or sharing information indiscriminately. In some cases, they can even solve problems that individual agents cannot. The study also finds that targeted, selective sharing reduces confusion between tasks and leads to a kind ofself-organization, where agents working on easier problems help others tackle more complex ones. Overall, this work highlights the potential of collaborative learning strategies to make AI systems more efficient and adaptable.

]]>
ComCat: Expertise-Guided Context Generation to Enhance Code Comprehension /valiant/2026/03/26/comcat-expertise-guided-context-generation-to-enhance-code-comprehension/ Thu, 26 Mar 2026 19:50:56 +0000 /valiant/?p=6346

Skyler Grandel; Scott Thomas Andersen; Yu Huang; Kevin Leach (2026)..ACM Transactions on Software Engineering and Methodology, 35(3), Article 82.

Software maintenance makes up a large share of the total cost of software over its lifetime, and a big part of that cost comes from understanding existing code. One way to make code easier to understand is through documentation, especially comments that summarize what the code does or explain why it does it. In this work, we introduce ComCat, a system that uses large language models (LLMs, which are AI models trained on very large amounts of text) together with expert guidance to automatically generate useful comments for source code. ComCat is designed to choose the most relevant and informative comment for a specific piece of code. For C/C++ files, the system works in three steps: it first finds places where comments would be most helpful, then decides what kind of comment is needed, and finally writes the comment. In a study with human participants, ComCat’s comments improved code understanding on three software engineering tasks by up to 13% for most participants. The generated comments were also judged to be at least as accurate and readable as human-written comments, and they were preferred over standard ChatGPT-generated comments for up to 92% of code snippets. We also released a dataset containing code snippets, human-written comments, and human-labeled comment categories. Overall, ComCat shows that LLMs can be used to meaningfully improve how well people understand code.

Fig. 1.

ComCatpipeline and study procedure. We use three instances of HSR to informComCat’s design (1) and evaluate developer performance (2) and preference (3) with our tool.ComCattakes C/C++ code as input, using a Code Parser to identify code Snippets to be commented. These Snippets are classified, and the class of each Snippet is used in combination with our Template Catalog to create a prompt for each Snippet. These prompt ChatGPT, which outputs the commented code. This pipeline is informed by developer expertise, but it is fully automated and requires no human intervention.

]]>
A Vision-Based Deep Learning Framework for Monitoring and Recognition of Chemical Laboratory Operations /valiant/2026/03/26/a-vision-based-deep-learning-framework-for-monitoring-and-recognition-of-chemical-laboratory-operations/ Thu, 26 Mar 2026 19:09:53 +0000 /valiant/?p=6328 Chuntao Guo; Jing Lin; Shunxing Bao; Xin Liu; Yaru Wang; Yunlin Chen (2026)..Sensors, 26(4), 1106.

This study explores a way to automatically monitor how laboratory tasks are performed, focusing on pipetting—a common technique where small amounts of liquid are transferred using a pipette. Ensuring that such procedures are done correctly is important for safety and for producing reliable results, but it is difficult to track in real time because it involves complex hand movements, tool use, and multiple steps that vary between users. To address this, the researchers developed a vision-based artificial intelligence system that uses video recordings instead of physical sensors. The system first applies a YOLO-based model (a type of object detection algorithm) to identify human body positions and interactions with the pipette. It then uses a bidirectional long short-term memory (LSTM) network, a type of deep learning model designed to analyze sequences over time, to understand how the actions unfold step by step.

The results show that this approach can successfully distinguish between correct (standard) and incorrect (non-standard) pipetting behaviors, including different types of errors, and performs better than methods that analyze images one frame at a time without considering motion over time. Overall, the study demonstrates that AI systems using video analysis can provide a practical, non-contact way to monitor laboratory techniques, potentially improving quality control and extending to other manual procedures in scientific labs.

Figure 1.Representative incorrect pipetting behaviors and key challenges for vision-based QA in chemical laboratory environments.

]]>
Monitoring morphometric drift in lifelong learning segmentation of the spinal cord /valiant/2026/03/26/monitoring-morphometric-drift-in-lifelong-learning-segmentation-of-the-spinal-cord/ Thu, 26 Mar 2026 19:08:20 +0000 /valiant/?p=6319 Enamundram Naga Karthik; Sandrine Bédard; Jan Valošek; Christoph S. Aigner; Elise Bannier; Josef Bednařík; Virginie Callot; Anna Combes; Armin Curt; Gergely David; Falk Eippert; Lynn Farner; Michael G. Fehlings; Patrick Freund; Tobias Granberg; Cristina Granziera; Ulrike Horn; Tomáš Horák; Suzanne Humphreys; Markus Hupp; Anne Kerbrat; Nawal Kinany; Shannon Kolind; Petr Kudlička; Anna Lebret; Lisa Eunyoung Lee; Caterina Mainero; Allan R. Martin; Megan McGrath; Govind Nair; Kristin P. O’Grady; Jiwon Oh; Russell Ouellette; Nikolai Pfender; Dario Pfyffer; Pierre-François Pradat; Alexandre Prat; Emanuele Pravatà; Daniel S. Reich; Ilaria Ricchi; Naama Rotem-Kohavi; Simon Schading-Sassenhausen; Maryam Seif; Andrew Smith; Seth A. Smith; Grace Sweeney; Roger Tam; Anthony Traboulsee; Constantina Andrada Treaba; Charidimos Tsagkas; Zachary Vavasour; Dimitri Van De Ville; Kenneth Arnold Weber II; Sarath Chandar; Julien Cohen-Adad (2026)..Imaging Neuroscience, 4, Article a.1105.

This study looks at how measurements of the spinal cord—such as itscross-sectional area(the size of the cord when viewed in a slice)—can be used as important indicators (biomarkers) for diagnosing and tracking neurological diseases like multiple sclerosis or spinal cord compression. Modern artificial intelligence methods can automatically identify and outline (segment) the spinal cord in MRI scans, but it is unclear whether these measurements stay consistent as models are updated with new data over time. This consistency is especially important when building “normal” reference values from healthy individuals.

To address this, the researchers developed a spinal cord segmentation model trained on a large and diverse dataset collected from 75 sites and over 1,600 participants, covering different MRI types and various spinal cord conditions. They also created a “lifelong learning” system that continuously monitors changes in measurements (calledmorphometric drift) whenever the model is updated. This system automatically runs through a workflow (via GitHub Actions, an automated coding tool) to track how measurements evolve over time.

The results showed that the new model performs very well, accurately identifying the spinal cord even in challenging cases such as severe compression or tissue damage, with a high Dice score (a measure of how closely the model’s segmentation matches the true anatomy) of 0.95. The monitoring system also proved useful for quickly detecting any changes in measurements between model versions. Importantly, the study found that updates to the model caused only minimal shifts in spinal cord measurements, meaning the results remain stable and reliable. This allowed the researchers to safely update an existing database of normal spinal cord measurements. Overall, this work provides a reliable and transparent way to maintain consistency in AI-based medical measurements as models evolve.

Fig 1

Overview of the dataset and image characteristics. Representative axial slices of nine contrasts and the total of images used for each contrast in brackets, the orientation (axial/sagittal) along with the median resolution of images. The respective doughnut chart illustrates the proportion of clinical status among the scanned participants, including healthy controls (HC), patients with radiologically isolated syndrome (RIS), patients with multiple sclerosis (MS), and their different phenotypes, including primary progressive (PPMS) and relapsing-remitting (RRMS), patients with amyotrophic lateral sclerosis (ALS), patients with neuromyelitis optica spectrum disorder (NMOSD), pre-decompression acute traumatic SCI (AcuteSCI), post-decompression traumatic spinal cord injury (SCI), degenerative cervical myelopathy (DCM), and syringomyelia (SYR; not shown). Labels indicate the phenotype associated with the patient, with their respective colors shared across contrast sets.

]]>
Cost-effectiveness analysis of artificial intelligence-assisted risk stratification of indeterminate pulmonary nodules /valiant/2026/03/26/cost-effectiveness-analysis-of-artificial-intelligence-assisted-risk-stratification-of-indeterminate-pulmonary-nodules/ Thu, 26 Mar 2026 18:40:52 +0000 /valiant/?p=6302 Caroline M. Godfrey; Ashley A. Leech; Kevin C. McGann; Jinyi Zhu; Hannah N. Marmor; Sophia Pena; Lyndsey C. Pickup; Fabien Maldonado; Evan C. Osmundson; Stacie B. Dusetzina; Eric L. Grogan; Stephen A. Deppen (2026)..PLOS ONE, 21(3), e0343492.

Researchers evaluated whether artificial intelligence (AI) could help doctors better judge the cancer risk of indeterminate pulmonary nodules, which are small lung spots seen on a CT scan whose cause is not yet clear. These nodules are becoming more common as lung cancer screening and CT imaging are used more often. The team built a decision model to compare two approaches: clinician evaluation alone versus clinician evaluation supported by AI-based radiomics, a method that analyzes patterns in imaging data. They asked whether the AI approach would improve health outcomes and whether it would be worth the extra cost from a payer’s perspective over a patient’s lifetime. In their base case—a 60-year-old patient with a 1.1 cm nodule and a fairly high chance of cancer (65%)—AI support led to a small gain of 0.03 life-years and was cost-effective, with an incremental cost-effectiveness ratio of $4,485 per life-year gained. However, when the chance that the nodule was cancer was very low, below 5%, the AI approach no longer met a typical cost-effectiveness threshold of $100,000 per life-year gained. Overall, the study suggests that AI-assisted nodule assessment is cost-effective in settings where the likelihood of cancer is greater than 5%.

Fig 1.Decision Model Structure.

The decision tree structure models the risk-stratification of an indeterminate pulmonary nodule utilizing artificial intelligence-assistance compared to the clinician alone. Repeated portions of the model have been collapsed into subtrees (A-G) for readability, each of which represents a diagnostic or management pathway that appears in various parts of the model (‘A’ = surveillance; ‘B’ = PET-CT evaluation; C = minimally invasive surgical (MIS) lobectomy; ‘D’ = low-risk surveillance; ‘E’ = intermediate-risk; ‘F’ = MIS wedge resection; ‘G’ = initial risk classification).

]]>
Img2ST-Net: efficient high-resolution spatial omics prediction from whole-slide histology images via fully convolutional image-to-image learning /valiant/2026/01/28/img2st-net-efficient-high-resolution-spatial-omics-prediction-from-whole-slide-histology-images-via-fully-convolutional-image-to-image-learning/ Wed, 28 Jan 2026 17:15:13 +0000 /valiant/?p=5707 Zhu, Junchao; Deng, Ruining; Guo, Junlin; Yao, Tianyuan; Xiong, Juming; Qu, Chongyu; Yin, Mengmeng; Wang, Yu; Zhao, Shilin; Yang, Haichun; Xu, Daguang; Tang, Yucheng; & Huo, Yuankai. (2025)..Journal of Medical Imaging,12(6), 61410.

Recent progress in multimodal artificial intelligence has shown that spatial transcriptomics data, which measure where genes are active within tissue, can potentially be generated from standard histology images, reducing the cost and time required for specialized experiments. However, newer spatial transcriptomics platforms such as Visium HD operate at very high resolution, down to about 8 micrometers, which creates major computational challenges. At this scale, traditional methods that predict gene expression one spot at a time become slow, unstable, and poorly suited to the extreme sparsity of gene expression, where many genes have very low or zero signal. To address this, the authors developed Img2ST Net, a high-resolution framework that predicts spatial transcriptomics data from histology images using a fully convolutional neural network, meaning the model generates dense gene expression maps all at once rather than sequentially. The method represents high-resolution spatial transcriptomics as groups of small regions called super pixels and reframes the task as an image generation problem with hundreds or thousands of output channels, each corresponding to a gene. This approach improves efficiency and better preserves spatial structure in the tissue. To evaluate performance under sparse expression conditions, the authors also introduced SSIM ST, a structural similarity-based metric designed specifically for high-resolution spatial transcriptomics. Testing on public breast and colorectal cancer Visium HD datasets at 8 and 16 micrometer resolution showed that Img2ST Net outperformed existing methods in both prediction accuracy and spatial coherence, while reducing training time by up to 28 times compared with spot-based approaches. Additional analyses showed that contrastive learning further improved spatial fidelity. Overall, this work provides a scalable and biologically meaningful solution for predicting high-resolution spatial transcriptomics data and supports future large-scale and resolution-aware spatial omics modeling.

Fig.1

Modeling paradigm for ST prediction. (a)Conventional patch-to-spot regression manner for Visium ST data: each WSI contains hundreds of55μmspots for the ST slide. A separate gene expression vector is predicted for each spot from its corresponding image patch. (b)Our proposed image-to-image prediction framework for Visium HD data: each WSI contains millions of8μmbins for the HD slide. A region-wise modeling strategy where each image region covers multiple bins is used to predict a high-resolution gene expression map, which enables more fine-grained and computationally efficient inference.

]]>