Top Research Papers on LLM Models
Unlock the latest findings and innovations in LLM Models with this curated selection of top research papers. Perfect for researchers and enthusiasts, our list covers essential studies to keep you informed and inspired in this dynamic field.
Looking for research-backed answers?Try AI Search
LLM-Pruner: On the Structural Pruning of Large Language Models
150 Citations 2023Xinyin Ma, Gongfan Fang, Xinchao Wang
neural information processing systems
Large language models (LLMs) have shown remarkable capabilities in language understanding and generation. However, such impressive capability typically comes with a substantial model size, which presents significant challenges in both the deployment, inference, and training stages. With LLM being a general-purpose task solver, we explore its compression in a task-agnostic manner, which aims to preserve the multi-task solving and language generation ability of the original LLM. One challenge to achieving this is the enormous size of the training corpus of LLM, which makes both data transfer and...
3D-LLM: Injecting the 3D World into Large Language Models
117 Citations 2023Yining Hong, Haoyu Zhen, Peihao Chen + 4 more
neural information processing systems
Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense caption...
LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysis
106 Citations 2023Shih-Chieh Dai, Aiping Xiong, Lun‐Wei Ku
journal unavailable
Thematic analysis (TA) has been widely used for analyzing qualitative data in many disciplines and fields.To ensure reliable analysis, the same piece of data is typically assigned to at least two human coders.Moreover, to produce meaningful and useful analysis, human coders develop and deepen their data interpretation and coding over multiple iterations, making TA labor-intensive and time-consuming.Recently the emerging field of large language models (LLMs) research has shown that LLMs have the potential replicate human-like behavior in various tasks: in particular, LLMs outperform crowd worke...
A systematic review of large language model (LLM) evaluations in clinical medicine
338 Citations 2025Sina Shool, Sara Adimi, Reza Saboori Amleshi + 3 more
BMC Medical Informatics and Decision Making
A systematic review of the evaluation parameters and methodologies applied to LLMs in clinical medicine highlights certain limitations and biases across the included studies, emphasizing the need for careful interpretation and robust evaluation frameworks.
The TRIPOD-LLM reporting guideline for studies using large language models
562 Citations 2025Jack Gallifant, Majid Afshar, Saleem Ameen + 22 more
Nature Medicine
Transparent reporting of a multivariable model for individual prognosis or diagnosis–large language model TRIPOD-LLM is a checklist of items considered essential for good reporting of studies that are developing or evaluating an LLM for use in healthcare settings, a ‘living guideline’ that emphasizes transparency, human oversight and task-specific performance reporting.
Understanding Large-Language Model (LLM)-powered Human-Robot Interaction
154 Citations 2024Callie Y. Kim, Christine P. Lee, Bilge Mutlu
ACM/IEEE International Conference on Human-Robot Interaction (HRI)
The findings show that LLM-powered robots elevate expectations for sophisticated non-verbal cues and excel in connection-building and deliberation, but fall short in logical communication and may induce anxiety.
LLM-Rec: Personalized Recommendation via Prompting Large Language Models
142 Citations 2024Hanjia Lyu, Song Jiang, Hanqing Zeng + 7 more
Findings of the Association for Computational Linguistics: NAACL
Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item.However, directly employing the original item descriptions may not yield optimal recommendation performance due to the lack of comprehensive information to align with user preferences.Recent advances in large language models (LLMs) have showcased their remarkable ability to harness commonsense knowledge and reasoning.In this study, we introduce a novel approach, coined LLM-REC, which incorporates four distinct prompting strategies of text ...
Large language models (LLM) and ChatGPT: what will the impact on nuclear medicine be?
207 Citations 2023Ian Alberts, Lorenzo Mercolli, Thomas Pyka + 4 more
European Journal of Nuclear Medicine and Molecular Imaging
Recent experience has shown that AI tools can be harnessed to mass-produce questionable content on social media networks or social media bots that can deliberately amplify misinformation, which might portend the future of ChatGPT-generated academic content.
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
104 Citations 2024Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko + 5 more
Annual Meeting of the Association for Computational Linguistics (ACL)
Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, S. Khatamifard, Minsik Cho, Carlo C Del Mundo, Mohammad Rastegari, Mehrdad Farajtabar. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly
1059 Citations 2024Yifan Yao, Jinhao Duan, Kaidi Xu + 3 more
High-Confidence Computing
This work investigates how LLMs positively impact security and privacy, potential risks and threats associated with their use, and inherent vulnerabilities within LLMs, and identifies areas that require further research efforts.
LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
136 Citations 2023Dongfu Jiang, Xiang Ren, Bill Yuchen Lin
Annual Meeting of the Association for Computational Linguistics (ACL)
We present LLM-BL E N D E R, an ensembling framework designed to attain consistently superior performance by leveraging the diverse strengths of multiple open-source large language models (LLMs).Our framework consists of two modules: PAIRRANKER and GEN-FUSER, addressing the observation that optimal LLMs for different examples can significantly vary.PAIRRANKER employs a specialized pairwise comparison method to distinguish subtle differences between candidate outputs.It jointly encodes the input text and a pair of candidates, using cross-attention encoders to determine the superior one.Our resu...
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
127 Citations 2024Zechun Liu, Barlas Oğuz, Changsheng Zhao + 6 more
journal unavailable
Zechun Liu, Barlas Oguz, Changsheng Zhao, Ernie Chang, Pierre Stock, Yashar Mehdad, Yangyang Shi, Raghuraman Krishnamoorthi, Vikas Chandra. Findings of the Association for Computational Linguistics: ACL 2024. 2024.
EPlus-LLM: A large language model-based computing platform for automated building energy modeling
192 Citations 2024Gang Jiang, Zhihao Ma, Liang Zhang + 1 more
Applied Energy
Establishing building energy models (BEMs) for building design and analysis poses significant challenges due to demanding modeling efforts, expertise to use simulation software, and building science knowledge in practice. These make building modeling labor-intensive, hindering its widespread adoptions in building development. Therefore, to overcome these challenges in building modeling with enhanced automation in modeling practice, this paper proposes Eplus-LLM (EnergyPlus-Large Language Model) as the auto-building modeling platform, building on a fine-tuned large language model (LLM) to direc...
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
420 Citations 2023Chan Hee Song, Brian M. Sadler, Jiaman Wu + 3 more
IEEE/CVF International Conference on Computer Vision (ICCV)
This work proposes a novel method, LLM-Planner, that harnesses the power of large language models to do few-shot planning for embodied agents and proposes a simple but effective way to enhance LLMs with physical grounding to generate and update plans that are grounded in the current environment.
Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities
244 Citations 2024Hao Zhou, Chengming Hu, Ye Yuan + 11 more
IEEE Communications Surveys & Tutorials
This work presents LLM fundamentals, including model architecture, pre-training, fine-tuning, inference and utilization, model evaluation, and telecom deployment, and introduces LLM-enabled key techniques and telecom applications in terms of generation, classification, optimization, and prediction problems.
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models
238 Citations 2023Zhiqiang Hu, Lei Wang, Yihuai Lan + 6 more
Conference on Empirical Methods in Natural Language Processing (EMNLP)
The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e.g., ChatDoctor) or instruction data (e.g., Alpaca).Among the various fine-tuning methods, adapter-based parameter-efficient fine-tuning (PEFT) is undoubtedly one of the most attractive topics, as it only requires fine-tuning a few external parameters instead of the entire LLMs while achieving comparable or even better performance.To enable further research on PEFT methods...
LLM-TIKG: Threat intelligence knowledge graph construction utilizing large language model
133 Citations 2024Yuelin Hu, Futai Zou, Jiajia Han + 2 more
Computers & Security
Open-source threat intelligence is often unstructured and cannot be directly applied to the next detection and defense. By constructing a knowledge graph through open-source threat intelligence, we can better apply this information to intrusion detection. However, the current methods for constructing knowledge graphs face limitations due to the domain-specific attributes of entities and the analysis of lengthy texts, and they require large amounts of labeled data. Furthermore, there is a lack of authoritative open-source annotated threat intelligence datasets, which require significant manual ...
FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning
137 Citations 2024Weirui Kuang, Bingchen Qian, Zitao Li + 7 more
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
Large language models (LLMs) have demonstrated great capabilities in various natural language understanding and generation tasks.These pre-trained LLMs can be further improved for specific downstream tasks by fine-tuning.However, the adoption of LLM in real-world applications can be hindered by privacy concerns and the resource-intensive nature of model training and fine-tuning.When multiple entities have similar interested tasks but cannot directly share their local data due to privacy regulations, federated learning (FL) is a mainstream solution to leverage the data of different entities.Bes...
Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproduction
197 Citations 2023Sungmin Kang, Juyeon Yoon, Shin Yoo
IEEE/ACM International Conference on Software Engineering (ICSE)
The results show Libro has the potential to significantly enhance developer efficiency by automatically generating tests from bug reports, a framework that uses Large Language Models (LLMs), which have been shown to be capable of performing code-related tasks.
SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models
185 Citations 2024Shyam Sundar Kannan, Vishnunandan L. N. Venkatesh, Byung‐Cheol Min
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert high-level task instructions provided as input into a multi-robot task plan by executing a series of stages.
