Objective: To explore the rehabilitation effect of pulmonary rehabilitation training in elderly patients with chronic obstructive pulmonary disease (COPD). Methods: Elderly COPD patients hospitalized from June 2024 to December 2024 were selected as subjects for a quasi-experimental study. The study randomly assigned patients into two equal groups of 50 each. One group served as the control and received standard treatment and nursing care, while the other group, the intervention group, was given additional pulmonary rehabilitation exercises alongside the conventional care. The lung function indexes [forced expiratory volume in the first second (FEV1), forced vital capacity (FVC), FEV1/FVC], 6-minute walk distance (6MWD), Borg’s Category Scale for perceived exertion (BCSS), COPD Assessment Test (CAT), Barthel Index for activities of daily living, blood oxygen saturation, and Modified Medical Research Council (MMRC) dyspnea scale were compared between the two groups before and after intervention. Results: Following the intervention, the intervention group demonstrated improved lung function compared to the control group (P < 0.05). However, no significant difference was observed in the 6-minute walk distance (6MWD) (P > 0.05). The intervention group had lower Bronchitis Severity Scale (BCSS) scores (P < 0.05) and better quality of life scores (P < 0.05) than the control group. No notable differences were found in activities of daily living scores or blood oxygen saturation (P > 0.05). Additionally, the intervention group exhibited a lower proportion of residual severe dyspnea (P < 0.05). Conclusion: Pulmonary rehabilitation can enhance respiratory function in individuals with COPD, leading to beneficial therapeutic outcomes and ultimately improving their overall quality of life.