The core of curriculum-based ideological and political education is “comprehensive education by all, throughout the whole process, and in all-round ways.” It integrates ideological and political education into the teaching of various courses, constructs a collaborative education model, and implements the fundamental task of cultivating morality and nurturing people. As a compulsory course in primary, middle, and universities in China, physical education contains rich ideological and political elements, laying a good foundation for curriculum-based ideological and political education. This article analyzes the necessity of the integrated ideological and political education in physical education courses in primary, middle, and universities in the new era, analyzes the dilemmas in the integrated development of the ideological and political teaching content system of physical education courses in primary and middle schools, and proposes strategies such as clarifying the integrated curriculum goals of physical education in primary, middle, and universities, improving the integrated ideological and political content system of the curriculum, establishing an integrated education platform for physical education courses in primary, middle, and universities, and constructing an integrated evaluation system. The aim is to accelerate the integrated construction of the ideological and political teaching content system of physical education courses in primary, middle, and universities and improve the teaching and education quality of physical education courses.