This study compared accelerometer-assessed habitual physical activity (PA), sedentary time, and meeting PA recommendations among 102 youth with disabilities (7–20 years) in four subgroups—physical/visual impairments, intellectual disability, autism spectrum disorders, and hearing impairment—and 800 youth with typical development (8–16 years). Low proportions of youth with disabilities met PA recommendations, and they generally were less physically active and more sedentary than youth with typical development. The hearing impairment and autism spectrum disorder groups were the most and least physically active, respectively. Older age and to some extent female sex were related to less PA and more sedentary time. Considering the suboptimal levels of PA in youth with disabilities, effective interventions directed at factors associated with PA among them are needed.