This study analyzed time-use interviews to report levels of active and inactive behavior during the after-school period (3–6 pm). Interviews were conducted on random days from three separate seasons during third and fourth grade. Youth with at least two interviews during third (356 completed 2 interviews; 506 completed 3 interviews [9 yrs; 50% boys]) and fourth (186 completed 2 interviews; 768 completed 3 interviews [10 yrs; 50% boys]) grade were included to report levels of moderate-to-vigorous physical activity (MVPA), light physical activity, inactive screen time, inactive nonscreen time, and travel by location and who the activity was undertaken with. Reporting time outside the home and with peers (single or group) was related to higher levels of MVPA. While inside the home, screen and nonscreen proportions were comparable (38% and 40%, respectively), despite unique patterns (screen: boys > girls; nonscreen: girls > boys). Reporting time with both parents was associated with more nonscreen time; whereas reporting time with peer groups was associated with lower screen time. Understanding active and inactive patterns of children’s behavior outside of school hours can be very important in contributing toward the development of innovative interventions for increasing physical activity.