I feel like it should be possible

Thats pretty arbitrary. I don’t think you need to be slowing down for kids around a school in the middle of the night. The thing about schools is they aren’t like parks or something, kids aren’t hanging around schools for fun. Before school opens and after after-school closes you are almost certain to NOT see a kid at a school.