The fake bus stop could be on a private road or driveway that the actual buses never travel on.

Hell, the fake bus stop could probably be on a gravel path that doesn't actually connect with public roads, as long as the ends of the path are hidden behind trees.