Driving control system for an autonomous vehicle using multiple observed point information