To fail to notice, to miss seeing something.
In good writing, it is important not overlook any misspelled words.
An overlook can also mean a place that looks over another: the cliff overlooks the ocean.