Know your pest
You don't want Lace (bug) in your place
I see olive trees used as features or ornamental foliage in towns around restaurants; some homeowners like them as they are hardy, have a grey-green foliage, a variation on other foliage colours.
By this time of the year many have yellowed leaves among the grey-green – an olive lace bug (OLB) symptom.