Olives are the fruit of the olive tree ... texture and a more pungent flavor than black olives. Black olives, on the other hand, are left on the tree to ripen and mature before they’re harvested.