This beautiful tree is the Chinese dogwood, Cornus sinensis, flowering at the end of June. Fruits ripen in October, and apparently taste quite like an apricot.
In his forest garden, Martin Crawford also has Cornus capitata – with fruit that ripen in November and taste like banana.
A slightly more familiar species is the Cornelian Cherry, Cornus mas. When properly ripe, its fruits taste like plums. According to Martin, its flowers can be used as a flavouring, and the seeds have in the past been roasted for a coffee substitute.
All of these trees are fully hardy, can tolerate some shade (although it will affect the amount of fruit) and have fruits that are edible raw or cooked.