Not all that early really.
It was around the time I lived briefly in Bookham, with my parents, when I was 3 (1975). I remember pushing a toy tank along a path in the garden.
I'm not sure though if it's just a memory that has been reinforced by people asking me "what's your earliest childhood memory?" if that makes sense. Although that's still a valid memory, right?