The teams were locked at 1-1 after 90 minutes.
Sweden beat Switzerland 1-0 to progress to the quarter-finals.
Jordan Henderson’s penalty was saved, only for Mateus Uribe’s effort to rattle the crossbar and Pickford to then deny Carlos Bacca.
Colombia’s Johan Mojica was seen trying to kick up the turf on the penalty spot to try to make it bobble before Kane could step up for the kick.
Maradona had made little secret of his allegiances at this World Cup following Argentina’s exit last weekend as he posted an image of him in a Colombia short before Tuesday’s game to support his fellow South Americans.
England manager Gareth Southgate defended his players’ behavior.
On Colombia’s side only Juan Cuadrado came close to Trippier, creating four chances.
Beer sprayed high into the blue Tyneside sky as Kane scored England’s spot-kick.
Despite their late equaliser and encouraging display in extra-time, Colombia’s stand out attribute was their aggression and what many England fans perceived as their “dirty tactics” throughout.
Geiger awarded a penalty to England after Carlos Sanchez was adjudged to have brought down Harry Kane, although Colombia levelled through Yerry Mina’s stoppage-time header.
Anything is possible: England’s players celebrate after their shootout win.
England’s lack of creativity further back is a problem too. A team of young players with smiles on their faces and a spring in their step and the belief that it does not always have to be the way it has always been. He added that it didn’t mean England had not done well.
The Colombia match also ended the so-called “curse of ITV”.
Despite Colombia’s achievement of reaching the knockout stages of a World Cup for a second consecutive tournament for the first time, Pekerman still wasn’t finished with his angry summary of England’s supposed antics. Colombia was cited for 23 of the 36 fouls called and six of the eight yellow cards handed out.
They were denied an equaliser just before half-time when Lampard’s effort clearly crossed the line – prompting Federation Internationale de Football Association to finally see the light on goal-line technology – but in truth Germany tore England apart and were worthy 4-1 winners.
“But we didn’t let this affect us”.
Dan Underhill, 38, from Gillingham, Kent, said “it’s got to be” when asked if this was England’s best opportunity in decades. “We showed resilience to come back from huge disappointment and kept calm”.
“The best player was Mina”, said lawyer Adriana Palma, 33.
He is already thinking of their next match.
“I’ve had a couple of decades thinking it through. But we did”, Dier said. A total of 44,190 spectators attended the match at the Spartak Stadium.