Paul Dummett scored an extra time winner to send Newcastle through to the fourth round of the Capital One Cup at the expense of Crystal Palace.

The Geordies were close to going through in normal time, as two goals from Emmanuel Riviere looked to have got the job done against a spirited Palace side. But a late equaliser from Sullay Kaikai forced the extra half-hour, allowing Dummett to pop up and head Newcastle through.

Alan Pardew named a strong line-up for the game, with six changes to the team that drew with Hull last weekend. Mehdi Abeid continued his Capital One Cup run in the team but was sent off for two bookable offences in the first half of extra time.

Riviere continued in the lone striker role and had a number of chances in the first half. Gabriel Obertan looked lively on the right of midfield and Sammy Ameobi created chances on the opposite flank. Newcastle’s best chances came from wide positions as crosses flew into the box on two occasions but Riviere was unable to make sufficient contact.

Daryl Janmaat also had a sight of goal when he had a shot from the edge of the box but his main involvement came in the opening goal. The Dutchman was caught out of position by Wilfried Zaha before swiping at the ball and catching the Englishman, who needed no second invitation to hit the ground. Dwight Gayle stepped up and confidently scored his second goal in as many games against Newcastle.

The visitors responded well though and were backed by an excellent away following. The travelling Toon Army were in good voice and no protests against the management could be heard from the away section at Selhurst Park.

And they were soon rewarded with an equaliser after Riviere’s earlier missed chances. The Frenchman collected a pass from Adam Armstrong and expertly turned away from Brede Hangeland before curling a superb left footed shot into Wayne Hennessey’s bottom corner.

Janmaat went off at half-time to be replaced by Massadio Haidara and Newcastle continued to take the game to Palace.

Again the wingers were causing problems and it was Ameobi who forced the breakthrough in the second period. The former England under-21 international made good ground in the box before being hacked down by Paddy McCarthy.

Riviere stepped up and sent his penalty high into Hennessey’s net to give Newcastle the lead.

Newcastle remained fairly comfortable and looked like hanging on to go through in normal time but Palace sub Kaikai – making his debut for the Eagles – latched onto a deflected cross to score at the far post with just two minutes of stoppage time remaining.

Abeid was then shown his second yellow card for a highly debatable foul on Zaha, leaving Newcastle with ten men for the remaining 20 minutes of extra time.

Normally, teams that are a man down sit back and accept the lottery of penalties but Pardew’s side kept attacking and got their reward with seven minutes remaining. Armstrong’s fine cross was perfect for Dummett, who headed past Hennessey with a diving effort.

When the two sides met in the league earlier this month, Zaha popped up with a last-minute equaliser and Palace almost done it again with two minutes remaining. Gayle found space at the far post but his free header was superbly repelled by Elliot’s sprawl.

Hangeland then had the ball in the net but the whistle had already gone for a foul and Dummett’s goal was enough to send the Magpies through to the next round of the league cup, where they will travel to Manchester City.