The goal is Atsu's first in the English Premier League after failing to score for loan clubs Everton and Bournemouth.
Newcastle won 2-1 at the end.
They will be further charged up with Rafael Benitez now returning from illness.
Xherdan Shaqiri equalised 57 minutes into the second half as he received the ball from Joe Allen and drove at the defence, curling home a goal from outside the box.
"We had a lot of chances and it was a great intensity from the boys from the start", Lascelles told Sky Sports.
"Stoke come into this game off the back of what probably felt like a win against Man United", said Ince to the Express. We still have to do this and that a little bit better.
The Potters had a last minute chance to steal the draw in added time when Bruno Martins Indi's cross was met by Diouf who managed to send his effort wide.
"We have to keep working hard and we know what we have in the team and the squad".
"We're doing okay after a tough period of fixtures".
Stoke boss Mark Hughes was disappointed not to come away with anything as his side lost for the first time since the opening day of the campaign, but urged his players to learn the lessons of their reverse on Tyneside.
"That was the disappointment because at that point, we had got back into the game and I thought we were growing into our performance and we may well have got something out of the game. We have a game in the League Cup in midweek and Chelsea at our place, so they keep coming thick and fast".