It was a debut to remember for midfielder Alex Bradley, whose 93rd minute winner brought that winning feeling back to Town!
It had looked like substitute Nyal Bell would deny Town returning to winning ways, cancelling out Mark Beck's goal.
After a goalless first half, Beck scored his second of the season, converting Ryan Fallowfield's low cross, only for Josh Falkingham's clearance to be tucked away by Bell with 69 minutes on the clock.
With the contest approaching full time, Brendan Kiernan picked out Bradley on the edge of the box, who finished expertly into the bottom left corner to give his new side the win!
Simon Weaver made two changes from last weekend's trip to Dagenham as new signing Alex Bradley came into the starting line-up as well as Will Smith, replacing Joe Leesley and George Smith.
Jack Emmett tried his luck with two early shots, but couldn't work Ben Hinchcliffe, while Josh Falkingham's well struck effort was blocked as Town made a good start to the contest.
The first effort on target arrived in the 20th minute as James Belshaw denied Adam Thomas twice in as many minutes, before the sides took on some water in the sweltering heat mid way through the first half.
Town's best chance came through their new addition, who fired a low shot across the face of goal, before Thomas again threatened at the other end, shooting high into the side netting.
The visitors best chance of the opening half fell to Frank Mulhern, but the former Town striker couldn't place the ball either side of Belshaw.
Weaver's side finished the half the stronger as Emmett capitalised on a defensive slip to find Jack Muldoon, who released the overlapping Ryan Fallowfield, though Ben Hinchcliffe kept out the low strike.
With Warren Burrell picking up a knock late in the first half, George Smith was introduced at left back and almost created the opener early in the second half, crossing low for Mark Beck who could only guide his finish wide at the near post.
Beck didn't let missed chance get to him though, converting Fallowfield's low cross after Josh Falkingham's defence splitting pass had found the full back's run.
It could have been two moments later as Beck's sumptous touch fed Bradley in behind the Stockport defence, but the midfielder took a fraction too long to take his shot and Hinchcliffe saved.
County equalised in the 69th minute when Falkingham couldn't clear under pressure, inviting substitute Bell to dispatch the ball into the top corner and level things up.
With the contest looking like ending in a draw, Brendan Kiernan picked out Bradley on the edge of the box, who finished expertly into the bottom left corner to give his new side the win!
Harrogate Town: Belshaw, Fallowfield, Falkingham, Burrell (G Smith 45+), Emmett, Beck (Stead 80), Kiernan, Bradley, Muldoon, Hall, W Smith
Subs not used: Leesley, Cracknell, Brown
Goals: Beck 54, Bradley 93
Stockport County: Hinchcliffe, Minihan, Cowan, Turnbull, Palmer, Keane, Thomas (Bell 61), Mulhern (Kirby 81), Osborne, Dimaio (Walker 52), Jackson
Subs not used: Ormson, Arthur
Goals: Bell 69
Referee: M Woods
Attendance: 1,326 (520 away)