The Shots were reduced to 10 men when Darren Barnard scythed down the lively Iyseden Christie as the Harriers forward went in on goal. The referee had no hesitation in brandishing a straight red.
For all their current woes, however, the Shots were worthy of all three points.
The home side took the lead after Andre Boucaud and Gary Holloway struck from the left, and with Harriers keeper John Danby unable to collect the ball, Coleman was on hand to score when unmarked at the far post.
It was the Harriers, however, who had an excellent double chance to open the scoring on eight minutes. Gareth Sheldon cut in from the left but his shot was parried by Nikki Bull to the path of Simon Heslop. With the goal at his mercy Heslop could only blast over the bar over the bar.
The Shots responded well and three minutes later, Lewis Hamilton and midfielder Holloway combined well to set up a chance for Tim Sills which failed to find the target.
With both sides attempting to dominate the midfield, chances were at a premium.
Heslop and Christie then exchanged passes on the left, and after beating two defenders, Christie found his effort blocked.
Aldershot were stirred into action then saw a Boucaud pile driver go close on the half-hour mark and then Coleman's header was wide of the mark.
Despite going one down, Harriers were unable to put any penetration to their moves and found chances few and far between.
Christie went close with a turn and shot out of nothing which Nikki Bull managed to palm on to the post.
Sheldon then had an excellent opportunity to draw level but he could only blast over when clear.
Deep into stoppage time Sills turned his marker and struck a shot from 25 yards that beat Danby but sadly for the Shots it hit the woodwork.