This latest defeat is Aldershot's fifth consecutive on the road, conceding 18 goals in that time.
Indeed, as a result, the Shots now have the worst defensive record in the Conference bar none!
But while Brown knows they are only a string of results away from a considerable rise up the table, there is also the knowledge that if this dire run continues, a relegation dogfight could be on the cards.
“It's not a very nice place to be in the dressing room at the moment,” he admitted.
“We know we're under performing as a team and we've got to start turning it round not just for a play-off spot, but we've got to start looking over our shoulder. We're not putting wins together and we're not keeping any clean sheets.
“You're talking about possible play-off places by catching up 12 or so points but we have to look at the other end. Football has a nasty habit of kicking arrogant people in the teeth and I certainly will make sure nobody in my dressing room is arrogant enough to think they won't go down.”
While the conditions at York did not help — indeed many were surprised that the match went ahead as large sections of the pitch were clearly waterlogged — it was two catastrophic errors from substitute Gary Elphick that cost the Shots at least a share of the spoils.
Level at 1-1 at half-time, two goals in three second half minutes as a result of shocking defending from the Brighton & Hove Albion loanee, gave York an unassailable lead.
“The young boy doesn't mean to make mistakes but two catastrophic errors mean we're chasing the game 3-1 away from home — and with the ref from hell,” the boss continued.
“Those appalling individual errors eventually cost us the game but the rest of the game I saw a very hard-working team trying to get something out an impossible position that those errors put us in.
“I didn't think we were helped by the official and it's my first rant of the season, I feel absolutely gutted and cheated, I told him I feel disgusted by his performance.”
Indeed, but whilst some of the blame for Sunday does lie with a poor defence, an injured Nikki Bull in goal does not help, while up front, the Shots still lack that cutting edge.
“We're not kidding ourselves we're on the back of another slump. There were signs today that going forward we can hurt teams but the league table doesn't lie and we are where we deserve to be at the moment.”
“It's about time we did manage to keep a clean sheet, and defensively I've got to get more out of my players. I've seen the same defensive lapses I have all year, but in a bigger way than normal,” added Brown.
The boss was once again forced to shuffle his backline, bringing Matt Somner back to his usual right back spot and switching Lewis Hamilton over to the left in the absence of the suspended Darren Barnard.
After just three minutes York were handed an opportunity when Greg Heald conceded a free kick on the edge of the area but Andy Bishop aimed straight at Bull.
The Shots though recovered soon after when Leroy Griffiths delivered for strike partner Jonny Dixon, who hooked the ball over his shoulder but his effort was also directed at the keeper, Chris Porter.
The Shots were looking more positive, Nick Crittenden particularly lively on the wing, but his final ball lacked quality — perhaps missing the target of Tim Sills — Griffths, this time, firing weakly towards goal.
Despite the conditions which were making pretty football something of an impossibility, both sides were making a good fist of it, and on 17 minutes the Shots showed just how it was done with a move which led to the opening goal.
Crittenden jinked his way through the midfield saw him lay off to Steve Watson. With Ryan Williams waiting on the wing, the skipper put the ball out wide and Williams crept in towards goal, unleashing a shot that was guided in with a deft header from Dixon.
York's response was instant with Clayton Donaldson an obvious threat — first blasting over before firing an overhead scissor kick straight at Bull.
Then, when Watson uncharacteristically missed his clearance, Donaldson streamed forward. His ball found Andy Bishop only for Hamilton to clear amid shouts for a penalty that were waved away by referee Mr Hayward.
Another long ball forward from Convery was again met by Donaldson who tied centre halves Heald and Brough up in knots trying to clear but the striker turned and shot wide.
It wasn't long, however before the pressure finally told.
Latching onto another long ball, Donaldson, on the left hand edge of the area, beat Brough to cross to Convery, who unleashed a shot from the edge of the box past Bull.
This goal spurred the home side on and they were soon on the attack again. The troublesome Donaldson got the better of the defence once again to go one-on-one with Bull, but thankfully the keeper smartly plucked the ball from the striker's feet to deny what would have been a certain goal.
Half-time saw the boss look to tighten things up at the back, replacing an apparently injured Brough with Elphick, who got the nod over Tobi Jinadu despite his height and ability to deal with aerial balls.
Whilst the substitution may have been enforced, the change in formation caused havoc as Brown put three at the back, bringing Matt Somner in from the right and putting Elphick in his spot.
Indeed, it proved disastrous as two goals in the first five minutes won the game for the hosts.
Firstly Convery's ball into the area looked destined for Bull, but Elphick intercepted, almost turning it into his own net and then feeding an on-rushing Neil Bishop who slotted home with ease.
Then another long ball forward was set to be cleared by Somner, but instead Elphick came in colliding with his defensive partner, leaving the ball free for Donaldson, who ran through and fired from the edge of the box. Bull got a desperate hand to it but he couldn't keep it out.
The Shots were looking truly beaten until nine minutes from time when they were given renewed hope.
Dixon won a free kick on the edge of the area and Williams stepped up to brilliantly curl the ball over the wall and into the top corner.
Suddenly there was renewed vigour in the side as the Shots piled forward, winning another free kick in the same spot, this time, however, Williams opted for the other corner and it went over and there was to be no happy ending for the Shots.
After this latest defeat, Brown is once again being forced to turn to loans as he hopes to bring in a more experienced centre-back to help shore things up.
He explained: “How far does the board go, spending good money after good money, if we were in real danger of relegation they would.
“It isn't a case of the board not giving me money or the club not having the finances, I just have to get more out of the squad. It would get better if Tarkan [Mustafa] and Tobi [Jinadu] would go on loan, but until they do, and they don't figure in my plans at all, I can't get anyone in.”
But in a season that has already seen 11 loans, including the current front pairing, it is rapidly becoming clear that temporary deals are not the answer.
Quite what is the answer only Brown knows, but whether he will find it before relegation does become a real issue, only time will tell.
With thanks to the Aldershot News.