Without a win to cheer in his last four games, Brown admits he's been feeling the pressure, but urged the need for calm and unity.
He said: “I feel a certain amount of pressure as we've lost three on the bounce — that can't get any worse as not many managers would survive those sort of results.
“We've gone from being a fantastic Ryman team to a top Conference side, so this is a disappointing season and we have got to pick up. I would say to fans to gauge someone over the period of three and half years.
“We as a club are aware that we need to make changes to the playing staff, and that we need to build on the foundations of our success. There is not a manager in the world that doesn't go through a tricky season,” said Brown.
Indeed, the boss is somewhat a victim of his own success, having won promotion from the Ryman League, then guiding his Shots to two play-off places, including the final, in the his first two years in the Conference. As a result, fans have come to expect nothing less.
“We have raised the expectancy level as we have been so successful over the last few years, and our supporters, quite rightly, have come to expect to move forward from there, no-one wants to move backwards.
“We don't want to be where we are in the League, and we have got to start picking up points, we need to start getting those wins, starting on Saturday. Our fans are realistic enough to know we've been playing catch up all season,” added Brown.
Whilst the Shots are struggling on the road, they do boast an impressive home record — losing just three Conference games all season.
Indeed, despite the criticism levelled at the boss, Aldershot haven't lost at the Rec in the league since SEPTEMBER when Hereford United beat them 1-0.
The boss continued: “We've got three tricky fixtures [Burton, Hereford and Morecambe] coming up, but when we're at home we like to get at teams and attack them.
“I saw a lot of good movement from Leroy Griffiths and Jonny Dixon on Sunday so that is encouraging and we scored two goals away from home, we just need to tighten up defensively.”
Along with the Shots' outstanding home record is the fact that Burton have never taken so much as a point off the Shots, after 3-1 and 4-1 victories home and away respectively in the 2003/4 season, and 3-0, 3-1 home and away last season.
The Shots have set up their first possible double of the season this weekend as they put one over the Brewers at the Pirelli Stadium back in October, winning 2-1, with goals from Tim Sills and Nick Crittenden cancelling out Andy Todd's opener.
However, Nigel Clough's side are currently riding high in the top ten and even entertaining hopes of a late push for the play-offs. They have suffered just one defeat in their last four games (3-1 at Morecambe), and on Saturday beat high-flying Exeter City, completing the double over Alex Inglethorpe's side.
“Burton are doing well at the moment and were well worth their victory over Exeter, it'll be a tough test for us.
“They're a good footballing side and I think it will be a very entertaining game of football on Saturday,” added Brown.
Darren Barnard is still out suspended for the Shots but the boss is hoping to have John Brough fit to resume his spot at centre back after his substitution at York City on Sunday saw two horrendous errors from his replacement Gary Elphick.
Despite that, Brown has given his backing to the on-loan defence-man, saying: “Gary is as disappointed as anyone that it didn't work out on Sunday but he's a very talented player and he'll bounce back.”
Steve Watson should have overcome his shoulder injury that forced him into substitution on Sunday, while Nikki Bull will continue to play despite a thigh strain.
Brown was also hoping to have sent Tobi Jinadu out on loan by the end of the week.
Burton, meanwhile, are hoping to have Andy Ducros (hip) and Darren Stride (knee) fit for selection, while Ryan Austin and Jon Shaw, currently away on England National Game duty, are also set to feature.
With thanks to the Aldershot News.