Much of the problem stems from the comings and goings of the managerial merry-go-round, with deals for players at the likes of Brentford, Northampton and Wycombe being placed on hold as their respective managers left their posts recently.
Brown said: "We've had very close links with Martin Allen, Colin Calderwood and John Gorman this year, and with them leaving it means that the deals we have in place for their players can't be completed until the new managers come in.
"There's a player at each of those clubs we want to sign but we'll have to wait and see what happens now. I feel a bit frustrated that we haven't got more new players in to be honest.
"If those managers were still there then I'm sure we would have three more new players here by now. We have got a lot to offer as a club — we're very ambitious and we have wonderful training facilities and a first class coach in Martin Kuhl.
"Once you have the players in, it makes it easier to sell the club to other targets. I would have hoped to have a couple more players in by now but every day I have my list of things to do and people to speak to, we are getting there."
With thanks to the Aldershot News.