The home side looked dangerous from the start with Sam Saunders blasting over from 15 yards in the second minute after a clever knock down by Ben Strevens.
Strevens had an even better opportunity a minute later when he pounced on a fluffed clearance from Ricky Newman but delayed his shot too long, allowing keeper Nikki Bull to smother at his feet.
Town looked shell-shocked, but hit the home side with a sucker punch in the seventh minute, when midfielder Danny Hylton fired a powerful 30-yard strike into the top left-hand corner of the Daggers net.
Jake Robinson should have doubled Town's lead in the 36th minute but pulled his strike wide from just inside the box after a clever pull back from Hylton.
Daggers hit back in the 39th minute when midfielder Matt Ritchie thundered a shot off the post with striker Paul Benson reacting fastest to nod past Bull from close range to level the scores.
Robinson should have put his side ahead in the 48th minute when he broke the Daggers offside trap, only for Roberts to save bravely at his feet.
Dagenham got lucky again in the 62nd minute when Scott Davies handballed inside the box, with Saunders stepping up to smash home the spot-kick.
Daggers made it three in the 66th minute when Glen Southam brought a good save out of Bull, only for Matt Ritchie to slot the ball into the net from a tight angle.
Robinson had a chance to pull one back in the 87th minute when he raced past the Daggers backline yet again, but Roberts raced out to block at his feet.