The visitors were stung by a 25-yard sizzler from 18 year-old midfielder Dale Stephens in a four-goal thriller.
Kyle Nix, the 22 year-old Australian midfielder, came on as a second half substitute for Peter Thorne and fired home what looked to be the winner with 12 minutes to go.
Striker Barry Conlon had scored his third league goal after Dave Buchanan needlessly handled Omar Daley's right wing cross a minute before the break.
Andy Bishop levelled for the struggling hosts and youngster Stephens had the final say when he rounded off the clash late on with a second equaliser.
It is a major blow to Stuart McCall, who had his side ready to make a late burst for the League Two play-off places, while Shakers' caretaker boss Chris Brass battles to improve the Greater Manchester side in his role as caretaker manager.
While the visitors always looked more lively, they failed to have a meaningful shot on target until Conlon struck.
Bury were quite happy to play on the counter attack, with midfielder Richie Baker having a number of decent opportunities.
The hosts were cursing their luck when skipper Paul Scott saw his header cleared off the line by a flurry of legs just seven minutes before Conlon's opener.
Overall Brass will be the happier of the two managers as he looks to secure the post on a full time basis. He is currently being helped out by former Wigan boss and good friend, Chris Hutchings, as a favour.