Demonstrators holding up placards chanted “Tories out” at the packed meeting on Brexit, bringing the event into chaos.
Conservative supporters returned fire, shouting “Labour scum” as Mr Rees-Mogg was mobbed by the protesters, who confronted him directly about his views on abortion.
The MP for North East Somerset, speaking from a lectern, appealed for calm.
He said: ”Ladies and gentlemen, let us have a proper and thoughtful debate.”
One of the protestors, Karla, who did not want to give her surname, challenged the Tory MP about reports he profited from an abortion drug despite being opposed to terminations in all circumstances.
The 31-year-old, from the outskirts of Manchester, said: “I think it is very hypocritical that you profit from a drug that allows for abortions.”
Mr Rees-Mogg replied: “That story is not true.”
He said: “We may disagree on things, but just because you disagree with somebody, that doesn’t make them a bad person. The two are separate.”
After the protestor accused him of “ruining people’s lives” and being a “despicable person”, Mr Rees-Mogg added: “You’re welcome to talk to me but it’s difficult if your intention is merely to shout and wave leaflets.”
The prominent backbencher has seen his popularity soar over recent months after he was touted as a potential leader of the party.
However, he hit controversy last month when he admitted that he is opposed to abortion, including in cases of rape and incest.