The American actor was known for playing pizza restaurant owner Peter 'Beansie' Gaeta in the hit HBO mob drama, as well as appearing as Whispers DiTullio in Martin Scorsese's 2019 crime drama The Irishman.
Sopranos star Michael Imperioli - who played Christopher Moltisanti - posted on Instagram: "Our friend and colleague Paul Herman has passed away.
Read more: Veteran actor Ron Leibman dies aged 82
"Paulie was just a great dude. A first class storyteller and raconteur and one hell of an actor. Goodfellas, Once Upon a Time in America , The Irishman and of course The Sopranos are some highlights.
"Paulie lived around the corner from me the last few years and I am glad we got to spend some time together before he left us. I’ll miss him. Lots of love to his family, friends and our community of actors and filmmakers."
Herman died on Tuesday 29 March, which was his 76th birthday.
He was known to fans of Entourage as Vincent Chase's accountant, Marvin.
He also appeared in Scorsese's Goodfellas and Casino, as well as playing Randy in David O. Russell's Silver Linings Playbook.
Last year saw the release of Sopranos prequel The Many Saints of Newark starring 22-year-old Michael Gandolfini as a young Tony Soprano.
The critically acclaimed HBO drama ran for six seasons between 1999 and 2007 starring Michael's late father James Gandolfini as mafia boss Tony Soprano.
The show, created by David Chase, created the psychological implications of being a criminal and mobster as well as a father and husband.
James Gandolfini died of a heart attack in 2013 aged 51.
Watch: The Sopranos finale remembered