Ben Abandoned After Rehab: 'Everyone's Frustrated & Ready To Walk On Him'

It's only been four days since Ben Affleck announced the end to his latest stint in rehab, but now RadarOnline.com has learned exclusively friends and business associates are turning their backs on him — because he fell off the wagon while IN treatment.

“Ben was caught breaking the rules in rehab and relapsed about two weeks ago,” tattled a source. “Everyone is frustrated and ready to walk on him.”

Even longtime bestie Matt Damon has severed ties with his pal!

“Matt’s wife, Luciana, is done with Ben,” dished the source. “She’s washing her hands of him and wants Matt to cut him off for good."

As RadarOnline.com readers know, Damon fled to Vegas for his birthday bash the same day his longtime pal Affleck successfully completed his latest rehab milestone. Sources told RadarOnline.com Damon disinvited Affleck to the wild party.

Meanwhile, insiders claimed additional colleagues of the two-time Oscar winner are also having second thoughts about working with the actor!

As RadarOnline.com reported, the 46-year-old Batman star started his fourth in-patient stint in two years on Aug. 22 — when estranged wife Jennifer Garner staged an intervention after he went on a boozy five-night bender.

Jen demanded Ben enter the Canyon Treatment Center in Malibu if he wanted to see their kids, Violet, 12, Seraphina, 9, and Samuel, 6.

To make matters worse, the troubled actor can't even count on Playboy model girlfriend Shauna Sexton for a shoulder to lean on during these troubling times, as a source close to the actor confirmed with RadarOnline.com the duo are done. (However, Sexton told RadarOnline.com split reports are "not accurate.")