It's Unraveling! Ben Affleck's Friends QUESTION His Nanny-Gate Denial — 'What Else Is He Hiding?'

Ben Affleck's friends are starting to doubt his poker face. The actor denies his affair with Christine Ouzounian but RadarOnline.com has learned that some of those closest to the actor are beginning to question the truth about what really happened with the nanny his wife Jennifer Garner, 43, hired to take care of their kids.

"He swore to his best friends nothing physical went on between them, that she was a shoulder to cry on because nobody else was around," an insider tells Radar.

But with all the damaging reports coming out, his friends now wonder if 42-year-old Affleck's been telling the truth about other things going on in his life, even beyond the alleged affair.

"They are starting to feel like they've been duped and are asking themselves what else he could be hiding," reveals the insider. "They're just very confused because there's no need for him to be dishonest and hide anything if the rumors are true."

After all, insists the insider, "They weren't going to judge him for it."