As RadarOnline.com readers know, Bieber, 24, and much-older Kardashian dated from 2016 into the following year.
"Things between Justin and Kourtney were more serious than most people realized," the source insisted. "Their physical compatibility was off the charts, and they even started to bond about religion. Justin was hugely attracted to Kourtney, and she was really smitten by him. They had a lot of fun together."
The pair split, and Bieber went on to date Selena Gomez, 26, and then current fiancée Baldwin, 21.
But Baldwin isn't so secure with her quickie engagement, the source claimed.
"Hailey is very protective of her relationship and she has every reason to feel threatened," the source continued. "She's saying that Kourtney better stay away from Justin, and she won't hesitate to ban him from speaking to her altogether."
As RadarOnline.com previously reported, Baldwin is also insecure about Bieber's longtime romance with ex Gomez.
"Hailey's dealing with daily onslaughts from trolls online, plus his own mom and others in Justin's circle who think Selena's his soul mate, not her," an insider told RadarOnline.com.
We pay for juicy info! Do you have a story for RadarOnline.com? Email us at email@example.com, or call us at (866) ON-RADAR (667-2327) any time, day or night.
Get the exclusive celebrity scoop on all the stars you love before any of your friends by subscribing to our new podcast Straight Shuter below!