The three women, who know Kennedy through Children’s Health Defense, an anti-vaccine group he chairs, have been sharing their alleged experiences in text messages with others in the wake of the scandal involving Kennedy and New York magazine correspondent Olivia Nuzzi.

The source said Trump’s top advisers and donors see Kennedy as a problem for the campaign, particularly given the news of his alleged infidelity comes on the heels of unfounded rumors that the former president himself was having an affair with Laura Loomer, a conspiracy theorist who traveled with his campaign for several days last month. Loomer vehemently denied any affair with Trump and mocked those who suggested it.

Kennedy has long been dogged by allegations of infidelity. In diaries obtained by the New York Post after the 2012 death by suicide of his first wife, Mary Richardson, Kennedy reportedly kept a “ledger” tallying the dozens of women he slept with while married.

Some people close to Mary have criticized Kennedy for how he treated his late wife. Last year, in a scathing post to social media, Billy Baldwin said Mary “cried on my shoulder about Bobby numerous times” before her death. “If Bobby were half a man she would still be alive today,” Baldwin wrote. “It will all come out. His campaign will be over in weeks. If these walls could talk.”

In the diaries, Kennedy reportedly described himself as a victim of the women he said pursued him for sex, encounters he described as “muggings.” He allegedly wrote that his greatest flaw was “my lust demons,” and that he had to “avoid the company of women. You have not the strength to resist their charms.”