Kanye West’s recent anti-Semitic comments have already had a devastating impact on his career, but the consequences may hurt his family life as well.

The controversial Chicago rap mogul, who is currently entangled in a bitter legal battle with his ex-wife Kim Kardashian, claimed on Tuesday (November 1) that his former lawyer warned him his inflammatory remarks could cost him custody of their four children.

“On my last and final meeting with Bob Cohen, he told me ‘if I keep up antisemitic rhetoric you’ll loose [sic] custody of your children,'” Ye wrote on Parler, the conservative social media platform he purchased last month, per AllHipHop.

“So let me get this straight If I complain about Jewish business practices it’s considered antisemitic. So, my custody lawyer was basically telling me if you complain about getting done wrong in business you will loose [sic] custody of your children, and this was the guy on my side.”

Cohen, a high-profile divorce lawyer (who is Jewish), dropped Kanye West as a client last month after the rapper vowed to go “death con 3 on JEWISH PEOPLE” in a since-deleted tweet. Cohen was the sixth lawyer to cut ties with Ye in his protracted divorce from Kardashian.

Kanye still has Beverly Hills attorney Nick Salick representing him, though. According to TMZ, Salick is currently trying to hash out both a custody and property settlement agreement with Kardashian’s lawyer, Laura Wasser. If a deal is reached, a trial scheduled for December will be averted.

Kanye West’s Online Attacks Prompt Kim Kardashian To Beef Up Security For Their Children

Kanye West’s Online Attacks Prompt Kim Kardashian To Beef Up Security For Their Children

Kanye previously addressed his custody battle with Kim Kardashian on the Alo Mind Full podcast in September, where he revealed his ex-wife currently looks after their four kids “80 percent” of the time. TMZ reported Ye hasn’t exercised any custodial rights in months.

The 45-year-old is still a regular presence at North, 9, and Saint’s, 6, sporting events, though. Earlier this week, the controversy surrounding Kanye seemingly spilled over on the sidelines at Saint’s soccer game, where the rapper was filmed arguing with another parent before storming off.