The fallout behind Jesse Jackson’s remarks about Barack Obama continues this weekend, with veteran filmmaker Spike Lee saying that “jealousy” may have fueled the now infamous “I want to cut his nuts off” comment.

“I’m very disappointed in Jesse Jackson. These old heads, I don’t know why they’re doing this stuff,” Lee told EUR Web.

The comment, which was caught by Fox News during a break surfaced earlier this week. Jackson says he did not know his microphone was still on.

“I think jealousy has to be somewhere in there. I read today that even Jesse Jackson’s son, Jesse Jr., is upset about his father’s comments. There’s no place for that and I think it’s really making Jesse look bad. I haven’t heard anybody say cut the man’s nuts off but Jesse,” Lee added.

Lee’s most telling comment came later, saying what many have been thinking—and saying—for years: that Jackson’s time in the spotlight is coming to a close.

“In life, sometimes you have your moment,” he says. “You have your window that lies upon you and then it leaves. This is not Jesse’s time right now. This is Barack Obama’s time, and I think he’s having a problem with that.”

Jackson offered an immediate apology for his “crude and hurtful” remarks and Obama accepted.