"It wouldn't make sense," the Yankees captain told ESPNNewYork.com.
Knicks president Donnie Walsh wants as many New Yorkers as possible to help convince James to choose Madison Square Garden when NBA free agency opens July 1. James is a Yankees fan, and has a special pair of Yankee-styled Nikes.
"If there's Yankees that want to help us, we would involve them," Walsh told the New York Post on Sunday.
James' good friend Jay-Z echoed Jeter's sentiment on recruitment.
"That's his decision," the hip-hop mogul and part owner of the New Jersey Nets said in a Rolling Stone interview.
"We're friends -- we've still gotta hang out! I don't want to convince somebody to do something, then have to see him and say, 'Uh, yeah, we're 4-30 ... sorry.'"
CC Sabathia is also friends with James, but admitted he didn't know what he'd say to persuade James to pick New York.
"You don't have to sell winning in New York," Jeter said.
When it was pointed out to Jeter that since he has won in New York, James could find out about how special it is, Jeter still didn't budge.
Jeter hypothetically compared it to if he were going to be recruited by one of the Los Angeles teams and Magic Johnson called him.
"If I were going to another baseball team, how would a basketball player help?" Jeter said. "I don't play basketball. I have nothing to do with that."
Unaware of Walsh's comments at the time he spoke about James, Jeter said he doubted the Knicks would ask him.
"I don't see how it would work," he said. "It is completely different."
Jeter, who was a standout basketball player in high school, knows James a little.
"He's a nice guy," Jeter said. "He's a big Yankee fan so I've gotten to meet him. I probably think of him as a player like everyone thinks of him as a player -- he can do anything."