Whisenhunt, 50, was 45-51 in six seasons with the Cardinals after being hired in 2007. He led the Cardinals to the Super Bowl after the 2008 season, losing to the Steelers.
"I have great respect for the San Diego Chargers," Whisenhunt told the team's official website. "Every time I've played them, they've been good football teams and we had battles whether I was in the AFC or the NFC. (I'm impressed) with the way they do business, so I have a tremendous amount of respect for them
"Playing here at this stadium, it's always been a tough place to play. The fans from what I've seen, they've always been great. That's something where any time you get home-field advantage like that, it's a big positive."
Whisenhunt struggled to find a starting quarterback after Kurt Warner's retirement after the 2009 season. In 2012, Arizona started three different quarterbacks and struggled after Kevin Kolb injured his ribs in Week 6. Both rookie Ryan Lindley and second-year QB John Skelton struggled in Kolb's absence.
The Cardinals, who started the season 4-0, went on to lose their next nine games, including the most one-sided loss in franchise history, a 58-0 drubbing at Seattle.
Whisenhunt had a second interview with the Cleveland Browns on Thursday, league sources confirmed to ESPN NFL Insider Adam Schefter.
Information from ESPN NFL Insider Adam Schefter and The Associated Press was used in this report.