Rhule, an assistant at Temple before joining the Giants as assistant offensive line coach in March, was one of the final two candidates for the job. University of Miami defensive coordinator Mark D'Onofrio withdrew from consideration, according to The Associated Press.
Rhule played at Penn State and has 14 seasons of college coaching experience, with his last six at Temple. He was the Owls' co-offensive coordinator and tight ends coach in 2011.
Rhule will be the Owls' third coach in the past four seasons, following Steve Addazio's departure to Boston College. Temple went 4-7 this season after having three straight winning seasons under Addazio and Al Golden.
Information from ESPN's Joe Schad and The Associated Press was used in this report.