Manningham traveled with the team to New Orleans and was considered a game-time decision, but the team opted to keep him inactive against the Saints.
The Giants were without four key starters as Manningham joined running back Ahmad Bradshaw (foot), linebacker Michael Boley (hamstring) and left tackle Will Beatty (eye) on the inactive list for the game.
Manningham did not practice all week due to the injury. He said he would play on Monday night and there was some hope when he made the trip with the team. The Giants started Hakeem Nicks and Victor Cruz at wide receiver.
Boley did not make the trip and sat out his second straight game with a hamstring injury, and rookie Mark Herzlich made his second consecutive start in his place.
Ivory was a healthy scratch. Coach Sean Payton had said he might only play three of his top four running backs against the Giants. Ivory, who has played in only two games since returning from the physically unable to perform list in midseason, was the odd man out.
Vilma had been struggling with his left knee and practiced off and on the past week. He missed his third straight game.
Ohm Youngmisuk covers the Giants for ESPNNewYork.com. Information from The Associated Press was used in this report.