He practiced for the second straight day Thursday on a limited basis, wearing a club on his right hand.
"Hopefully by the time Sunday rolls around it will be as if I'm playing with two hands, except one's clubbed up," he said Thursday, adding that he and the Packers will be smart with his rep count.
Matthews had the pins removed Monday from his broken thumb, an injury he suffered against the Detroit Lions on Oct. 6.
The injury was diagnosed as a Bennett's fracture, which is a break at the base of the thumb. He underwent surgery the next day to have pins inserted in order to stabilize the break.
"I've been working hard, obviously it's difficult to work with one hand as far as your upper body, but lower body and conditioning and cardio, I've been working hard," he said.
Seneca Wallace will start at quarterback against the Eagles.
"Aaron's a heck of a football player, he's done amazing things for this team. He definitely gives us a better chance of winning, but we have all the trust and belief behind Seneca this week moving forward," Matthews said.
Sunday's game against the Eagles will give him the chance to play against his brother Casey Matthews, who plays linebacker for Philadelphia. He said he went 1-1 against his brother when the two faced each other in college when Clay played for USC and Casey for Oregon.
"It will be fun," Matthews said of playing against his brother. "I think it will make a great story to tell when we're older. I'm looking forward to it, and I hope he makes some plays."
ESPN.com Packers reporter Rob Demovsky contributed to this report.