Swisher is hitting .298 with 14 homers and 48 RBIs for the Yankees. Young is batting .306 with 12 homers and 53 RBIs.
Young, just before the results were announced, thanked all of those who voted for him.
"I'd like to thank the team for their strong efforts," Young said. "They've been great, the Cowboys have been great. My focus is on the second half and helping this team get where we want to go. That's what I'm going to do."
Young said he plans on spending the three days at home with his family and in the pool with his kids.
"I'll take a break and get ready," Young said. "I'm thankful to have been included in that final five and to the fans that voted."