Prematch, this clash had been billed as one of the most competitive ties, pitting the World Cup-winning USWNT against Olympic silver medalists Sweden, the team that also eliminated the U.S. in 2016.
Fifth-ranked Sweden put the pressure on almost immediately with three shots in the first eight minutes, before Stina Blackstenius headed it into the lead on 25 minutes from a Sofia Jakobsson cross.
Alyssa Naeher, in goal for the USWNT, had to make five saves in the first half to stop Sweden from increasing its advantage. Midfielder Rose Lavelle nearly equalized with a header in the 45th minute off a corner kick from Christen Press but hit the post.
However, the four-time Olympic gold medalists fell further behind in the 54th minute, when Blackstenius scored her second of the game, scoring from a rebound off a corner kick.
Press struck a post for the USWNT in the 72nd minute as it tried to rally, but Lisa Hurtig added a third goal for Sweden moments later, with a header into the roof of the net, to secure victory.
The Rio defeat in 2016 marked the USWNT's earliest exit in Olympic history, after it previously reached the final of every edition of the Games since 1996, when the women's event was introduced.
The two sides drew 1-1 in an April friendly, the only blemish to the United States' 2021 record of 11 wins in 12 matches and a prescient warning of the challenges the team would face in their Tokyo kickoff.
The defeat was the United States' first under Andonovski, who took over from Jill Ellis in 2019.
Information from Reuters was used in this report.