The Rangers relied on the arm of Holland to keep them tight with the Orioles, who had kept the Rangers in check until Beltre delivered a solo shot leading off the top of the fourth to give the Rangers a 1-0 lead.
Holland escaped two-out jams in the second and fifth innings to keep the Orioles off the board.
Kinsler gave the Rangers a little breathing room with his fourth homer of the season, a two-out, two-run blast off Jim Johnson, who had come on in relief of Jeremy Guthrie to start the seventh inning.
Guthrie (1-1) went six solid innings, allowing just one run on four hits and a walk, but Holland was better. The Rangers lefty allowed five hits and struck out six to improved to 2-0.
Neftali Feliz picked up his third save. He came on with two out in the eighth when Darren O'Day walked back-to-back batters after retiring the first two he faced. Feliz got Luke Scott to fly out to deep center to end the threat, then finished things off in the ninth to preserve the win.
*The Rangers haven't started 8-1 wince 1989. They won the first three series of the year for the first time since 1993.
*Beltre's third home run gave him eight RBIs for the year.
*Darren Oliver pitched a perfect seventh in relief of Holland.
*Ex-Ranger Vladimir Guerrero went 2-for-4 with a double for the O's.