Lugo has started 22 games and at times looked as if he wasn't fully recovered from the injury. Fans at Fenway Park have booed when balls have slipped past him during some games.
"It's tough. Nobody wants to be booed. Not me, not anybody," he said. "Sometimes the only person who knows what's going on or why you miss a ball is you because you're the only one out there. You know what happened.
"It's not fair to anyone, not me or anybody. If you try to make a play like that and you get destroyed by you guys [media] the next day, it's not fair."
He also expressed frustration at not playing every day like he did in 2007, his first season with the Red Sox.
"Are you OK if somebody comes one day and another day you're not working?" he said. "Then that's how I feel. I love Boston. I love it. There's nowhere else you want to play. I'll tell you the truth, I think fans have been fair to me."
Red Sox manager Terry Francona knows Lugo has been upset about his playing time.
"The communication, I don't think is bad, but I don't think he always likes what I tell him," he said. "Somebody needs to sit on the bench every day and be available."
Lugo is hitting .256 with one homer and four RBIs, and has committed four errors. There will be a logjam at the position when Lowrie, who had surgery on his left wrist, returns.
Lowrie took over at shortstop last season when Lugo went down for the year with a strained left quadriceps in July.
Lowrie started taking batting practice Friday and Francona said things went well.