Afflalo threw at least one punch in the fight, which came four minutes after both players had been assessed technical fouls.
"I don't want to feel like a victim here, that's part of the game," Bjelica said. "But he took a swing at me, and I was just trying to protect myself, first of all, and to calm him down because he was wild.
"I don't know what's wrong with that guy, but at that point I have to protect myself and my family."
Afflalo was unavailable for comment after the game, a 108-102 win over the visiting Wolves.
The Associated Press contributed to this report.