Williams will have to sit at least four games.
The Browns signed cornerback Herb Miller off their practice squad to take Williams' place on the roster.
Williams was expected to start opposite Pro Bowl corner Denzel Ward. Rookie Martin Emerson Jr., a third-round pick out of Mississippi State, will likely get the start in Williams' place. Emerson returned an interception for a touchdown in Cleveland's preseason opener at Jacksonville.
Williams has battled injuries since the Browns drafted him in the second round in 2019. He missed the entire 2020 season with a shoulder injury. Williams came back to start eight games last year.
Cleveland opens the season Sunday against the Carolina Panthers.