Brown had been out for the first three games after having hip and sports hernia surgery in the preseason. There had been hope he might be able to return around the middle of the season, but the Saints apparently determined that wasn't likely to happen.
Jermon Bushrod has been starting in Brown's place at left tackle. The Saints also signed offensive lineman Nick Leckey to take Brown's roster spot. Leckey was with the Saints for the first two games of the regular season and was released Saturday.
Pat Yasinskas covers the NFC South for ESPN.com.