Time to bench Brady against the Broncos?

To me, the most interesting game on this week’s slate is the Sunday night option with Tom Brady taking on Von Miller. Other players are involved, of course, but the New England Patriots are coming off their bye week for a road tilt in the thin air of Colorado. Meanwhile, the Denver Broncos are a mess on both sides of the football, with Brock Osweiler at quarterback and a defense coming off a 51-point shredding in Philadelphia. Does that mean Brady will have a great game and, if so, should fantasy managers shy away from the Denver defense not only this week but moving forward?