Officials confirmed the 125-pound title fight on Tuesday. UFC 177 is set to take place at Sleep Train Arena in Sacramento, California.
Yahoo! Sports earlier reported the bout.
Johnson (20-2-1) will seek his fifth UFC title defense. He scored a dominant decision victory against Ali Bagautinov at UFC 174 last month in Vancouver. Fighting out of Kirkland, Washington, Johnson is on a six-fight win streak.
John Dodson (16-6) was expected to challenge Johnson next, but will miss the rest of 2014 after undergoing knee surgery last week. The two fought previously in January 2013, with Johnson winning via unanimous decision.
The injury to Dodson opens a door for Cariaso (17-5), who was originally scheduled to fight Kyoji Horiguchi on Sept. 21 in Saitama, Japan.
A former bantamweight, Cariaso got off to a rough 1-2 start after dropping to 125 pounds in 2012, but has since rebounded with a three-fight win streak. Three of his four wins at flyweight have gone the distance.