Wormley enrolled at the University of Michigan in 2012. During summer training camp in August 2012, Wormley sustained a torn anterior cruciate ligament, did not play during the 2012 season, and received a medical redshirt. As a redshirt freshman in 2013, he appeared in 13 games as a backup defensive lineman. As a redshirt sophomore in 2014, Wormley appeared in 12 games, six as a starter.
As a redshirt junior in 2015, Wormley appeared in 12 games, including 10 as a starter. He totaled two sacks and eight tackles for loss in the 2015 season.
In 2016, Wormley returned to Michigan as a fifth-year, redshirt senior. In August 2016, Wormley and tight end Jake Butt were selected by a vote of their teammates as the team captains for the 2016 Michigan team. He was also named to the watch lists for the Bronko Nagurski Trophy and Chuck Bednarik Award as the best defensive player in college football. On September 10, 2016, he blocked two field goal attempts in a 51-14 victory over UCF. During the 2016 season, Wormley recorded 39 tackles, with nine tackles-for-loss, and finished second on the team with six sacks.