Nicknamed "Hayeso" by his classmates, he played football from 1936 to 1938 and was a member of the second version of Fordham's famous "Seven Blocks of Granite".
 
During Hayes' time at Fordham, the Rams compiled an overall record of 18-2-5. From the opening game of the '37 season, a 66-0 win over Franklin & Marshall, to the famous 24-13 loss to the nationally ranked Pitt Panthers in 1938, Hayes helped the Rams go unbeaten in 12 straight games. In 1937, he keyed victory over the cross-town rival New York University when he returned a pass interception 41 yards for a touchdown. From 1935-37, Fordham played in the three consecutive 0-0 scoreless ties against Pitt, Hayes was involved in these games as well