I believe that initially they were only able to directly connect the vaccine to fewer deaths from cervical cancer. Something like warts is not deadly so probably not considered.

Then it was recommended that boys also get the vaccine because they can be carriers

However now we know the virus causes other forms of cancer as well. Men are not just carriers but can also have cancers caused by the virus.