It was hitting the jamb on the bottom. The hinges seemed tight, so I just hit it with 40 grit sandpaper since it’s solid wood. Hit it with some sealant and it looks good as new.
I had to retighten the handle too. When I went to do the final test I was a little worried it the handle might not work correctly so I made sure I had my phone, my leatherman, and a bottle of water “just in case”.
I was surprised and very happy how well it came out.
The best part is every time you hear that latch you can think, “I did that”