EDIT: Thanks everyone for your time and responses. To break as little as possible attempting to fix this I’ve opted to go with ZeroSSL’s DNS process to acquire a new cert. I wish I could use this process for all of my certs as it was very quick and easy. Now I just have to figure out the error message lemmy is throwing about not being able to run scripts.

Thank you all for your time sincerely. I understand a lot more than I did last night.


Original Post

As the title says I’m unable to renew a cert on a self-hosted lemmy instance. A friend of mine just passed away and he had his hands all up in this and had it working like magic. I’m not an idiot and have done a ton of the legwork to get our server running and working - but lemmy specifically required a bit of fadanglin’ to get working correctly. Unfortunately he’s not here to ask for help, so I’m turning to you guys. I haven’t had a problem with any of my other software such as nextcloud or pixelfed but for some reason lemmy just refuses to cooperate. I’m using acme.sh to renew the cert because that’s what my buddy was using when he had set this all up. I’m running apache2 on a bare metal ubuntu server.

Here’s my httpd-ssl.conf:

https://pastebin.com/YehfTPNV

Here’s some recent output from my acme.sh/acme.log:

https://pastebin.com/PESVVNg4

Here’s the terminal read out and what I’m attempting to execute:

https://pastebin.com/jfHfiaE0

If you can make any suggestions at all on what I might be missing or what may be configured incorrectly I’d greatly appreciate a nudge in the right direction as I’m ripping my hair out.

Thank you kindly for your time.

  • @running_ragged
    link
    English
    1212 days ago

    Not sure if this is anything or not.

    You pasted the httpd-ssl.conf file.

    The script output is referencing httpd.conf

    I think it’s sending the challenge request via port 80 and that might be where you’re looking in the wrong place.

    • Sol 6 VI StatCmdOP
      link
      English
      212 days ago

      Thanks I’m gonna check this out first thing. I thought that was weird but I’m not sure what in httpd.conf could be interfering with the process. I will give the file a better read through and see what I can come up with - it’s a good starting point.

  • @[email protected]
    link
    fedilink
    English
    712 days ago

    Hi, just a guess. But

    The retryafter=86400 value is too large (> 600), will not retry anymore.

    Seems to me like the call to your server in the verification step is failing.

    Do you have port 80 blocked or stopping the call in another way ?

    • Sol 6 VI StatCmdOP
      link
      English
      212 days ago

      The only thing I can think of that might be interfering is HSTS? I’m not sure how acme is accessed when a browser can only access a site with ssl. Perhaps HSTS is interfering with the cert process somehow?

      • @[email protected]
        link
        fedilink
        English
        211 days ago

        The process makes file to read via http (not https), it’s just a nonce ( some random characters). Once their server reads that file, using the domain (and not the ip) and compares with what is expected, this shows you own the domain , and they give you a new ssl cert, modifying your server’s https configuration file (usually). And deletes the file it made .

  • Johannes Jacobs
    link
    fedilink
    English
    511 days ago

    I’m really surprised noone mentioned Caddy which handles all the SSL business for you. Not to mention an easier config :)

    • @[email protected]
      link
      fedilink
      English
      3
      edit-2
      11 days ago

      Caddy is awesome! I originally went for nginx proxy manager to manage my certs as it has a GUI. However, despite being text based, Caddy is so even easier to configure…

              email [email protected]
      }
      
      jellyfin.mydomain.net {
              reverse_proxy 192.168.0.1:8096
      }```
      
      
      That's all there is to it. Caddy does the heavy lifting.
      • @[email protected]
        link
        fedilink
        English
        311 days ago

        I don’t think you even need to configure the email.

        If I recall correctly emails are optional for Let’s Encrypt but Caddy are partnered with ZeroSSL who do require emails so you’re encouraged to provide one.

    • Sol 6 VI StatCmdOP
      link
      English
      210 days ago

      How hard would it be to switch in your experience… I’d love something this simple. Nervous to tear stuff down though.

      • Johannes Jacobs
        link
        fedilink
        English
        2
        edit-2
        10 days ago

        I dont think its hard :)

        Can you post your apache config?

        Ive been so long on Caddy i havent touched Apache or nginx for ages. But i’m pretty sure i or someone else can help you convert your config :)

        • Sol 6 VI StatCmdOP
          link
          English
          210 days ago

          I appreciate the offer. If I get stuck I’ll dump it. If it’s as straight forward as everyone says I should be able to pull it off it looks so easy. Don’t want to make others do my work for me unduly.

          • Johannes Jacobs
            link
            fedilink
            English
            2
            edit-2
            10 days ago

            Oh my god… i completely overlooked the config in your original message!!

            Un any case, look at this: https://join-lemmy.org/docs/administration/caddy.html

            Someone done the work, and they would be glad if you made use of it :)

            And if you start with: lemmy.domain.tld:81 {

            You can even have it run on a different port, so you can test it without risking your apache config.

            • Sol 6 VI StatCmdOP
              link
              English
              210 days ago

              This is brilliant thank you. This is going to save me dozens of hours.

            • Sol 6 VI StatCmdOP
              link
              English
              210 days ago

              Only thing I’m having trouble with so far is handling a line like this > <FilesMatch \.php$> # Apache 2.4.10+ can proxy to unix socket SetHandler "proxy:unix:///run/php74-fpm.sock|fcgi://localhost/" </FilesMatch> Not really sure how caddy handles this.

                • Sol 6 VI StatCmdOP
                  link
                  English
                  29 days ago

                  thank you for taking the time to share, I actually moved over to nginx… all over the place >_> a few people have made it pretty clear I’m going to overwhelm caddy quickly with the number of different domains and sites we host so I’m starting over with nginx now.

  • @[email protected]
    link
    fedilink
    English
    512 days ago

    You’ve just reminded me to fix cert renewal on my instance. I’m using let’s encrypt & their certbot with nginx and it is great.

    Recently my nginx config got too complex, so nginx plugin stopped working correctly, because it wasn’t able to inject the config for ACME challenge correctly anymore. The solution was to manually configure location /.well-known/acme-challange to read from a local directory and configure certbot to use a local webroot directory instead of fiddling with nginx config.

    • Sol 6 VI StatCmdOP
      link
      English
      112 days ago

      This is out of my skillset but I’m sure there’s documentation online I can check out to give it a shot. We use this server for our (very) small business so I’m trying not to jack anything up worse than it is but it seems like something I could potentially tackle. Thank you.

  • Sol 6 VI StatCmdOP
    link
    English
    312 days ago

    Just popping in this morning to thank everyone for their suggestions overnight. I have some stuff to look at now when I get to the office this morning. Can’t respond to every comment at the moment but I will. Just wanted to say thanks.

  • @[email protected]
    link
    fedilink
    English
    211 days ago

    Are you using cloudflare to proxy the server? If so, just download a 10-year certificate and don’t worry about renewing short term ones.

    • Sol 6 VI StatCmdOP
      link
      English
      111 days ago

      Unfortunately no, though that sounds very nice.

      • @[email protected]
        link
        fedilink
        English
        311 days ago

        Ah, you should perhaps look into using Cloudflare or a similar service. Not for the certificate, but because if somebody took a dislike to your instance, they could easily DDoS you off the internet. The decade long certificate is just icing on the top.

        • Sol 6 VI StatCmdOP
          link
          English
          111 days ago

          Certainly will look into it thanks for the heads up!

  • @iopq
    link
    English
    212 days ago

    You can just try zeroSSL. Either add a DNS record they give you or host the file they give you, it’s much simpler

    • Sol 6 VI StatCmdOP
      link
      English
      112 days ago

      This sounds like a good backup plan and I’ll probably definitely have to resort to trying it - thank you for the suggestion.

    • Sol 6 VI StatCmdOP
      link
      English
      112 days ago

      Are you referring to the ‘does not contain DNS’? Or the ‘apache,/’ because both are a bit confusing to me honestly

    • Sol 6 VI StatCmdOP
      link
      English
      1012 days ago

      My friend chose it, he was old school. I don’t personally have a preference between the two but we use this server for our small business so I haven’t really wanted to risk messing everything up to switch when it’s (mostly) currently functional.

      • @roofuskit
        link
        English
        111 days ago

        Woah, you have a Lemmy instance hosted on the server for your small business? That just doesn’t sit well with me. I hope the server going down would not halt your income.

        • Sol 6 VI StatCmdOP
          link
          English
          211 days ago

          We are a community oriented business and I really hate the big tech companies controlling the fate of my company. Lemmy seemed like one of a few easy alternative platforms where we were free from being stuck under the thumb of a tech giant or a ban away from loosing our members.