Hi there!
So I was hoping programming might be able to help with this. I am trying to learn how to use Selenium for personal projects.

I have tried using normal, straight up selenium but it does not support authorized proxies…
I have tried SeleniumBase, but when I got it working, there were WebRTC leaks that I could not avoid.
I have tried using Undetected-chrome but that too I was unable to get authorized proxies working…
For proxies, I tried seleniumwire as well. That seems to use its own SSL certificates which unfortunately as far as I can tell is easy to detect.
Main purpose for me is web scraping and or simple login to X site, enter X info and close.

So my question is… What is the proper way to use Selenium for automating functions while avoiding detection?

Thank you in advance.

EDIT: I made this post because I am hitting a wall at every turn, and I feel like I might just be approaching this the wrong way, or maybe I’m just missing something crucial. I was hoping someone with more experience could explain to me what is the correct way of doing it without cobbling it together with duct tape.

  • @iliketurtles
    link
    English
    4
    edit-2
    1 year ago

    Not 100% sure if this is helpful, but here is what I’m importing and a snippet initiating webdriver. Sorry on mobile. The hardest part was getting the right chromium installed and getting the path right. I believe this is the one I used. sudo apt-get install chromium-chromedriver

    from selenium.webdriver.chrome.options import Options
    from selenium.common.exceptions import TimeoutException
    from selenium.webdriver.common.keys import Keys
    from selenium.common.exceptions import NoSuchElementException
    from selenium.webdriver.support.ui import WebDriverWait
    from selenium.webdriver.common.by import By
    from selenium.webdriver.support import expected_conditions as EC
    
    
    driver = webdriver.Chrome("/usr/lib/chromium-browser/chromedriver")```
    • @[email protected]OP
      link
      fedilink
      English
      21 year ago

      Thanks! I appreciate your response, and love the username! :) Fortunately getting the right chrome driver working was one of the very few things that just worked for me. Have you gotten proxies working without proxy detection with this setup, and if so, what did you do?

      • @iliketurtles
        link
        English
        21 year ago

        Oh, sorry haven’t tried proxies. Just scraping a single site.