Issue with Proxy_url and Proxy_auth

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Tagged: 

Viewing 7 reply threads
  • Author
    Posts

    • May 23, 2024 at 10:49 pm #10541


      wytlander001
      Participant
      Post count: 3

      Hey,
      I’m using smartproxy for my crawling purpose but I have either timeout issues or err 407 issue with the function crawlomatic_curl_exec_utf8.
      I’ve tried different configurations in main settings like:

      – IP/url:port with no auth
      – IP with auth
      – IP/url:port with auth

      But nothing seems to work properly.
      The data I have in my possession:

      <code class="language-php">      $url = 'ip.smartproxy.com/json';
      $proxy = 'http://gate.smartproxy.com'; or http://us.smartproxy.com
      $port = 7000;
      $user = 'XX';
      $psw = 'XXX';

FYI, bBy default (with no proxy and wordpress by default), my scrawl rule is working perfectly)
Can you please be more specific and give examples if possible on the configuration waiting to make sure it works?
Thx a lot for your help,

    • May 24, 2024 at 4:05 am #10545


      Szabi – CodeRevolution
      Keymaster
      Post count: 4310

      Hello,

      First of all, thank you for your purchase.

      Please try adding in plugin’s ‘Main Settings’ menu -> ‘Web Proxy Address List’ the proxy IP and port in this format:
      PROXY_IP:PROXY_PORT

      Example: 172.231.1.1:555

      Also, in the ‘Web Proxy Authentification’ settings field, add the proxy username and password, in this format:
      USERNAME:PASSWORD

      Example:
      secretuser:passwordnottell

      Let me know if this helped.

      Regards, Szabi – CodeRevolution.

    • May 24, 2024 at 7:48 am #10546


      wytlander001
      Participant
      Post count: 3
      This reply has been marked as private.

    • May 24, 2024 at 8:17 am #10547


      Szabi – CodeRevolution
      Keymaster
      Post count: 4310

      Please check the ‘crawlomatic_get_web_page’ function from the plugin’s crawlomatic-multipage-scraper-post-generator.php file.

      Search in it for

      $crawlomatic_Main_Settings[‘proxy_url’]
      and
      $crawlomatic_Main_Settings[‘proxy_auth’]
      Regards.

    • May 24, 2024 at 9:32 am #10548


      wytlander001
      Participant
      Post count: 3
      This reply has been marked as private.

    • May 24, 2024 at 10:48 am #10549


      Szabi – CodeRevolution
      Keymaster
      Post count: 4310
      This reply has been marked as private.

    • May 24, 2024 at 11:18 am #10552


      wytlander001
      Participant
      Post count: 3
      This reply has been marked as private.

    • May 24, 2024 at 11:50 am #10556


      Szabi – CodeRevolution
      Keymaster
      Post count: 4310

      Sure. StormProxies have only IPaddress:PORT combination, as they don’t provide a user:password.

      This is because you can whitelist only a single IP address (your server’s IP address) to be able to access their proxy, in the proxy admin panel.

      Because of this, simply add in the ‘Web Proxy Address List’ the IP address and port combination they provide for you and leave the user/password field empty.
      Example:
      ‘Web Proxy Address List’:

      22.31.129.201:1034
  • Author
    Posts
Viewing 7 reply threads

You must be logged in to reply to this topic.