home >> subpage >> post

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Viewing 5 reply threads
  • Author
    Posts
    • #756


      paraguaio
      Participant
      Post count: 2

      Hello, I need help setting up crawlomatic in the following function:

      home >> subpage >> post

      I need to go through a subpage to get the post

    • #757


      Szabi – CodeRevolution
      Keymaster
      Post count: 4139

      Hello,

      Please send me the URL of the target website so I can check on it.

      Regards,

      Szabi – CodeRevolution.

    • #760


      paraguaio
      Participant
      Post count: 2

      https://agenciabr7.com.br/

      home>>Modelo Plus Size>>post

    • #761


      Szabi – CodeRevolution
      Keymaster
      Post count: 4139
      Hello,
      I checked the link you provided, and it seems that the source site is using some plugins or scripts to load content only after the page is displayed to the user, using JavaScript. The process is called lazy loading.
      The issue here is that the plugin (nor any other PHP based plugin that runs on WordPress) cannot execute JavaScript, it will only get the content that is sent from the server in it’s plain HTML form. Changes that are made to the content after the page is displayed (using JavaScript), are invisible to the plugin.
      However, I managed to work around this in my plugins, so if you check the plugin’s ‘Main Settings’, you will see a settings field called PhantomJS Path On Server’ – this is used to configure the plugin to use phantomjs to import content. PhantomJS is a small browser that needs to be installed on your server, and the plugin can use it to download content and to also render JavaScript created material, inside of posts.
      However, the down side of this approach is that phantomjs is possible to be installed only on VPS hosting services or on private servers – shared hosting providers will not allow you to edit the server settings or to install other components to it.
      So, if you are able to install phantomjs to your server, you can configure the plugin to enable it’s usage, and it will also import content that is “lazy loaded”. 

      For more info on this, please check this video:
      https://www.youtube.com/watch?v=hnEPlQSeAZE (similar settings also for Echo RSS)
      Phantomjs installation help: https://www.youtube.com/watch?v=wWuI1mdIHwA
      Like this, you will be able to import content from the page.
      Regards.
    • #794


      paraguaio
      Participant
      Post count: 2

      I created this site to use as an example.

      https://  gb5online.com/

      in it I have 2 subpages and in them the posts

    • #795


      Szabi – CodeRevolution
      Keymaster
      Post count: 4139

      Please assign HTML classes to links from pages, so they can be easily crawled. https://gb5online.com/

Viewing 5 reply threads

The topic ‘home >> subpage >> post’ is closed to new replies.