BCA Bank

Step 1

Inspect the website HTML that you want to crawl, and access URL of the website using code and download all the HTML contents on the page.

Example

website : https://www.bca.co.id

target url : https://www.bca.co.id/id/informasi/kurs

target query selector : [class="m-table-kurs--sticky"]

Hit API

endpoint : https://us-central1-appgregator.cloudfunctions.net/ecommerce3/custom/website

Return response value from endpoint

This object could be anything that can be represented by JSON — an object, an array, a string, a number...

Step 2

Extract out useful information and save it into a structured format.

I have a GET request endpoint that receives a response in json format.then copy response from endpoint to another endpoint

HIT API

endpoint : https://us-central1-appgregator.cloudfunctions.net/ecommerce3/custom/filter

Create a new request body

Attributes

key
value
description

selector searches within the context scope which searches within the root scope. selector and context can be a string expression, DOM Element, array of DOM elements, or cheerio object. root is typically the HTML document string.

This selector method is the starting point for traversing and manipulating the document. Like jQuery, it's the primary method for selecting elements in the document.

element

key : your text

example : title,price,description....

value : "[class="field field-name-title-field field-type-text field-label-hidden"]"

your query of element depends on your need

attr : src,href,p,h2,...

your query of attribute,depends on your need

Previouse-RateNextScrapes listings

Last updated