A nodejs script to Scrape reksadana list on bibit.id.
To Clone This Repo :
git clone https://github.com/rahadiana/bibit.id-scraper.git
This Script using "cache" as default folder value for scraping result , You can change default folder value for result scraping in
ReksadanaInfo.js (SaveFolder = "cache/") AND index.sh (FolderName="cache")
Avaliable Method :
- list (to get avaliable list Reksadana).
- product (to get product info Reksadana).
- prospectus (to get prospectus info Reksadana).
- factsheets (to get factsheets info Reksadana).
- simulation (to get simulation info Reksadana).
- chart (to get chart info Reksadana).
- aum (to get aum info Reksadana).
- dividends (to get dividends info Reksadana).
- switchables (to get switchables info Reksadana).
Example Method:
-
list (to get avaliable list Reksadana).
node ReksadanaInfo.js list (page)
node ReksadanaInfo.js list 1
-
product (to get product info Reksadana).
node ReksadanaInfo.js product (product code)
node ReksadanaInfo.js product RD3191
-
prospectus (to get prospectus info Reksadana).
node ReksadanaInfo.js prospectus (product code)
node ReksadanaInfo.js prospectus RD3191
-
factsheets (to get factsheets info Reksadana).
node ReksadanaInfo.js factsheets (product code)
node ReksadanaInfo.js factsheets RD68
-
simulation (to get simulation info Reksadana).
node ReksadanaInfo.js simulation (product code)
node ReksadanaInfo.js simulation RD68
-
chart (to get chart info Reksadana).
node ReksadanaInfo.js chart (product code) (peroid)
node ReksadanaInfo.js chart RD68 1y
-
aum (to get aum info Reksadana).
node ReksadanaInfo.js aum (product code) (peroid)
node ReksadanaInfo.js aum RD68 1y
-
dividends (to get dividends info Reksadana).
node ReksadanaInfo.js dividends (product code)
node ReksadanaInfo.js dividends RD68
-
switchables (to get switchables info Reksadana).
node ReksadanaInfo.js switchables (product code)
node ReksadanaInfo.js switchables RD68
*for peroid method "chart & aum" you can choose :
1D,1M,3M,YTD,1Y,3Y,5Y,10Y,ALL
for automatic scraping all method, you can use index.sh and uncomment a function / all functions
bash index.sh
If you use index.sh, you machine must installed jq package
you can install jq package using (i'm use ubuntu):
sudo apt install jq