This is the project for scraping Karnataka eProcurement Tenders. Scraping is done on daily basis and the SQLite DB is updated. THe SQLite DB in this git repo is just for developement and doesnt have the latest data.
The latest DB [Updated Daily] is available for download at OpenBangalore
//This table contains the basic info of the tender
TABLE "tender"
"Tender_Number" ,
"Department_Location" ,
"Tender_Title" ,
"Tender_Type" ,
"Category" ,
"Sub_Category" ,
"Estimated_Value" ,
"NIT_Published_Date" ,
"Last_Date_for_Bid_Submission" ,
"notice_url" ,
"download_docs_url" ,
"Notice_Inviting_Tender_Details" ,
"error"
//This table contains the links to documents that belogs to a tender.
TABLE "document"
"name_of_the_document"
"Tender_Number" ,
"type_of_the_document" ,
"url_of_the_document"
- Download procurements.sqlite.tar.lzma
- Unzip using 7zip
- Install Firfox
- Install Firefox addon - SQLite manager
- Restart Firefox
- Go to Firefox - Tools - SQLite Manager
- In SQLite manager - Database - Connect Database and choose the extracted file in step 2
- Expand tables on left
- Click on the document or tender table
- If you want it as csv, right click on table and export table
- Code a simple RSS feed to subscribe to latest tenders
- Simple UI to explore the data
- Download the documents along with scraping info
Thejesh GN http://thejeshgn.com |
i-at-thejeshgn-com GPG ID : 0xBFFC8DD3C06DD6B0 |