Built with Python with those frameworks and packages :
- for scraping data ->
BS4,requests - for process tasks ->
sys,os,itertools
- Clone the git project in your terminal
- Install python3 and beautifulSoup4
- Then run command in your terminal (remember to change to your download directory using cd command) Sample command: web_scraper.py https://www.washingtonpost.com/technology/2020/09/25/privacy-check-blacklight/
sample news url includes https://www.washingtonpost.com/technology/2020/09/25/privacy-check-blacklight/ https://www.washingtonpost.com/technology/2022/11/23/mars-rover-rock-samples/ https://www.washingtonpost.com/technology/2022/11/24/twitter-musk-reverses-suspensions/
No licence