- Which One Of The Following Statements About Web Scraping And Apis Is True If A Website Doesn T Have A Term And Conditio 1 (38.14 KiB) Viewed 26 times
Which ONE of the following statements about web scraping and APIs is TRUE? If a website doesn't have a term and conditio
-
- Site Admin
- Posts: 899603
- Joined: Mon Aug 02, 2021 8:13 am
Which ONE of the following statements about web scraping and APIs is TRUE? If a website doesn't have a term and conditio
Which ONE of the following statements about web scraping and APIs is TRUE? If a website doesn't have a term and conditions or terms of use page, this means you have permission to perform web scraping. The main reason we rate-limit is to avoid the website we're scraping detecting we are violating the terms and conditions. If the location of the data we want to scrape from a website in not listed as one of the parts of a website that are off limits based on the robots.txt, we can definitely scrape this website. We cannot look at the robots.txt since it is for algorithms/robots to read. You should always provide credit to the source of your data when presenting results from web scraped data.