Page 1 of 1
Which ONE of the following statements about web scraping and APIs is TRUE? If a website doesn't have a term and conditio
Posted: Wed Mar 30, 2022 9:28 am
by answerhappygod
- Which One Of The Following Statements About Web Scraping And Apis Is True If A Website Doesn T Have A Term And Conditio 1 (38.14 KiB) Viewed 27 times
Which ONE of the following statements about web scraping and APIs is TRUE? If a website doesn't have a term and conditions or terms of use page, this means you have permission to perform web scraping. The main reason we rate-limit is to avoid the website we're scraping detecting we are violating the terms and conditions. If the location of the data we want to scrape from a website in not listed as one of the parts of a website that are off limits based on the robots.txt, we can definitely scrape this website. We cannot look at the robots.txt since it is for algorithms/robots to read. You should always provide credit to the source of your data when presenting results from web scraped data.