Timeline for Is generating automatic requests illegal?
Current License: CC BY-SA 4.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 20, 2022 at 4:55 | vote | accept | gustavovelascoh | ||
| Apr 15, 2022 at 20:23 | comment | added | GuilleOjeda | It should be noted that 1 request a minute (average) is web scraping, but 1 request per microsecond is a DoS attack (DoS if you're doing it from a single computer/network, DDoS if from multiple computers/networks). There is a line somewhere in between, and some information about who decides where it is would be interesting. | |
| Apr 15, 2022 at 15:29 | history | edited | sevensevens | CC BY-SA 4.0 |
added 379 characters in body
|
| Apr 15, 2022 at 11:10 | comment | added | Josiah | Randomising the delay may also improve the scientific validity of your result, by avoiding your sampling falling into lockstep with any pattern in the availability of the button. That's not what you are asking about, but it's a nice little bonus. | |
| Apr 15, 2022 at 1:24 | comment | added | bta | Some servers have software to detect web scraping and block the offending user. To minimize the risk of getting blocked, ensure your requests are slow enough that they look like a human could be sending them manually. Randomizing the delay between page accesses helps as well. | |
| Apr 14, 2022 at 18:45 | history | edited | sevensevens | CC BY-SA 4.0 |
deleted 3 characters in body
|
| Apr 14, 2022 at 16:53 | history | edited | sevensevens | CC BY-SA 4.0 |
added 89 characters in body
|
| Apr 14, 2022 at 16:22 | comment | added | gustavovelascoh | Thank you for your answer. I have provided more details about the scrapping process and the usage of the data | |
| Apr 14, 2022 at 15:52 | history | answered | sevensevens | CC BY-SA 4.0 |