@[email protected] to Open [email protected] • 2 months agoFOSS infrastructure is under attack by AI companiesthelibre.newsexternal-linkmessage-square30fedilinkarrow-up1383cross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected]
arrow-up1383external-linkFOSS infrastructure is under attack by AI companiesthelibre.news@[email protected] to Open [email protected] • 2 months agomessage-square30fedilinkcross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected]
minus-square@[email protected]linkfedilink5•2 months agoThe bots scrape costly endpoints like the entire edit histories of every page on a wiki. You can’t always just cache every possible generated page at the same time.
minus-square@[email protected]linkfedilinkEnglish1•edit-22 months agoOf course you can. This is why people use CDNs. Put the entire site on a CDN with a cache of 24 hours for unauthenticated users.
The bots scrape costly endpoints like the entire edit histories of every page on a wiki. You can’t always just cache every possible generated page at the same time.
Of course you can. This is why people use CDNs.
Put the entire site on a CDN with a cache of 24 hours for unauthenticated users.