@[email protected] to Programmer [email protected]English • 2 months agomuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comimagemessage-square300fedilinkarrow-up1983
arrow-up1983imagemuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.com@[email protected] to Programmer [email protected]English • 2 months agomessage-square300fedilink
minus-square@[email protected]linkfedilinkEnglish143•2 months ago60k is laughably, embarrassingly small. It’s still sqlite-sized.
minus-square@[email protected]linkfedilink58•2 months agoi mean its even excel sized depending on how many columns. This is seriously sad and alarming
minus-square@[email protected]linkfedilinkEnglish11•edit-22 months agoHey now that’s real close to the 65,535 16-bit limit (from 20 years ago)
minus-square@[email protected]linkfedilink3•2 months agoHoly shit if this ids lm issue that’s too funny
minus-square@[email protected]linkfedilink50•2 months agoSqlite can easily handle millions of rows. Don’t sell it short
minus-squareThe_DecryptorlinkfedilinkEnglish9•2 months agoHow about a 6.4TB sqlite database? https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
minus-square@[email protected]linkfedilinkEnglish4•2 months agoI have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
60k is laughably, embarrassingly small. It’s still sqlite-sized.
i mean its even excel sized depending on how many columns. This is seriously sad and alarming
Hey now that’s real close to the 65,535 16-bit limit (from 20 years ago)
Holy shit if this ids lm issue that’s too funny
Sqlite can easily handle millions of rows. Don’t sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I’m not
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
60k is single json file