@[email protected] to Programmer [email protected] • 14 days agoWhat Drove You to Madness?lemmy.worldimagemessage-square44fedilinkarrow-up1621
arrow-up1621imageWhat Drove You to Madness?lemmy.world@[email protected] to Programmer [email protected] • 14 days agomessage-square44fedilink
minus-square@[email protected]linkfedilink6•edit-214 days agoMost recently: I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types. It’s truly an abomination. I’ve never had to use pythons AST module to parse data before…
minus-square@[email protected]linkfedilink2•edit-214 days agoIt was 900mb raw and compressed to 1.6mb after cleaning. That’s how much junk data there was. Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.
Most recently:
I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types.
It’s truly an abomination.
I’ve never had to use pythons AST module to parse data before…
🤮
It was 900mb raw and compressed to 1.6mb after cleaning.
That’s how much junk data there was.
Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.