logoalt Hacker News

mmoosstoday at 4:12 PM1 replyview on HN

> normalizing document formats for analysis

What do you mean here? Normalizing it into ODF format? Does that limit which tools/libraries you can use to analyze it?


Replies

riettatoday at 4:21 PM

Normalize into flat xml that I could then parse in Nokogiri.

Edit for clarity: I am a Rubyist at heart so I reach for Ruby for almost all of my automation, ML, and even now AI stuff. Fro a very long time, I have been able to use CLI LibreOffice to do amazing things. It can read everything, even obscure formats by today's standards, going back into the 1990s. And then once in OpenOffice XML you have one target to parse in your scripting language of choice to do document analysis, data loss prevention detection, and more. All with a clean open source license with no server usage restrictions, unlike MS Office.

show 1 reply