logoalt Hacker News

owyn10/10/20242 repliesview on HN

Former Wikia engineer here too! I also thought there was a lot of potential there. We even invested in some RDF and structured data and NLP projects (second screen, sentiment analysis on comments for detecting flame wars, etc), but for various reasons they just didn't work out beyond hackathons and demos. I think there were a lot of well meaning engineers who wanted to make stuff like that work. Part of the problem is mediawiki itself. A page is literally just text using an awful hacked together xml parser and some regexes to emit HTML. It might look like a database sometimes when it is rendered (and there is Wikidata) but there is no actual structure to it, just a pile of templates made of other templates that people have to tediously wrangle by hand. That it eventually turns into some HTML that you can view is almost an accident.


Replies

thealistra10/18/2024

Also former Wikia/Fandom engineer. I won a hackathon with a wiki text validator on page save - the idea was never moved to production because nobody ultimately cared about the wiki part of it for years and years. It was just a cost center. Nice chrome to put around ads.

languagehacker10/10/2024

Oh man, good to see you on here, dude!

Yes, extracting the real human-readable text from a Wiki was a lot harder than you'd expect.

There was also a question of investment. I think even with some early successes quantified with A/B tests and things like that, there just wasn't the executive or product buy-in to broaden the investment.