logoalt Hacker News

smoorestoday at 11:46 AM2 repliesview on HN

I took a week of from work recently to reimplement Storyteller's forced alignment algorithm. Storyteller[1] is an open source, self hosted platform for creating, managing, and reading/listening to "readaloud" books — books that have audiobook narration built in and can highlight each sentence (and/or word, with this new algorithm!) as it's read aloud. Forced alignment is the process of determining where each piece of text starts and ends in the audiobook.

Anyway, I am really pleased with how the new algorithm turned out! Hopefully someone else finds it interesting as well.

[1] https://storyteller-platform.dev


Replies

zackifytoday at 2:58 PM

This is great. Recently got an xteink x3 and jailbroke my kindle, making custom stuff for it.

I couldn't find it exactly in the docs. Sorry if I missed it.

If you align these and then pull onto koreader via opds or other way, will audio work over Bluetooth there too? Along with the highlighting.

show 1 reply
orsenthiltoday at 1:37 PM

This is excellent! I wanted this. I had noticed that Kindle had limited feature like this for certain books that support audiobooks. I had tried this style of reading with audiobook and ebook without a any automated sync, but hadn't pursued it. This looks cool. :)

show 1 reply