logoalt Hacker News

IanCal12/09/20240 repliesview on HN

I wouldn't store that usually, I'd use that to trigger retries.

For you storing the raw data is storing the json that http endpoint returns rather than something like

    let content = get(url).json()
    info_i_care_about = content['data']['title']
    store(info_i_care_about)
as otherwise you'll get stuck when the json response moves the title to data.metadata.title or whatever

It's usually less of an issue with structured data, things like html change more often, but keeping that raw data means you can process it in various different ways later.

You also decouple errors so your parsing error doesn't stop your write from happening.