logoalt Hacker News

alexpotatotoday at 5:08 PM0 repliesview on HN

At my first full time job in the early 2000s I was tasked with building a webscraper. We worked for law firms representing Fortune 500 companies and they wanted to know who was running "pump and dump" stock schemes on stocks using Yahoo Finance message boards.

At the time, I didn't know the LWP::Simple module existed in Perl so I ended up writing my own socket based HTTP library to pull down the posts, store them in a database etc. I loved that project as it taught me a lot about HTTP, networking, HTML, parsing and regexes.

Nowadays, I use playwright to scrape websites for thing I care about (e.g. rental prices at the Jersey Shore etc). I would never think to re-do my old HTTP library today while still loving the speed of modern automation tools.

Now, I too have felt the "but I loved coding!" sense of loss. I temper that with the above story that we will probably love what comes next too (eventually).