That's how I did undergrad. Wasn't even much of a note taker, usually just paid attention during lectures and did the reading. That's not enough for the insane volume of information you have to learn in med school. There are certain subjects like physiology that are very conceptual but even there you need to know quite a bit of detail, and then of course the memorization heavy topics like anatomy, microbiology and others.

There's a reason Anki is used so heavily by med students these days.