Current/voltage chart looks a lot like a RELU.
That's exactly why it's called a 'rectified' linear unit! It's a half-wave rectifier. The ReLU function is just what you'd see if you put an (ideal) diode on a curve tracer.
alt Hacker News
That's exactly why it's called a 'rectified' linear unit! It's a half-wave rectifier. The ReLU function is just what you'd see if you put an (ideal) diode on a curve tracer.