logoalt Hacker News

Open Code Review – An AI-powered code review CLI tool

161 pointsby geoffbptoday at 12:04 AM36 commentsview on HN

Comments

eranationtoday at 5:16 AM

Ran it on a subset of 10 of the 50 PRs in this benchmark https://codereview.withmartian.com

- very good recall (~74%, e.g. found a lot of the golden issues)

- not so good precision (~12%, e.g. lots of false positives)

- the precision causes the F1 to tank (~20%, if this stays the same on the full 50 sample it would puts it almost last, even less than Kilo+Grok)

show 1 reply
sfortistoday at 7:39 AM

Is not working with gpt5.x models (Unsupported parameter: 'max_tokens' is not supported with this model. Use 'max_completion_tokens' instead.) which is hardcoded. I dont know why this is on the front page. My review-with-codex skill is working just fine, consuming my usage and not API tokens.

hrpnktoday at 7:36 AM

Rule files are in https://github.com/alibaba/open-code-review/tree/main/intern... (in Chinese)

show 1 reply
faangguyindiatoday at 1:53 AM

If you've codex what does it add over codex's default app? I am confused. Can't you simply ask codex in another tab to just do a code review?

show 5 replies
elpakaltoday at 1:58 AM

At a kill s@@s hackathon at work, I was able to build something that

uses a node image installs claude code runs a /review-like command puts inline comments to PR deletes old comments when rerunning

OCR seems cool, but overkill, and I'm definitely not using Code Rabbit after their CEO was on here acting snobbish a while back.

Point being AI code review in Git** itself isn't hard to do and can add a lot of value quickly.

show 2 replies
pi-victortoday at 6:59 AM

i did something like this, but somewhat in reverse. you are the one that reviews the code and you instruct AI what to do through code review comments: https://parley.cloudflavor.io.

thinking about it, it would be funny to first run alibaba's tool and then run parley after.

posted it here a few days ago: https://news.ycombinator.com/item?id=48369782 i guess with AI there are too many Show HN now, and i never got any type of feedback.

show 1 reply
singingtodaytoday at 1:35 AM

I'm interested in trying this.

We have our own internal automated review which has shown positive results, but I would love to drop it if I find something better.

Code review is currently our bottleneck, so any possibility of better automating it is welcome.

show 2 replies
weird-eye-issuetoday at 4:49 AM

> After installation, the ocr command is available globally.

Wish they chose a different acronym...

show 1 reply
eranationtoday at 3:01 AM

I wonder how they do against this benchmark (not that I vetted this benchmark... but still interesting to know...)

https://codereview.withmartian.com

causaltoday at 2:02 AM

I recently moved off Cursor's BugBot because it's no longer a flat $40, and I feel a little lost trying to find a viable alternative because there are so many and the pricing kind of sucks for all of them. Curious if anyone has a recommendation.

show 1 reply
atestutoday at 1:47 AM

We've been using Coderabbit, great deal ($30/mo/dev flat) and finds a lot.

I also built a skill I call `/meta-review` that asks Codex, Cursor, and Gemini to review the code (I use Claude Code). It always finds little things claude & I missed.

Coderabbit just came out with their own PR review UI that's great for big PRs, it groups files together etc. https://www.coderabbit.ai/blog/introducing-atlas-the-first-a...

show 3 replies
AashmanShuklatoday at 6:07 AM

[flagged]

Aegis_01today at 5:34 AM

[flagged]

xuanlin314today at 2:13 AM

[flagged]

lizhengfeng101today at 4:32 AM

[dead]