│ > Do that once more utilizing mpfr, which is already put in. Name this │
│ pi_value_mpfr. │
Gemini obtained that proper the primary time, which wasn’t an enormous shock since MPFR has a built-in fixed operate for pi. Then Gemini volunteered that the MPFR implementation was a bit slower than the Increase implementation. Nicely, I knew that MPFR was utilizing a suboptimal however dependable algorithm.
Me:
│ > attempt once more utilizing the absolute best algorithm. name this system │
│ pi_value│
Gemini accurately selected the Chudnovsky algorithm with MPFR, however then screwed up the implementation just a few occasions earlier than getting it proper. When it lastly obtained an accurate end result, the actual runtime was about half of that of the built-in fixed operate for pi. I then had Gemini verify the three end result values towards one another and the 39-digit reference worth given within the Encyclopedia Britannica. All good.
On to one thing non-trivial: I modified to the listing the place I had a present copy of the gemini-cli repository and first requested it to elucidate the repo, after which requested it to record open points, which it did utilizing gh
as soon as I gave it permission. Then I requested it to choose an open problem marked as a good first problem
, after which to counsel an implementation. It got here up with a plan, bumped into hassle with the implementation, got here up with a revised plan, had hassle with that, and eventually went right into a loop making an attempt to stability TypeScript parentheses. I canceled the duty at that time.
Good however not nice
My conclusion right here is that Gemini CLI with the gemini-2.5-pro mannequin is fairly good however not nice. On a scale of Degree 0 to Degree 5 the place Degree 0 is “No automation or company, however good tooling for shortcuts and repetitive use” and Degree 5 is “Full automation: Software program can problem-solve and implement with out supervision,” the Gemini CLI and Professional mannequin are in all probability at round a 3.5, someplace between Degree 3’s “Conditional automation: Software program can write itself beneath pre-defined guidelines and recipes” and Degree 4’s “Excessive automation: Software program can write itself with little to no human supervision.”
To place that in perspective, the one higher programs that I’ve examined are Claude Code and Solver, which may each typically behave at or close to Degree 4. However, Gemini CLI is free and the gemini-2.5-pro mannequin has a million-token context window and superior coding capabilities, which collectively can get you fairly far with out paying for a subscription or for utilization.
Price
Free with 60 mannequin requests per minute and 1,000 requests per day; usage-based billing and subscriptions accessible.
Platform
Command line/terminal; Node.js v18+; Home windows, macOS, Linux.
Backside line
Gemini CLI is free and the gemini-2.5-pro mannequin has a million-token context window and superior coding capabilities, which collectively can get you fairly far with out paying for a subscription or for utilization. The one higher programs that I’ve examined are Claude Code and Solver.
Execs
- Free for many makes use of
- Good outcomes more often than not
- Someplace between conditional and excessive automation
- Energetic open-source challenge
Cons
- Nonetheless buggy because it has been accessible for lower than a month
- Makes use of a hosted mannequin, which implies that your code may doubtlessly leak
- When it fails it will possibly produce rubbish code however declare that it really works