Can LLMs Do Accounting? Evaluating LLMs on Real Long-Horizon Business Tasks

I've been on an accounting course and yeah, it actually takes a little brains and then a billion checks that you didn't typo anything.

LLM's aren't great with the former and are utter dogshit with the latter. The amount of times it goes for something beyond ridiculous isn't so bad that they're worthless, but as of now, if you use one for accounting on any significant scale, I'd say there's non-insignificant chance you'll be breaking some sort of accounting / taxation rules in a matter of hours. And the governments (in general, all of them) don't really take kindly to that kind of shit.