Is it worth paying OpenAi $200 a month for a new chat model?

$200 a month is crazy. Is it worth it? Lets have a look.

Someone spend $200 subscribing to OpenAi's latest model. His wife might dump him soon if she knows about this, so read this before it's taken down :D.

Spending $200, so far my observations:

• Thinking time for pro is always longer, sometimes it is 30 seconds and the longest I had was around 5 minutes

• It is surprisingly hard to think of some questions that other models can't do well

• Difference between quality of o1 and o1-pro mode is hard to definitively tell apart

• One way it feels different is robustness - occasionally you'll see o1 and other models totally misjudge something and it doesn't seem to happen with o1-pro as much

• Chain of thought summaries are significantly cut down, often there's nothing shown, sometimes you see 3-5 sentences even for questions that take a few minutes to answer

• It is really fun to play with - really feels like a different kind of intelligence to other LLMs

In terms of the solid use cases I found so far (with the caveat that it is hard to tell o1 and o1-pro apart):

• Recommendations - (eg if you like clothing brand A and B, but you want something for purpose X, you'll like D and C) it feels like it really can think through what to base the recommendation on and other models just spit something out that is related

• Generating benchmark questions - I've tried this before with LLMs and they would always be bad at this, just generating trivial stuff. O1 pro has been superb, I will write more about this later.

Author

AiUTOMATING PEOPLE, ABN ASIA was founded by people with deep roots in academia, with work experience in the US, Holland, Hungary, Japan, South Korea, Singapore, and Vietnam. ABN Asia is where academia and technology meet opportunity. With our cutting-edge solutions and competent software development services, we're helping businesses level up and take on the global scene. Our commitment: Faster. Better. More reliable. In most cases: Cheaper as well.

Feel free to reach out to us whenever you require IT services, digital consulting, off-the-shelf software solutions, or if you'd like to send us requests for proposals (RFPs). You can contact us at [email protected]. We're ready to assist you with all your technology needs.

© ABN ASIA