BLACKSIG SYSTEMS/Resources/Can We Just Use ChatGPT

// Resources

Can We Just Use ChatGPT Instead of Automating Our Work?

For the owner whose team already has it, and who wants to know whether that is the whole answer or the beginning of one. Where a chat window is already enough, what it cannot do whichever plan you buy, and how to tell which of your work belongs in each.

Last updated · 2026-10-16

The short version

For anything a person is going to sit down and do, yes, and you should. For anything that has to happen when nobody is sitting there, no, and no plan upgrade changes that. A chat window is a tool somebody operates: it waits to be opened, it works on what you paste in, and it puts the answer back on your screen. That covers a lot of real work, and OpenAI's own benchmarking shows the models are close to expert quality on one off deliverables. What it does not cover is the part that costs you money, which is the fifty invoices that arrive on Tuesday whether or not anybody opens a browser. The question to settle is which of your work needs a person present, because that line is where the chat window stops and a built system starts.

Can we just use ChatGPT instead of automating our work?

Yes for work somebody does at a desk, no for work that has to run whether or not somebody is at the desk. That is the whole answer, and everything below is detail on where the line falls.

A chat window has three properties that decide this. It is started by a person, it works on what that person gives it, and it returns the result to that person. Nothing in it is triggered by an invoice arriving, nothing writes into your ledger by itself, and nothing notices in week five that it has been quietly producing nothing.

Automation inverts all three. Something external starts it, usually a document, a form, a message or a clock. It goes and gets what it needs rather than being handed it. It writes the result where the work actually lives, and it keeps a record of what it did so somebody can check without redoing the job.

Which means the two are not competing. Most businesses should be doing both, and the ones getting value out of AI usually started with a chat window, learned what the models are good at, and then built the two or three things that were worth taking off people's desks. The mistake is not choosing wrong, it is assuming the chat window will eventually turn into the second thing. It does not, because the limitation is not the model's intelligence, it is that somebody has to be there.

The test to apply to any task on your list: if nobody opened a browser tomorrow, would this still need to happen? If yes, a chat window is not the answer, however good the answer it gives.

What is ChatGPT already good enough for?

Good enough for most one off professional deliverables, and the evidence for that is stronger than the marketing. OpenAI built a benchmark called GDPval, announced in September 2025 and written up that October, which tests models on real work tasks drawn from 44 occupations across the nine sectors contributing most to US GDP. It holds 1,320 tasks in total, with a 220 task gold subset written by industry professionals from their own work.

The grading is the interesting part: experts compared the model's deliverable against a human professional's, blind. According to the paper, on that gold subset in the first release Claude Opus 4.1 reached 47.6% wins and ties against the human experts and GPT-4o reached 12.4%, and the most common reason experts preferred the human work was that the model had not fully followed the instructions. Those figures are from October 2025 and later models score higher as the benchmark is re-run, so read 47.6% as a floor rather than a ceiling. Either way it is roughly even odds or better on a single piece of professional output, which is a remarkable place for the technology to be and also not the same claim as "it can do the job".

So the honest list of what a chat window is already worth having for: drafting and rewriting, summarising long documents, turning notes into something sendable, first pass analysis of a spreadsheet, explaining a contract clause, writing the awkward email, producing the first version of a policy or a process description, and answering the sort of question you would otherwise spend twenty minutes searching for.

What those have in common is that a person is right there to catch the problems. The instruction following gap GDPval found is survivable when somebody reads the output before it goes anywhere, and it is not survivable when the output is written straight into your accounting system at two in the morning.

For the work on that list, buy the seats and get on with it. Our page on getting your team to use AI covers the adoption side, which is a harder problem than the licence.

How are people actually using ChatGPT at work?

People are using ChatGPT at work mostly as an editor and an answer service, which is worth knowing before you plan a business around it. The largest study of this is a working paper published by the National Bureau of Economic Research in September 2025, written by researchers at OpenAI and Harvard, analysing a sample of about 1.1 million conversations.

Three findings matter for this decision. According to the paper, non work messages grew from 53% of usage to more than 70% between late 2022 and July 2025, so most of what the product does is not business use at all. Across all messages, roughly 49% were classified as asking, 40% as doing and 11% as expressing. Among work messages specifically, doing rose to about 56%, and it is largely writing.

The detail that settles the argument is what kind of writing. The paper's work writing is dominated by editing, summarising and translating text the user supplied, rather than generating something from nothing. The dominant business use of the most capable consumer AI product in the world is a person handing it their own text and getting a better version back.

That is a genuinely useful thing and it tells you exactly where the ceiling is. Every one of those interactions required a person to have the text, open the window, paste it in, read the result and put it somewhere. The work the chat window removed was the writing. The work it did not touch was the opening, the pasting, the reading and the putting somewhere, and in most businesses that is where the hours actually go.

What does ChatGPT not do, whichever plan we buy?

Five things, and the business plans do not change any of them. Being specific about them matters, because the plan comparison pages make it sound like these are features waiting further up the price list.

A chat window does not start by itself. Nothing in a chat product watches your inbox, your job board or your document folder and begins work because something arrived. A person starts every conversation.

A chat product does not reliably write into the systems you run. Connectors and app integrations are real and they are getting better, and they are built for a person asking a question across their own files rather than for a process writing a record into your ledger, your field service app and your CRM in the same transaction.

A chat window does not handle the variation in your inputs the way a built process has to. The twelve invoice layouts, the supplier who sends a photograph of a delivery note, the customer who replies to the wrong thread. A person in a chat window copes with all of that without noticing, which is exactly why nobody realises how much of it there is until they try to automate it.

A chat conversation keeps no operational record. Nothing counts what was processed, what was escalated and what was skipped. The skipped count is the number that tells you an automation has quietly stopped earning its keep, and a chat window has no concept of it.

Nobody owns a chat conversation at six in the morning. When something breaks in an automated process, somebody is accountable for noticing and fixing it. When a chat conversation goes wrong, the person who was there notices, because they were there.

None of that is a criticism of the product. It is a description of what a tool a person operates can be, which is why the question is about your work rather than about the software.

Can an AI agent do the work on its own yet?

An AI agent can do part of the work on its own, and the measured numbers are well below the sales pitch. The best public evidence is TheAgentCompany, a benchmark built at Carnegie Mellon with Duke and independent researchers, which sets 175 tasks inside a self hosted simulated software company spanning software development, project management, data science, administration, HR and finance.

The first version of the paper put the best baseline agent at about 24% of those tasks completed autonomously. The revision of September 2025 reports Gemini 2.5 Pro at 30.3%. The authors' framing is that a good share of simpler tasks can be solved while longer horizon work remains out of reach. For a buyer, 30% autonomous completion on office tasks is not a function you can hand over, and it is a long way from nothing.

What makes the difference in practice is scope. An agent given one narrow job with clear inputs, a defined output and a human escalation path when it is unsure does useful work today, and that is what a well built automation is: a tightly scoped agent plus the plumbing, the error handling and the record keeping around it. The same model given a vague remit and access to everything produces a demo and then a mess.

So the realistic version is not an AI employee. It is a process where the model does the reading, the classifying and the drafting, the system does the fetching, the writing and the logging, and a person handles the small pile of things the model was not sure about. AI agents vs chatbots separates the categories, and what happens when AI gets it wrong covers the escalation design.

Which of our work belongs in a chat window and which belongs in a system?

Work belongs in a chat window when a person has to be present for it anyway, and in a built system when it has to happen whether or not anybody is there. The table below applies that sort to the work most businesses already have.

WorkChat windowBuilt system
Drafting a proposal from your notesYes, with a person editingNo
Sending the follow up on every quote over $5,000NoYes, on a schedule
Summarising a long contract before a callYesNo
Coding fifty supplier invoices into the ledgerNoYes
Writing the job description for a new hireYesNo
Confirming tomorrow's appointments and rebooking the no showsNoYes
First pass analysis of last month's numbersYesNo
Assembling the same report every week from four systemsNoYes
Answering a one off question about a policyYesNo
Routing an inbound enquiry to the right person within minutesNoYes

The pattern down that table is volume and timing rather than difficulty. Everything in the chat column happens once, when somebody decides to do it. Everything in the system column happens on a cadence set by your customers and your suppliers rather than by your team, which is precisely why it is the work that slips.

Look at which column your most expensive problem sits in. For most owner led businesses the hours are in the second column and the AI spending is in the first, because the first is easy to buy. Where AI creates leverage in a business goes through how to find the ones worth building.

Is it safe to put our business data into ChatGPT?

Safe enough for most business content on a paid business tier, and the real exposure is the accounts nobody set up. OpenAI's own help centre states that with ChatGPT Business, Enterprise, Edu and its API, inputs and outputs are not used to train its models by default. Personal Plus, Pro and Free accounts work the other way: sharing is on unless the user switches it off. That difference is the whole of this section.

Which is why the bigger risk is what your team is already doing. Cyberhaven's 2026 AI adoption and risk report, published in February 2026 and built from data movements across 222 companies, found that 39.7% of interactions with AI tools involved sensitive data, and that about a third of employees reaching those tools were doing it through personal accounts rather than company ones. Cyberhaven sells data security software and applies its own classification, so read it as vendor research. A personal account sits outside whatever your business agreed with the vendor, on the plan where sharing is the default, and outside any record of what left the building.

Which makes this a policy and provisioning question rather than a technology one. Give people company accounts on a plan whose terms you have read, say plainly which categories of information do not go into any AI tool, and the shadow usage mostly resolves itself because the sanctioned path is easier than the workaround.

Is AI automation safe with my business data? covers vendor handling in detail, and does a small business need an AI policy? covers the policy itself, including what you have to tell customers.

Frequently asked questions

Is ChatGPT cheaper than building an automation?

Per seat, yes, and the comparison is not like for like. A chat subscription buys your team a tool each of them operates. An automation removes a recurring task from the business whether or not anybody is working that day. The way to compare them is to count what the manual process costs now: hours per week, multiplied by loaded hourly cost, annualised. If that number is small, a chat window and a better habit is the right answer and you should stop there. If it is large and the process repeats on somebody else's schedule, the subscription will not touch it.

How do we turn what we do in ChatGPT into something automatic?

Start from the task rather than the prompt. Write down what triggers the work, where the inputs come from, what judgement is involved, where the result has to end up and who notices when it is wrong. That document is the specification, and the prompt is a small part of it. Then build the connections, test against your real historical records rather than samples, and run the automated version alongside the manual one until the outputs match. Most of the engineering is in the connections, which is the part the chat window never required.

Is ChatGPT enough, or do we need Zapier or a custom build?

Three different purchases. A chat subscription suits work a person does at a desk. A no-code platform such as Zapier, Make or n8n suits work that needs to happen on a trigger, has few steps and tolerates somebody maintaining it. A custom build suits work with real variation in the inputs, several systems to write into, and a cost of quiet failure that somebody has to own.

Can our process run entirely without a person?

Some can, most should not at first. The design that works has the model doing the reading, classifying and drafting, the system doing the fetching, writing and logging, and a person handling whatever the model flagged as uncertain. Over time the flagged pile shrinks as the rules get sharper. Anything going to a customer stays a draft until you have watched it for a while, which is less about the technology than about the fact that a message to your customer is a statement from your business.

Will ChatGPT improve enough that we will not need to build anything?

The models will keep improving and the structural gap will not close, because it is not about capability. A chat product is started by a person and returns its answer to that person. Work that arrives on your customers' schedule and has to land inside your own systems needs something that runs when nobody is watching and keeps a record of what it did. Better models make that thing cheaper to build and better at the judgement inside it. They do not remove the need for it.

Related resources

Find out which of your work is worth building

We map where your time and money go, put a number on each one, and tell you what belongs in a chat window and what is worth building properly. Then our engineering team builds it and we run it for you from there.