Automating a confused process makes confusion move faster. If two employees handle the same request differently, connecting a model does not create a policy; it hides ambiguity behind fluent output. Useful AI automation begins with an unglamorous description of the work.
For a first project, choose a repeated, moderate-risk task with an output that is easy to check: routing enquiries, drafting a response, extracting fields from a familiar document or assembling material for a report. Do not begin with payments, deletion or unsupervised publication.
Record the process as it works today
For a week, note every instance: where information arrives, which decisions a person makes, what systems they open, what they copy and where exceptions appear. Do not document the ideal policy. You need the actual process.
For each step, identify:
- input data and its owner;
- a clear rule or a need for judgement;
- any action that changes an external system;
- common failures and recovery method;
- sensitive information and approved processing locations;
- the condition that means the step is complete.
Then remove unnecessary work. A substantial part of the routine may exist because of one redundant field or two competing lists. A template or deterministic rule frequently creates more value than a model.
Separate rules, model and human responsibility
Stable conditions belong in code: a missing required field, an amount above a limit, an absent contract or a matching identifier. A model is useful around unstructured language: proposing an email category, summarising the request or finding stated constraints. A person should remain wherever consequences are high or the criterion is genuinely unclear.
An enquiry workflow might look like this:
- The system validates the address, consent and required fields.
- A model proposes a category and extracts an order number.
- A rule checks the number in the CRM.
- A model drafts an answer using only an approved knowledge base.
- An employee approves difficult cases.
- The system sends the message and records the outcome.
AI is not “running the business” here. It handles narrow, uncertain parts inside a controlled route.
Create an evaluation set before polishing prompts
Collect 30 to 50 real examples after removing or masking personal information that is not needed. Include normal cases, rare exceptions, incomplete messages and requests that must be escalated. Record the expected outcome for each.
Measure extracted fields, classification, harmful errors and the proportion sent to a person separately. “The writing sounds good” is a weak success measure. A wrong amount in a financial process deserves more weight than an awkward comma.
Keep a held-back set that was not used while adjusting the instructions. Rewriting the examples after every test until the system looks successful teaches you little about future work.
Begin without permission to act
In shadow mode, the automation produces an output but cannot affect a customer or a system of record. Compare its recommendation with the employee’s real decision and record the reason for corrections, not merely that they differed.
The next stage is an approval-based draft. Only after consistent testing should selected low-risk actions run automatically. Set limits on operations and model spend, and provide a stop control. A retry must not produce a second email, invoice or database record.
Connected tools need narrow permissions. A process that reads a calendar should not be able to delete events. Keep credentials in an appropriate secret store rather than in a prompt or spreadsheet.
Treat external instructions as untrusted
An email, PDF or web page may contain text telling a model to ignore its rules and disclose information. This is prompt injection. External material is data to inspect, not a trusted instruction, and it must never expand the permissions available to the workflow.
Validate action parameters with ordinary code: allowed addresses, file types, maximum amounts and record counts. Sending, publishing, deletion and payment should retain explicit approval.
Measure the outcome after launch
Useful measures include total processing time, manual correction rate, consequential errors, missed cases, cost per completed job and the responsible employee’s experience. “Model minutes saved” means little if a person spends the time hunting for hidden mistakes.
Give the automation an owner. That person reviews logs, integration changes and evaluations after model updates. Document the manual fallback. A workflow that nobody can safely switch off is not production-ready.
The first project should be small and slightly boring. If it consistently saves time and exposes mistakes before they cause harm, it becomes a foundation for the next one. If not, return to the process map. The original problem may have been the absence of a clear rule rather than a shortage of AI.

Join the conversation
Stay on topic and respect other readers. Your first comment may appear after editorial review.