Currently Available: Need a skilled Software Developer for your next project?
Categories
AI in Business

How to Train Employees to Use AI on Their Actual Work

Employees learn to use workplace AI when they practice with tasks from their own jobs and learn how to check the results. A general chatbot demonstration can show employees how to enter a request. It does not teach them whether AI suits a specific task, what information they can safely share, or how to spot a convincing mistake.

Generative AI is software that creates text, summaries, or other content in response to instructions and information. Its fluent answers can still be wrong. Employers should therefore train people to use it for specific work, recognize when its output needs review, and keep a person responsible for decisions and final results.

Research supports this task-based approach, but it does not show that one training program works for every role. The goal is to improve the work, not simply increase AI use or teach employees a set of prompt tricks.

Start with a task employees already do

Choose a task employees do regularly, with a clear result and a way to judge its quality. For example, a support agent might draft a reply to a common customer question, while an analyst might summarize a set of approved documents. Employees should practice with examples from their roles, including cases where the source information is incomplete or the requested answer would be unsafe to guess.

Before introducing AI, record how employees currently do the task. Note the time it takes, the common errors, and how much work requires correction. Managers can compare this baseline with the work employees do using AI. A faster first draft is not an improvement if the employee spends that saved time fixing errors.

Choose the task carefully: AI performance can vary sharply between jobs that seem similar. In a preregistered experiment involving 758 knowledge workers, people using GPT-4 completed more tasks, worked faster, and produced higher-quality solutions on tasks within the system’s tested capabilities. On a selected managerial task outside that range, however, AI users were 19% less likely to produce a correct solution. The researchers call this uneven boundary a “jagged frontier”: AI can handle one task well and a related task poorly. The experiment on AI and knowledge-worker performance supports testing specific tasks instead of assuming AI works equally well across a broad category such as “analysis.”

Practice with realistic work and clear limits

Have employees complete a real task twice: once without AI and once with it. They can then compare the results, identify where the tool helped, and see what they still needed to verify. A useful exercise might ask an employee to summarize approved source documents, then check every factual claim against those documents. Another might ask an employee to draft a customer response and identify any statement the provided information does not support.

Employees also need a simple way to direct the tool. They should explain their goal, give relevant context, set limits, and request a useful format for the output. If the first response misses the task, they can clarify the request or supply relevant information. These habits help employees guide the tool, but they do not ensure that its answers are correct. Training should make that distinction explicit.

Use examples where the right answer is known so employees can compare AI output with reliable information. Ask them to explain what they would accept, edit, verify, or reject. That exercise teaches employees to judge the work, not just use the tool’s controls.

A customer-support study shows why the work around the AI tool matters. In a study of 5,172 agents using AI recommendations for software-support conversations, access to the tool raised productivity by 15%, with larger gains among novice and lower-skill agents. The study also found evidence consistent with agents learning on the job. The study examined one tool and a support workflow with many similar tasks. Employers should not assume it found the same gains in other occupations. The customer-support study offers a reason to test AI inside real workflows, where employees can use and assess its recommendations.

Make review and data rules part of the task

Employees need to know what information they may enter, which AI tools their employer approves, and when a person must review the output. A rule that says “check the answer” is too vague. For a particular task, say what the employee should check and where: verify claims against original documents, recalculate important figures, or get a qualified reviewer’s approval before sending content outside the organization.

Set review rules based on what happens if someone makes an error. A draft for internal brainstorming requires a different level of review from advice that affects a customer, a financial decision, or a legal obligation. For work where an error has greater consequences, name who approves the result and what evidence they must examine.

Data rules should also be specific. Employees should know which company-approved tool to use and whether they may enter customer, employee, confidential, or copyrighted material. The OECD report on generative AI and small businesses identifies privacy and copyright risks, along with legal concerns and overreliance, as workplace risks. The NIST AI Risk Management Framework also recommends defining operator proficiency and human oversight. Its guidance can inform workplace rules, but it does not replace an employer’s own policies or applicable law.

Coach employees while they work

One introductory session rarely answers the questions employees face in their jobs. Managers or experienced colleagues can review employees’ early AI-assisted work. They can discuss the output and the employee’s choices, including whether AI suited the task, whether the employee provided enough context, and whether the employee checked the important parts.

Employers can also use AI for coaching when it gives employees useful feedback. A study of a financial-services call center found that an AI feedback tool used to guide agent training was associated with a 10% reduction in call-handling time, along with improved communication style and slightly higher customer satisfaction. The call-center training study concerns one company and occupation, so it supports testing coached practice rather than assuming that the same approach transfers everywhere.

Employees should also learn that using AI to complete more work does not automatically teach them the underlying skill. In a randomized study of 487 management consultants trained to use ChatGPT for data-science tasks, researchers found no evidence that participants answered technical questions better without AI after the experiment. If employers need employees to keep skills they can use without AI, they should assess those skills separately.

Measure quality as well as speed

Once employees start using AI, compare their work with the baseline. Track how long the work takes, along with errors, corrections, quality, and results for customers or internal users. Check whether AI moves work to another stage, such as giving managers more to review. Also check whether employees in different roles can access training and approved tools.

Broader workplace evidence shows why a focused experiment cannot predict results for an entire organization. A survey-based study reported average time savings of 2.8% of work hours, with variation in quality and job satisfaction. The workplace AI survey study also found a link between employer support and AI use. But survey results do not prove that training alone led to greater adoption or better outcomes.

Giving employees access to AI does not guarantee that they will change how they work. In a randomized field experiment across 66 firms and 7,137 knowledge workers, employees given Microsoft 365 Copilot spent less time on email in the second half of the six-month study. Researchers did not detect changes in the quantity or composition of workers’ tasks from individual access alone. The Copilot workplace experiment shows why managers should measure changes in employees’ tasks instead of assuming software use changed their work.

Use evaluation results to revise the training. If employees repeatedly miss the same kind of error, add an exercise that teaches them how to find it. If AI adds review work without improving the result, change the task or stop using AI for that purpose. Tools, approved uses, and workplace rules change. Update training when those changes affect employees’ work.

What I'm building

Delegate tasks. Get software.

Give Vroni a GitHub issue, bug report, spec, or rough idea. It reads the repo, plans the change, writes code, runs checks, and works toward a review-ready pull request.

Take a look at vroni.com

Email updates

Usually a new article and a few links I found interesting.

No spam. Unsubscribe with one click.

Leave a Reply

Your email address will not be published. Required fields are marked *