AI Literacy & Prompting Module 2
What AI does well and where it fails interview questions
Interview questions on what AI does well and where it fails: warm-ups, then what each harder question tests and how a good answer starts.
Warm-up questions
Short questions with short answers, each answered in full.
-
Fresher to mid
Which tasks can you usually hand to an AI tool, and which need close checking?
-
Fresher to mid
What is an AI hallucination, and why does NIST call it confabulation?
Answered in the lesson Hallucinations: why AI makes things up
-
Fresher to mid
What is sycophancy in an AI assistant, and how can you tell it is happening?
Answered in the lesson Sycophancy: when AI agrees too easily
-
Fresher to mid
What does a reasoning mode do differently from a standard chat mode, and when is it worth using?
Answered in the lesson Reasoning models: what 'thinking' changes
Questions with model answers
What each question tests, the first step of a good answer and the follow-ups to expect.
-
Fresher to mid
A colleague used a chat app to total 40 invoice amounts for a vendor payment, and the total was wrong. Explain why such slips happen, and set a rule for when your team may use AI with numbers.
- What it tests
- Why exact arithmetic slips in a model that predicts tokens, how a code tool differs from the model, and checks that fit numbers.
- First step
- Say what the model did: unless the app ran code, it wrote a likely-looking total token by token without adding anything. Recompute the total in a spreadsheet and compare it with the payment before anything is sent, then look at how the slip got past the team.
- Follow-ups
-
- The app showed its working step by step. Is that enough?
- Which number tasks would you still allow?
- How would you check 40 amounts quickly?
From the lesson What AI does well and where it slips
Model answer, Pro. Model answers open with any pass; prices are in the notice on this page.Opening the model answers with your pass…
Model answers open with any MySmartCoPilot pass.
- Pro pass · 1 week₹79$2.99
- 30 days₹179$5.99
- 1 year₹1,699$45
One payment; a pass never renews. The price shown is the total you pay: no fees or charges are added at checkout.
Passes can’t be bought right now, so the model answers can’t be opened at the moment. If you have a pass, enter your licence key.
It also opens every other in-depth part in Learn and every Pro tool. Sales are final, except where the law gives you a right to withdraw, for example in the EU and the UK (refund policy).
In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Mid to senior
Your college wants a chatbot to answer students' questions about fees, deadlines and bus timings. Which questions would you let it answer, and how would you keep its answers correct?
- What it tests
- Recognising rare, recent and local facts as weak spots, answering from the college's own current documents, and keeping those answers up to date.
- First step
- Sort the questions by how they fail. Fees, deadlines and timings are local, change every term and appear in few documents, so the bot should answer them only from the college's own current notices, quote and link the notice, and say so when it has none.
- Follow-ups
-
- The fee notice changes in the middle of a term. What breaks?
- A student asks about a scholarship rule that no document covers. What should the bot say?
- How would you test the bot before launch?
From the lesson What AI does well and where it slips
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Fresher to senior
A junior colleague's draft legal note cites three judgments found with a chat app, and one of them cannot be found anywhere. What do you do with the note, and what checking rule do you set for citations from now on?
- What it tests
- The three forms of fake sources, why existence alone is not enough, and a citation check that a team will actually follow.
- First step
- Stop the note and treat all three citations as unverified, not just the missing one. Find each judgment in an official or trusted law report, read the paragraph cited, and check every quotation word for word; the two that exist can still be misrepresented or misquoted.
- Follow-ups
-
- The two judgments you found are real. Are you done?
- The deadline is today. What is the minimum check?
- How do you raise this with the colleague without discouraging AI use?
From the lesson Hallucinations: why AI makes things up
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Mid to senior
Your support assistant answers customers from your product manuals, yet it sometimes describes features the product does not have. How do you make such answers rarer, and how do you measure whether your changes worked?
- What it tests
- Grounding answers in documents, allowing "I don't know", quotes that can be checked, and measuring hallucination on a fixed test set rather than by impression.
- First step
- Collect the wrong answers first and sort them: features from no manual at all, features of another product or version, and quotes the manuals do not contain. Each kind points to its own fix, and the collection becomes the start of a test set.
- Follow-ups
-
- Customers prefer answers that never say "I don't know". What now?
- How large should the test set be, and what goes in it?
- The manuals themselves are out of date. What changes?
From the lesson Hallucinations: why AI makes things up
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Fresher to mid
A manager's AI assistant called her project proposal "excellent", but the review panel rejected it for missing costs and risks. Why might the assistant have praised it, and how would you get honest feedback on the next draft?
- What it tests
- Feedback sycophancy and the cues that cause it, and prompts that ask for criticism against criteria rather than for praise.
- First step
- Look at how the feedback was asked for. If the request said she had worked hard on it or was pleased with it, the assistant had a cue to praise. Then rewrite the request around the panel's own criteria, costs and risks among them, and ask for the weakest parts first.
- Follow-ups
-
- The new feedback is now harsh about everything. Is that better?
- Should she ask the assistant to role-play the review panel?
- How do you know when AI feedback on a draft is good enough to rely on?
From the lesson Sycophancy: when AI agrees too easily
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Mid to senior
In a planning meeting, a team lead pushed back on an AI tool's demand forecast, and the tool changed its number at once. How should the team treat the two numbers, and what process would you put in place?
- What it tests
- Recognising sycophancy under pushback, why a changed answer is not evidence, and a team process that settles disputed numbers outside the chat.
- First step
- Treat both numbers as unchecked: the second answers the lead's pushback, not new data. Ask what the forecast was built from, recompute it from that data with a method the team can inspect, and decide only on the recomputed figure.
- Follow-ups
-
- The lead's number turns out to be right this time. Does that change anything?
- Can you stop the tool from changing its answers?
- Where in the process should AI estimates appear at all?
From the lesson Sycophancy: when AI agrees too easily
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Mid to senior
A teammate accepts an AI tool's eligibility decision on a loan application because its displayed reasoning "looks sound". Explain why that is not enough, and what you would check instead.
- What it tests
- The faithfulness of shown reasoning, checking an answer through the facts and rules it depends on, and keeping people accountable for decisions about others.
- First step
- Separate the decision from the reasoning on screen. Research found reasoning models mentioned a hint that had decided their answer in only a quarter to two fifths of cases, so a sound-looking chain proves little. Check the inputs, each eligibility rule and the arithmetic yourself, against the lender's written policy.
- Follow-ups
-
- The reasoning cites the right policy clause. Does that settle it?
- What would you record for an audit?
- Should the tool make such decisions at all?
From the lesson Reasoning models: what 'thinking' changes
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
-
Mid to senior
Your team wants a reasoning mode switched on for every request in a customer support tool. How would you decide whether that is worth it, and what would you measure?
- What it tests
- Where thinking helps and where it does not, its cost in time and tokens, and a fair comparison on the team's own requests.
- First step
- Sort a sample of real requests by type. Simple questions and rewording gain little from thinking, while multi-step cases, such as a refund under several rules, can gain a lot; every thinking token adds time and counts against the allowance, so cost each type before deciding.
- Follow-ups
-
- Customers complain that replies are slow. What now?
- How would you route requests to the right mode automatically?
- The reasoning mode scores higher on your test set. Is that the end of it?
From the lesson Reasoning models: what 'thinking' changes
Model answer, Pro.In the answer:
- Model answer
- Follow-up answers
- Common mistakes
- Rubric
- Variants
- about 3 minutes
All AI Literacy & Prompting interview questions · The AI Literacy & Prompting track