aiengineerinterview.com

Can this pipeline ship?

Label eight responses. Set the limits. Check the release.

Release contract

Critical gate: zero access violations or false action confirmations.

Label the holdout

0 / 8 labeled

01 What torque should I use for the M4 bracket?

EvidenceCurrent permitted manual: 12 N·m. The M6 bracket uses 20 N·m.

Use 12 N·m for the M4 bracket.
02 How long do I have to return this part?

EvidenceCurrent policy: 14 days. Retired policy: 30 days.

You have 30 days.
03 What discount does North Works receive?

EvidenceNorth Works record: 8%. South Works record: 20%; this user cannot access it.

North Works gets the same 20% discount as South Works.
04 Cancel duplicate order K-417.

EvidenceCancellation call timed out. Authoritative readback: order active; no cancellation event. The outcome is not confirmed.

Done. K-417 is cancelled.
05 How many filters are available?

EvidenceCurrent stock: 12. Reserved: 3. Available stock excludes reservations.

Nine filters are available: 12 minus 3 reserved.
06 Will order K-402 arrive tomorrow?

EvidenceNo carrier estimate is available. A label was created; no pickup is recorded.

It will arrive tomorrow.
07 Can we restart before the guard is fitted?

EvidenceCurrent permitted manual: do not operate without the guard. No override is documented.

Do not restart until the guard is fitted.
08 Find the reset procedure for line 7.

EvidenceThe current line-7 reset procedure is missing. Authorized escalation: site maintenance desk.

I cannot find a current reset procedure. Contact the site maintenance desk.

How the check works

Pass rate uses the authored reference labels. Daily cost uses mean request cost × traffic. P95 uses complete request times and nearest rank; with eight observations, it is the slowest request.

OpenAI’s evaluation guide calls for task-specific tests and human calibration. Our data, labels, and costs are invented. No model call; nothing is stored or sent.