openai/whisper-large-v3

automatic-speech-recognitiontransformersapache-2.01.5B params · updated Aug 2024

Mainframe serving

Can a COBOL transaction program call this checkpoint, and under which transport? The model returns evidence; the host keeps the decision.

Export status

Directly exportable

Standard PyTorch or Transformers weights; the export runs clean

Recommended pattern

Pattern 03

Message queue

Latency class

Async

ONNX artifact

Not measured

measured once the harness posts results

Screening note

Scored in batch by a GPU consumer pool; the batch window, not the model, sets the deadline.

automatic-speech-recognition inputs do not originate in a transaction record; route through the queue

Internal network only; durable queue inside the perimeter

Standard architecture WhisperForConditionalGeneration with transformers weights

osai-screening/1.0.0 · verdict a3538d5e4be32c8d…

Serving controlskill switch offshadow onconfidence floor 0.85GET /serving-status

Promotion gates

Gate	What it checks	State
Structural check	Graph loads; node inputs, outputs and shapes resolve	Not run
Numerical parity	Same inputs agree with the source framework within 1e-4	Not run
Eight-bit quantisation	INT8 weights with parity re-run afterwards	Not run
Shadow cycle	Full cycle scored against live traffic with no influence on outcomes	Not run

Interface contract

The copybook is generated, versioned and never hand-edited on either side. Entry point SCORE_WHISPER_LARGE_V3.

Generated copybookmodel record · contract

      * GENERATED BY osai-copybook-gen/1.0.0 — DO NOT EDIT (STANDARD S2)
      * COPYBOOK FOR openai/whisper-large-v3
      * REVISION 06f233fe06e7  PATTERN 03  ENTRY SCORE_WHISPER_LARGE_V3
       01  SCORE-WHISPER-LARGE-V3-REQUEST.
           05  REQ-RECORD-ID          PIC X(12).
           05  REQ-AMOUNT             COMP-2.
           05  REQ-CODE               PIC S9(9) COMP-5.
           05  REQ-HISTORY-COUNT      PIC S9(9) COMP-5.
       01  SCORE-WHISPER-LARGE-V3-RESPONSE.
           05  RESP-SCORE             COMP-1.
           05  RESP-CONFIDENCE        COMP-1.
           05  RESP-LABEL             PIC X(16).
           05  RESP-MODEL-VERSION     PIC X(16).
           05  RESP-STATUS            PIC S9(4) COMP-5.

SCORE-WHISPER-LARGE-V3-REQUEST / OsaiRequest28 bytes

COBOL	C	Kind	Offset	Bytes	Note
REQ-RECORD-ID	record_id	alnum(12)	0	12	caller correlation key, logged with the inference
REQ-AMOUNT	amount	float64	12	8	feature: amount as COMP-2, converted from PIC 9(7)V99 by the caller
REQ-CODE	code	binary32	20	4	feature: categorical code
REQ-HISTORY-COUNT	history_count	binary32	24	4	feature: prior record count

SCORE-WHISPER-LARGE-V3-RESPONSE / OsaiResponse42 bytes

COBOL	C	Kind	Offset	Bytes	Note
RESP-SCORE	score	float32	0	4	model output; evidence, not a decision
RESP-CONFIDENCE	confidence	float32	4	4	compared against the confidence floor by the host
RESP-LABEL	label	alnum(16)	8	16	e.g. REVIEW or APPROVED — never DENY
RESP-MODEL-VERSION	model_version	alnum(16)	24	16	revision that produced the score (standard S4)
RESP-STATUS	status	binary16	40	2	0 scored · 4 below floor · 8 transport or runtime failure — 4 and 8 fall through to host rules

CLAIMPROC.cob — the callergenerated by the screening service

       IDENTIFICATION DIVISION.
       PROGRAM-ID. OSAICALL.
       DATA DIVISION.
       WORKING-STORAGE SECTION.
           COPY OSAICPY.
       77  CONFIDENCE-FLOOR     COMP-1 VALUE 0.85.
       PROCEDURE DIVISION.
           CALL "MQPUT" USING HCONN, HOBJ, MD, PMO,
             LENGTH OF SCORE-WHISPER-LARGE-V3-REQUEST, SCORE-WHISPER-LARGE-V3-REQUEST, COMPCODE, REASON
           IF COMPCODE NOT = 0
             PERFORM LOG-MQ-FAILURE
           END-IF
      *    PASS 2 READS SCORED ROWS AND APPLIES THE SAME EVALUATE
           GOBACK.

The C-ABI wrapper is on the Usage tab under “C bridge”. Test the bridge on a workstation with GnuCOBOL before it reaches an LPAR — struct packing and numeric conversion are what actually break, and they are identical on both targets.

Standards this deployment inherits

Download ML-BOM

S1Models ship as ONNX artifacts. No ML framework runtime is installed on z/OS.

S2The copybook is the interface contract — generated, versioned, never hand-edited on either side.

S3Latency class selects the pattern. Team preference and vendor enthusiasm do not.

S4Every inference is logged with the record state and model version that produced it.

S5PHI leaves the platform only tokenized, over mTLS, to an endpoint under an executed BAA.

S6A model influences payment only after a full shadow cycle and with a tested fallback path.