DI

distilbert/distilbert-base-uncased-finetuned-sst-2-english

text-classificationtransformersapache-2.070M params · updated Dec 2023

Mainframe serving

Can a COBOL transaction program call this checkpoint, and under which transport? The model returns evidence; the host keeps the decision.

Export status
Already ONNX
Published with ONNX artifacts — no export step required
Recommended pattern
Pattern 01
Co-located in-memory
Latency class
< 2 ms
ONNX artifact
Not measured
measured once the harness posts results
Screening note

Compiled graph executes in the same address space as the COBOL program. No network hop; the host keeps the decision.

Static graph, per-record text-classification output and 67M parameters fit a co-located sub-2 ms call

Zero egress — data stays inside the encrypted boundary

  • ONNX artifact present: onnx/model.onnx
osai-screening/1.0.0 · verdict 048b004410317deb…
Serving controlskill switch offshadow onconfidence floor 0.85GET /serving-status

Promotion gates

GateWhat it checksState
Structural checkGraph loads; node inputs, outputs and shapes resolveNot run
Numerical paritySame inputs agree with the source framework within 1e-4Not run
Eight-bit quantisationINT8 weights with parity re-run afterwardsNot run
Shadow cycleFull cycle scored against live traffic with no influence on outcomesNot run

Interface contract

The copybook is generated, versioned and never hand-edited on either side. Entry point SCORE_DISTILBERT_BASE_UNCA.

Generated copybookmodel record · contract
      * GENERATED BY osai-copybook-gen/1.0.0 — DO NOT EDIT (STANDARD S2)
      * COPYBOOK FOR distilbert/distilbert-base-uncased-finetuned-sst-2-english
      * REVISION 714eb0fa89d2  PATTERN 01  ENTRY SCORE_DISTILBERT_BASE_UNCA
       01  SCORE-DISTILBERT-BASE-UNCA-REQUEST.
           05  REQ-RECORD-ID          PIC X(12).
           05  REQ-TEXT-LEN           PIC S9(4) COMP-5.
           05  REQ-TEXT               PIC X(512).
       01  SCORE-DISTILBERT-BASE-UNCA-RESPONSE.
           05  RESP-SCORE             COMP-1.
           05  RESP-CONFIDENCE        COMP-1.
           05  RESP-LABEL             PIC X(16).
           05  RESP-MODEL-VERSION     PIC X(16).
           05  RESP-STATUS            PIC S9(4) COMP-5.
SCORE-DISTILBERT-BASE-UNCA-REQUEST / OsaiRequest526 bytes
COBOLCKindOffsetBytesNote
REQ-RECORD-IDrecord_idalnum(12)012caller correlation key, logged with the inference
REQ-TEXT-LENtext_lenbinary16122bytes used in REQ-TEXT
REQ-TEXTtextalnum(512)14512de-identified text; tokenized inside the graph
SCORE-DISTILBERT-BASE-UNCA-RESPONSE / OsaiResponse42 bytes
COBOLCKindOffsetBytesNote
RESP-SCOREscorefloat3204model output; evidence, not a decision
RESP-CONFIDENCEconfidencefloat3244compared against the confidence floor by the host
RESP-LABELlabelalnum(16)816e.g. REVIEW or APPROVED — never DENY
RESP-MODEL-VERSIONmodel_versionalnum(16)2416revision that produced the score (standard S4)
RESP-STATUSstatusbinary164020 scored · 4 below floor · 8 transport or runtime failure — 4 and 8 fall through to host rules
CLAIMPROC.cob — the callergenerated by the screening service
       IDENTIFICATION DIVISION.
       PROGRAM-ID. OSAICALL.
       DATA DIVISION.
       WORKING-STORAGE SECTION.
           COPY OSAICPY.
       77  CONFIDENCE-FLOOR     COMP-1 VALUE 0.85.
       PROCEDURE DIVISION.
           CALL "SCORE_DISTILBERT_BASE_UNCA" USING SCORE-DISTILBERT-BASE-UNCA-REQUEST, SCORE-DISTILBERT-BASE-UNCA-RESPONSE
             ON EXCEPTION MOVE 8 TO RESP-STATUS
           END-CALL
           EVALUATE TRUE
             WHEN RESP-STATUS NOT = 0
               PERFORM APPLY-EXISTING-HOST-RULES
             WHEN RESP-CONFIDENCE < CONFIDENCE-FLOOR
               PERFORM APPLY-EXISTING-HOST-RULES
             WHEN RESP-LABEL = 'REVIEW'
               PERFORM HOLD-FOR-REVIEW
             WHEN OTHER
               PERFORM CONTINUE-ADJUDICATION
           END-EVALUATE
           PERFORM WRITE-AUDIT-RECORD
           GOBACK.

The C-ABI wrapper is on the Usage tab under “C bridge”. Test the bridge on a workstation with GnuCOBOL before it reaches an LPAR — struct packing and numeric conversion are what actually break, and they are identical on both targets.

Standards this deployment inherits

Download ML-BOM
S1Models ship as ONNX artifacts. No ML framework runtime is installed on z/OS.
S2The copybook is the interface contract — generated, versioned, never hand-edited on either side.
S3Latency class selects the pattern. Team preference and vendor enthusiasm do not.
S4Every inference is logged with the record state and model version that produced it.
S5PHI leaves the platform only tokenized, over mTLS, to an endpoint under an executed BAA.
S6A model influences payment only after a full shadow cycle and with a tested fallback path.