Skip to content
FlowScript templates

Visual inspection ablation

Compare removals from a surface defect detector, from illumination normalisation to uncertainty routing, against its fixed baseline; illustrative deltas are not measured performance or causal evidence. Typed FlowScript for machine-learning evaluation. Keywords: ablation, benchmark, evaluation, model comparison.

Template previewFlowScript
ABLATION STUDY · ILLUSTRATIVE BOUNDED QUALITY SCORE; HIGHER IS BETTERbaseline_eval — baseline 0.820#CHANGEΔ vs BASESCORE1Remove hard-negative trainingvariant_3−0.0900.7302Remove augmentationvariant_1−0.0700.7503Remove multiscale featuresvariant_2−0.0550.7654Remove illumination normalisationvariant_0−0.0400.7805Remove uncertainty routingvariant_4−0.0300.790

What this template contains

Source
46 lines

Make it your own.

// Compare removals from a surface defect detector, from illumination normalisation to uncertainty routing, against its fixed baseline; illustrative deltas are not measured performance or causal evidence.
// Synthetic worked example: all entities, schedules and measurements are illustrative.
// Every string below is EXAMPLE text from a fictional model: replace it.
// Replace assumptions and inputs before applying this model to actual work.

model baseline_model {
  title: "Illustrative Surface defect detector"
  params: 12000000
  family: "Research prototype"
}

dataset evaluation_set {
  title: "Synthetic Held-out production batches"
  n: 500
  split: "held-out"
}

eval baseline_eval {
  model: baseline_model
  dataset: evaluation_set
  metric: "Illustrative bounded quality score; higher is better"
  score: 0.82
}

ablation variant_0 {
  base: baseline_eval
  delta: -0.04
  change: "Remove illumination normalisation"
}

ablation variant_1 {
  base: baseline_eval
  delta: -0.07
  change: "Remove augmentation"
}

ablation variant_2 {
  base: baseline_eval
  delta: -0.055
  change: "Remove multiscale features"
}

ablation variant_3 {
  base: baseline_eval
  delta: -0.09
  change: "Remove hard-negative training"
}

ablation variant_4 {
  base: baseline_eval
  delta: -0.03
  change: "Remove uncertainty routing"
}

view variants: ablation_table(baseline_eval)