The rank each input must have, in order, where it matters. Checked before shape runs,
because an operator reading an image as [channels, height, width] reads a value with one more
axis as its first three and validates it — and then declares an output it fills only part of.