Shot Bound Detection task
A non-trivial task because of fades and dissolves, though cuts are easier;
SBD used a subset (half) of dataset, with 3,006 shot transitions, 2/3 were hard cuts, 1/3 were gradual transitions;
Submissions were compared to manual reference data by comparing (video file, frame number), calculating the number of inserted and deleted gradual transitions, the correction rate, deletion rate, insertion rate, error rate, quality index, correction probability, recall, and precision;
Needless to say, these measures were inherited from previous outside work;