video browsing with        
Físchlár system is a web-based video indexing, analysis and browsing system. The user-interface of the system allows recording of TV broadcast programmes and browsing/watching of recorded programmes. (to find out more, visit Hyowon Lee)






Físchlár interface overview




Video browsing is Físchlár's main feature with automatically extracted images ("keyframes") from the recorded video displayed on the screen. Currently it provides 8 distinct different browsers that have different characteristics so that the user can use whichever suits him/her. Work is going on in identifying important attributes in keyframe browsing interfaces and developing a framework for better design and evaluation. Here is a simple taxonomy of the eight browsers:

Single Layer
(WITHOUT TIME)
Single Layer
(WITH TIME)
Double Layer
(WITHOUT LINK)
Double Layer
(WITH LINK)

Scroll Bar

Slide Show

Timeline Bar
(Default)

Quick Bar

Overview/ Detail

Quick Bar
+ Overview

Dynamic Overview

Hierarchical Browser






Quick glance of each Físchlár browser





  Timeline Bar browser
The idea of using timeline bar for video is not new and can be found in most video player software, but this simple bar is a very important element in keyframe browsing as well, because it provides temporal orientation by showing current point of browsing in relation to the whole video. Not only as a time indicator, the bar in this browser allows random access to the keyframes by allowing clicking on the bar.




Quick Bar browser  
This browser saves tedius and continuous clickings that Timeline Bar browser above requires. One sweep of the mouse and you've seen all the keyframes in the video. Much finer control and continuous, immediate response from the system is what 'direct manipulation' is about. Browsing task is less of an 'act-and-react' of disjointed interaction, and becomes more natural and paced on the user. Many video games are fun basically because of this kind of immediate reaction as s/he steers the character in the virtual space.



  Scroll Bar browser
The first version of Físchlár had only this browser - all the keyframes on one long page, taking ages to scroll down. But scroll bar is a very versatle controller: clicking arrow moves the page by each row of keyframes, clicking on the empty bar jumps the page by screenful, and dragging the square object provides immediate and continuous movement of keyframes thus allowing finer and more pleasant experience. Other than slow-loading problem (which is a technical problem I am not much concerned), time-distortion is the problem with scroll bar - our shot boundary detection might have detected much more shots in the beginning part than the end part, producing much more keyframes in the beginning part, thus e.g. the middle of the long page doesn't acurately represent the middle of the video (timeline bar does).







Overview/Detail browser  
Taking in the idea of "Overview first, zoom and filter, then details on demand", this browser's initial screen shows smaller size keyframes selected from whole through the video - this provides rough idea on what the video is about. Double-layered timeline bar at the top can be clicked to navigate between segments.






  Overview/Detail + Quick Bar browser
This browser is a combination of Overview/Detail browser and Quick Bar browser. Basically same idea as Overview/Detail browser, but moving into detail view is done by option button. Once in detail view, Quick Bar is used for immediate system reaction and finer control in browsing. A reasonable arrangement.




Slide Show browser  
This browser flips through all keyframes in a single slot. Temporally presenting keyframes (rather than spatially) saves screen space considerably, thus useful to be used in small devices. People with more dynamic interaction preference may also like this browser. It is important to provide some form of temporal orientation in this kind of temporal presentation, in this case timeline bar is used. Others called this presentation as "keyframe-based playback (Maryland HCIL)", "moving icon (WebSEEk)", "timed playback of keyframes" or "dynamic thumbnail", etc.




  Dynamic Overview browser
This browser combines Slide Show and Overview idea - initially an overview page is displayed, and when mouse is over one of the keyframes it Slide Shows detail keyframes within that keyframe. It uses small yellow points to indicate current point of the viewed keyframe. No change from a page to another is needed, while still full list of keyframes viewable. Combining spatial and temporal presentation resulted in this novel browser.




Hierarchical browser  
Hierarchical video browsing interface was first suggested by Apple as "hierarchical video magnifier", later addressed in CAETI Internet Library (Princeton University) and interactive version implemented in SWIM system (KRDL, Singapore). Although this method of hierarchical keyframe browsing is mentioned quite often in literature, it is difficult to find any real working example anywhere. The browser allows break-down display of keyframes in highly interactive way (i.e. quick response) and worth a good consideration.







CENTRE FOR
DIGITAL VIDEO PROCESSING