Subjective Test for the Fast-forwarding-based Summarization [Part 2: Comparative Evaluation]
Introduction:
Welcome to the page of subjective test.
The main purpose is to summarize a video to a prespecified length with both video truncation and fast-forwarding. The results from three different methods are mixed and presented in a random order. Please view the videos in each group and answer the questions to help us finish a subjective test.
Please be sure to fill all questions before you move to the next group of videos. You are not allowed to move back to the previous page!
* Note that the main purpose of this subjective evaluation is to investigate the relevance of the proposed system in personalizing video summaries for satisfying various user preferences. Due to the limitation of network bandwidth, the videos are encoded in low bitrates. Hence, the video quality itself should be excluded from the following subjective evaluation of system performance.
Your Name:
Your Email Address:
Time you spent on Group 1:
Sec. (Esti. 7-min)
Time you spent on Group 2:
Sec. (Esti. 4-min)
Time you spent on Group 3:
Sec. (Esti. 8-min)
Time you spent on Group 4:
Sec. (Esti. 14-min)
Time you spent on Group 5.
Sec. (Esti. 8-min)
Time you spent on Group 6.
Sec. (Esti. 16-min)
[Group 1] Soccer Video (Compression Ratio 1/8)
Video 1
Video 2
Video 3
1. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
2. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
3. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
[Group 2] Surveillance Video 1 (Compression Ratio 1/8)
Video 1
Video 2
Video 3
4. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
5. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
6. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
[Group 3] Surveillance Video 2 (Compression Ratio 1/8)
Video 1
Video 2
Video 3
7. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
8. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
9. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
[Group 4] Soccer Video (Compression Ratio 1/4)
Video 1
Video 2
Video 3
10. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
11. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
12. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
[Group 5] Surveillance Video 1 (Compression Ratio 1/4)
Video 1
Video 2
Video 3
13. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
14. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
15. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
[Group 6] Surveillance Video 2 (Compression Ratio 1/4)
Video 1
Video 2
Video 3
16. Which video reproduces clearly most of the actions in the scene?
Video 1
Video 2
Video 3
17. Which video is most comfortable to watch (e.g. less flickering and intelligibility of events)?
Video 1
Video 2
Video 3
18. Which video presents the actions of interest with the most reasonable playback rates?
Video 1
Video 2
Video 3
Thank you very much for your kind help! Please press the "submit" button to submit your answers.
Maintained by chen-fan AT jaist.ac.jp. Last update 2013-01-21
