One of the biggest challenges of spatio-temporal querying is the difficulty of setting up user queries. Since users need to provide both spatial and temporal information for different time instants, getting such information is not simple.
Firstly, we need a proper index structure for fast retrieval of data from the database. We have developed Semantic Sequence State Graph (S3G) for spatio-temporal indexing. The spatial context is limited. Objects move their positions on spatial context and these movements might be results of some actions. S3G can effectively index such databases. We have applied S3G on tennis video databases.
There are two aspects of Query-by-Gaming: 1) finding relevant clips and showing those clips to the user as inputs from a gaming controller is taken, and 2) finding clips that meet the criteria of of the user. The queries can be provided in a sequential mode or eventual mode. These modes are based on linear temporal logic. For sequential mode, 'next' operator is used. For the eventual mode, 'eventually' operator is used.