Abstract
In multi-agent scenarios such as sports videos, multiple actions are played by different players. Such actions do not necessary appear strictly sequentially but can happen in parallel. Approaches which only consider a single stream of actions are not competent to handle such scenarios. The temporal and causal relationships between the action streams such as “concurrence”, “mutually exclusion” and “triggering” need to be captured so as to correctly recognize the actions. In this paper, a novel method is presented for action recognition in multi-agent scenarios leveraged by analyzing the relationships among the temporal contextual actions. The multi-streams of actions are modeled by a Dynamic Baysian Network (DBN) containing several temporal processes corresponding to each type of action. Comparing to the Coupled Hidden Markov Model (CHMM), only the necessary interlinks between the temporal processes are built by a structure learning algorithm to capture the salient relationships. Empirical results on real-world video data demonstrate the effectiveness of our proposed method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Brand, M., Oliver, N., Pentland, A.: Coupled hidden markov models for complex action recognition. In: CVPR Conference Proceedings (1997)
Brendel, W., Fern, A., Todorovic, S.: Probabilistic event logic for interval-based event recognition. In: CVPR Conference Proceedings (2011)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR Conference Proceedings, pp. 886–893 (2005)
Dalal, N., Triggs, B., Schmid, C.: Human detection using oriented histograms of flow and appearance. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 428–441. Springer, Heidelberg (2006)
Hongeng, S., Nevatia, R.: Multi-agent event recognition. In: ICCV Conference Proceedings, pp. 84–91 (2001)
Korb, K., Nicholson, A.: Bayesian Artificial Intelligence. Chapman and Hall/CRC (2004)
Kratz, L., Nishino, K.: Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: CVPR Conference Proceedings (2009)
Lv, F., Nevatia, R.: Recognition and segmentation of 3-D human action using HMM and multi-class adaBoost. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 359–372. Springer, Heidelberg (2006)
Ryoo, M.S., Aggarwal, J.K.: Recognition of composite human activities through context-free grammar based representation. In: CVPR Conference Proceedings (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhang, Y., Zhang, C., Tang, Z., Lu, H. (2013). Temporal Context Analysis for Action Recognition in Multi-agent Scenarios. In: Huet, B., Ngo, CW., Tang, J., Zhou, ZH., Hauptmann, A.G., Yan, S. (eds) Advances in Multimedia Information Processing – PCM 2013. PCM 2013. Lecture Notes in Computer Science, vol 8294. Springer, Cham. https://doi.org/10.1007/978-3-319-03731-8_71
Download citation
DOI: https://doi.org/10.1007/978-3-319-03731-8_71
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03730-1
Online ISBN: 978-3-319-03731-8
eBook Packages: Computer ScienceComputer Science (R0)