iBet uBet web content aggregator. Adding the entire web to your favor.
iBet uBet web content aggregator. Adding the entire web to your favor.



Link to original content: https://unpaywall.org/10.1007/S11227-019-03117-9
Leveraging knowledge-as-a-service (KaaS) for QoS-aware resource management in multi-user video transcoding | The Journal of Supercomputing Skip to main content
Springer Nature Link
Log in

Leveraging knowledge-as-a-service (KaaS) for QoS-aware resource management in multi-user video transcoding

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The coexistence of parallel applications in shared computing nodes, each one featuring different Quality of Service (QoS) requirements, carries out new challenges to improve resource occupation while keeping acceptable rates in terms of QoS. As more application-specific and system-wide metrics are included as QoS dimensions, or under situations in which resource-usage limits are strict, building and serving the most appropriate set of actions (application control knobs and system resource assignment) to concurrent applications in an automatic and optimal fashion become mandatory. In this paper, we propose strategies to build and serve this type of knowledge to concurrent applications by leveraging Reinforcement Learning techniques. Taking multi-user video transcoding as a driving example, our experimental results reveal an excellent adaptation of resource and knob management to heterogeneous QoS requests, and increases in the amount of concurrently served users up to 1.24 × compared with alternative approaches considering homogeneous QoS requests.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Bossen F, Common H (2013) Test conditions and software reference configurations. JCT-VC Doc

  2. Costero L, Iranfar A, Zapater M, Igual FD, Olcoz K, Atienza D (2019) MAMUT: multi-agent reinforcement learning for efficient real-time multi-user video transcoding. In: Design, Automation Test in Europe Conference

  3. Farhad SM, Bappi MSI, Ghosh A (2016) Dynamic resource provisioning for video transcoding in IaaS cloud. In: 2016 IEEE 18th International Conference on High Performance Computing and Communications, IEEE, pp 380–384

  4. Gao G, Wen Y, Westphal C (2016) Dynamic resource provisioning with QoS guarantee for video transcoding in online video sharing service. In: 2016 ACM Multimedia Conferecne—MM ’16, pp 868–877

  5. Gao G, Wen Y, Westphal C (2019) Dynamic priority-based resource provisioning for video transcoding with heterogeneous QoS. IEEE Trans Circuits Syst Video Technol 29(5):1515–1529

    Article  Google Scholar 

  6. Ho HN, Lee E (2015) Model-based reinforcement learning approach for planning in self-adaptive software system. In: International Conference on Ubiquitous Information Management and Communication, pp 103:1–103:8

  7. IBM (2005) An architectural blueprint for autonomic computing. Technical Report, IBM

  8. Iranfar A, Zapater M, Atienza D (2018) Machine learning-based quality-aware power and thermal management of multistream HEVC encoding on multicore servers. IEEE Trans Parallel Distrib Syst 29(10):2268–2281

    Article  Google Scholar 

  9. Sembiring K, Beyer A (2013) Dynamic resource allocation for cloud-based media processing. In: ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM Press, pp 49–54

  10. Singh S, Chana I (2015) QoS-aware autonomic resource management in cloud computing. ACM Comput Surv 48(3):1–46

    Article  Google Scholar 

  11. Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  12. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction, vol 1. MIT Press, Cambridge

    MATH  Google Scholar 

  13. Viitanen M, Koivula A, Lemmetti A, Ylä-Outinen A, Vanne J, Hämäläinen TD (2016) Kvazaar: open-source HEVC/H.265 encoder. In: 24th ACM International Conference on Multimedia

  14. Wang L, Gelenbe E (2018) Adaptive dispatching of tasks in the cloud. IEEE Trans Cloud Comput 6(1):33–45

    Article  Google Scholar 

Download references

Funding

This work has been partially supported by the EU (FEDER), the Spanish MINECO and the CM under Grants S2018/TCS-4423, TIN 2015-65277-R and RTI2018-093684-B-I00 and the Spanish MECD under Grant FPU15/02050.

Author information

Authors and Affiliations

  1. Departamento de Arquitectura de Computadores y Automática, Universidad Computense de Madrid, Madrid, Spain

    Luis Costero, Francisco D. Igual, Katzalin Olcoz & Francisco Tirado

Authors
  1. Luis Costero
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francisco D. Igual
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Katzalin Olcoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Francisco Tirado
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luis Costero.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Costero, L., Igual, F.D., Olcoz, K. et al. Leveraging knowledge-as-a-service (KaaS) for QoS-aware resource management in multi-user video transcoding. J Supercomput 76, 9388–9403 (2020). https://doi.org/10.1007/s11227-019-03117-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-019-03117-9

Keywords

Search

Navigation