Abstract
Cloud computing is seen as a more promising technology than any other traditional information technology computing paradigm in today’s world. It essentially functions as an on-demand resource provisioning platform that requires no active user participation. The resource provisioning strategies necessitate proper load distribution management across the cloud network, without which the cloud would experience biased workload performance. Today virtualization is the cornerstone of cloud computing, allowing data dissemination and administration via deploying virtual machines. Modern applications contain data that need to be stored into a scheme called polyglot persistence (combining SQL and NoSQL data-stores). However, these services are tailored to specific storage requirements, necessitating aggregating them from several heterogeneous clouds or migrating data from one cloud to another. Data migration can be done offline where the database is independent of the application, or otherwise, the application has to be down for the migration period. This paper developed a middleware in .NET Core facilitating the live migration of persistent polyglot data in heterogeneous clouds. This paper presents the proof of concept for live migration of the database layer of an application hosted on any supported clouds to any implemented cloud’s data-store. Our suggested technique performs better in migration time, energy usage, and throughput aspects as compared with the offline migration scenario. In our experimentation, we found that while migrating data in offline mode from SQL to mongo and vice versa there is a marginal increase of 29% and 11%, respectively, in latency time. This increase is acceptable and tolerable while considering the live data migration scenario.
Similar content being viewed by others
Data availability
This manuscript has no associated data.
References
Alomari E, Barnawi A, Sakr S (2015) CDPort: a portability framework for NoSQL datastores. Arab J Sci Eng 40(9):2531–2553. https://doi.org/10.1007/s13369-015-1703-0
Bjeladinovic S (2018) A fresh approach for hybrid SQL/NoSQL database design based on data structuredness. Enterp Inform Syst 12(8–9):1202–1220. https://doi.org/10.1080/17517575.2018.1446102
Zhang Z, Wu C, Cheung DWL (2013) A survey on cloud interoperability. ACM SIGMETRICS Perform Eval Rev 40(4):13–22. https://doi.org/10.1145/2479942.2479945
Scavuzzo M, Di Nitto E, Dominiak J (2015) Data synchronisation layer
Bharany S, Sharma S, Khalaf OI, Abdulsahib GM, Al Humaimeedy AS, Aldhyani THH, Maashi M, Alkahtani H (2022) A systematic survey on energy-efficient techniques in sustainable cloud computing. Sustainability 14:6256. https://doi.org/10.3390/su14106256
Alonso J, Orue-Echevarria L, Huarte M (2022) CloudOps: towards the operationalization of the cloud continuum: concepts, challenges and a reference framework. Appl Sci 2(9):4347. https://doi.org/10.3390/app12094347
Bharany S, Sharma S, Bhatia S, Rahmani MKI, Shuaib M, Lashari SA (2022) Energy efficient clustering protocol for FANETS Using moth flame optimization. Sustainability 14:6159. https://doi.org/10.3390/su14106159
Gebrealif Y, Mubarkoot M, Altmann J, Egger B (2020) AI-based container orchestration for federated cloud environments. In: Proceedings of the 1st Workshop on Flexible Resource and Application Management on the Edge. HPDC ’21: The 30th International Symposium on High-Performance Parallel and Distributed Computing. ACM. https://doi.org/10.1145/3452369.3463818
Ardagna D, Ceri S, Di Nitto E, Scavuzzo M (2014) Data synchronisation techniques
Bansel A (2015) Cloud based NoSQL data migration framework to achieve data portability. National College of Ireland, Dublin, Ireland
Lăcătușu M, Ionita AD, Anton FD, Lăcătușu F (2022) Analysis of complexity and performance for automated deployment of a software environment into the cloud. Appl Sci 12(9):4183. https://doi.org/10.3390/app12094183
Tomarchio O, Calcaterra D, Modica GD (2020) Cloud resource orchestration in the multi-cloud landscape: a systematic review of existing frameworks. J Cloud Comput. https://doi.org/10.1186/s13677-020-00194-7
Zaharia MH (2017) A multiagent approach to database migration for big data systems. New Math Nat Comput 3(2):159–180. https://doi.org/10.1142/s1793005717400051
Zou C, Zhao F, Xie Y, Zhou H, Qin J (2019) Live migration in Greenplum database based on SDN via improved gray wolf optimization algorithm. In: Proceedings of the Conference on Research in Adaptive and Convergent Systems. RACS ’19: International Conference on Research in Adaptive and Convergent Systems. ACM. https://doi.org/10.1145/3338840.3355640
Elmore AJ, Das S, Agrawal D, El Abbadi A (2011) Zephyr. In: Proceedings of the 2011 International Conference on Management of Data—SIGMOD ’11. The 2011 International Conference. ACM Press. https://doi.org/10.1145/1989323.1989356
Elmore AJ, Das S, Agrawal D, El Abbadi A (2011) Zephyr. In: Proceedings of the 2011 International Conference on Management of Data—SIGMOD ’11. The 2011 International Conference. ACM Press. https://doi.org/10.1145/1989323.1989356
Barker S, Chi Y, Moon HJ, Hacigümüş H, Shenoy P (2012) Cut me some slack. In: Proceedings of the 15th International Conference on Extending Database Technology—EDBT ’12. The 15th International Conference. ACM Press. https://doi.org/10.1145/2247596.2247647
Georgiou MA, Paphitis A, Sirivianos M, Herodotou H (2022) Hihooi: a database replication middleware for scaling transactional databases consistently. IEEE Trans Knowl Data Eng 34(2):691–707. https://doi.org/10.1109/tkde.2020.2987560
Hai J, Wang C, Chen X, Li TO, Cui H, Wang S (2019) Fulva: efficient live migration for in-memory key-value stores with zero downtime. In: 2019 38th Symposium on Reliable Distributed Systems (SRDS). 2019 38th Symposium on Reliable Distributed Systems (SRDS). IEEE. https://doi.org/10.1109/srds47363.2019.00019
Aboulsamh MA, Davies J (2011) A formal modeling approach to information systems evolution and data migration. In: Enterprise, Business-process and information systems modeling. Springer Berlin Heidelberg. pp. 383–397 https://doi.org/10.1007/978-3-642-21759-3_28.
Hababeh, Data Migration among Different Clouds, (2015). http://arxiv.org/abs/1512.08383
Bharany S, Sharma S, Badotra S, Khalaf OI, Alotaibi Y, Alghamdi S, Alassery F (2021) Energy-efficient clustering scheme for flying Ad-hoc networks using an optimized LEACH protocol. Energies 14(19):6016. https://doi.org/10.3390/en14196016
Ma K, Yang B, Yu Z (2017) Optimization of stream-based live data migration strategy in the cloud. Concurr Comput: Pract Exp 30(12):e4293. https://doi.org/10.1002/cpe.4293
Singh P, Sawhney RS, Kahlon KS (2017) Forecasting the 2016 US presidential elections using sentiment analysis. In: Conference on e-Business, e-Services and e-Society (pp. 412–423). Springer, Cham
Talwar B, Arora A, Bharany S (2021) An energy efficient agent aware proactive fault tolerance for preventing deterioration of virtual machines within cloud environment. In: 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)
Kaur K, Sharma S, Kahlon KS (2020) A middleware for polyglot persistence and data portability of big data PaaS cloud applications. Comput Mater Cont 65(2):1625–1647. https://doi.org/10.32604/cmc.2020.011535
Kaur K, Sharma DRS, Kahlon DRKS (2018) Interoperability and portability approaches in inter-connected clouds. ACM Comput Surv 50(4):1–40. https://doi.org/10.1145/3092698
Munisso R, Chis AE (2017) Cloudmapper: a model-based framework for portability of cloud applications consuming PaaS services. In: 25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, pp. 132–139
Petcu D (2011) Portability and interoperability between clouds: challenges and case study. In: European Conference on a Service-Based Internet, Springer, Berlin, Heidelberg, pp. 62–74
Pulgatti LD (2017) Data migration between different data models of NoSql databases (Masters Dissertation). Graduate
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We declared that there is no competing interest exists.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kaur, K., Bharany, S., Badotra, S. et al. Energy-efficient polyglot persistence database live migration among heterogeneous clouds. J Supercomput 79, 265–294 (2023). https://doi.org/10.1007/s11227-022-04662-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-022-04662-6