{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T23:13:08Z","timestamp":1723072388494},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2015,8]]},"abstract":"The configuration of a distributed storage system typically includes, among other parameters, the set of servers and their roles in the replication protocol. Although mechanisms for changing the configuration at runtime exist, it is usually left to system administrators to manually determine the \"best\" configuration and periodically reconfigure the system, often by trial and error. This paper describes a new workload-driven optimization framework that dynamically determines the optimal configuration at run-time. We focus on optimizing leader and quorum based replication schemes and divide the framework into three optimization tiers, dynamically optimizing different configuration aspects: 1) leader placement, 2) roles of different servers in the replication protocol, and 3) replica locations. We showcase our optimization framework by applying it to a large-scale distributed storage system used internally in Google and demonstrate that most client applications significantly benefit from using our framework, reducing average operation latency by up to 94%.<\/jats:p>","DOI":"10.14778\/2824032.2824047","type":"journal-article","created":{"date-parts":[[2015,9,16]],"date-time":"2015-09-16T12:18:17Z","timestamp":1442405897000},"page":"1490-1501","source":"Crossref","is-referenced-by-count":28,"title":["Take me to your leader!"],"prefix":"10.14778","volume":"8","author":[{"given":"Artyom","family":"Sharov","sequence":"first","affiliation":[{"name":"Google, Inc."}]},{"given":"Alexander","family":"Shraer","sequence":"additional","affiliation":[{"name":"Google, Inc."}]},{"given":"Arif","family":"Merchant","sequence":"additional","affiliation":[{"name":"Google, Inc."}]},{"given":"Murray","family":"Stokely","sequence":"additional","affiliation":[{"name":"Google, Inc."}]}],"member":"320","published-online":{"date-parts":[[2015,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon dynamodb. http:\/\/aws.amazon.com\/dynamodb\/. Amazon dynamodb. http:\/\/aws.amazon.com\/dynamodb\/."},{"key":"e_1_2_1_2_1","unstructured":"Amazon simpledb. http:\/\/aws.amazon.com\/simpledb\/. Amazon simpledb. http:\/\/aws.amazon.com\/simpledb\/."},{"key":"e_1_2_1_3_1","unstructured":"Basho riak. http:\/\/basho.com\/riak. Basho riak. http:\/\/basho.com\/riak."},{"key":"e_1_2_1_4_1","unstructured":"Mongodb. http:\/\/www.mongodb.org\/. Mongodb. http:\/\/www.mongodb.org\/."},{"key":"e_1_2_1_5_1","volume-title":"Retrieved","year":"2015"},{"key":"e_1_2_1_6_1","volume-title":"Retrieved","year":"2015"},{"key":"e_1_2_1_7_1","volume-title":"USENIX NSDI","author":"Agarwal S.","year":"2010"},{"key":"e_1_2_1_8_1","first-page":"102","article-title":"Reconfiguring replicated atomic storage: A tutorial","author":"Aguilera M. K.","year":"2010","journal-title":"Bul. of EATCS"},{"key":"e_1_2_1_9_1","first-page":"367","volume-title":"USENIX OSDI","author":"Ardekani M. S.","year":"2014"},{"key":"e_1_2_1_10_1","volume-title":"CIDR","author":"Baker J.","year":"2011"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2535930"},{"key":"e_1_2_1_13_1","first-page":"335","volume-title":"OSDI","author":"Burrows M.","year":"2006"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038916.2038932"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454167"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491245"},{"key":"e_1_2_1_17_1","volume-title":"ACM SIGCOMM","author":"Escriva R.","year":"2012"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/945445.945450","volume-title":"SOSP","author":"Ghemawat S.","year":"2003"},{"key":"e_1_2_1_19_1","volume-title":"USENIX ATC","author":"Hunt P.","year":"2010"},{"issue":"11","key":"e_1_2_1_20_1","first-page":"1040","article-title":"Where in the world is my data?","volume":"4","author":"Kadambi S.","year":"2011","journal-title":"PVLDB"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/279227.279229"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753171.1753191"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1217935.1217946"},{"key":"e_1_2_1_24_1","volume-title":"OSDI","author":"MacCormick J.","year":"2004"},{"key":"e_1_2_1_25_1","volume-title":"USENIX ATC","author":"Shraer A.","year":"2012"},{"key":"e_1_2_1_26_1","volume-title":"The voltdb main memory DBMS","author":"Stonebraker M.","year":"2013"},{"key":"e_1_2_1_27_1","first-page":"15","volume-title":"USENIX ATC","author":"Tran N.","year":"2011"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/249978.249982"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043556.2043572"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2824032.2824047","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T05:49:47Z","timestamp":1691992187000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2824032.2824047"}},"subtitle":["online optimization of distributed storage configurations"],"short-title":[],"issued":{"date-parts":[[2015,8]]},"references-count":28,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2015,8]]}},"alternative-id":["10.14778\/2824032.2824047"],"URL":"https:\/\/doi.org\/10.14778\/2824032.2824047","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2015,8]]}}}
