A Data-aware MultiWorkflow Scheduler for Clusters on WorkflowSim

César Acevedo; Porfidio Hernández; Antonio Espinosa; Victor Mendez

iBet uBet web content aggregator. Adding the entire web to your favor.

Link to original content: https://unpaywall.org/10.5220/0006303500790086

SciTePress - Publication Details

Research.Publish.Connect.

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

A Data-aware MultiWorkflow Scheduler for Clusters on WorkflowSim

Topics: Bioinformatics; Simulation and Modeling; Usability of Complex Information Systems

In Proceedings of the 2nd International Conference on Complexity, Future Information Systems and Risk COMPLEXIS - Volume 1, 79-86, 2017 , Porto, Portugal

Authors: César Acevedo ; Porfidio Hernández ; Antonio Espinosa and Victor Mendez

Affiliation: Univ. Autónoma de Barcelona, Spain

Keyword(s): MultiWorkflow, Data-aware, Cluster, Simulation, Storage Hierarchy.

Related Ontology Subjects/Areas/Topics: Bioinformatics ; Biomedical Engineering ; Biomedical Signal Processing

Abstract: Most scientific workflows are defined as Direct Acyclic Graphs. Despite DAGs are very expressive to reflect dependencies relationships, current approaches are not aware of the storage physiognomy in terms of performance and capacity. Provide information about temporal storage allocation on data intensive applications helps to avoid performance issues. Nevertheless, we need to evaluate several combinations of data file locations and application scheduling. Simulation is one of the most popular evaluation methods in scientific workflow execution to develop new storage-aware scheduling techniques or improve existing ones, to test scalability and repetitiveness. This paper presents a multiworkflow store-aware scheduler policy as an extension of WorkflowSim, enabling its combination with other WorkflowSim scheduling policies and the possibility of evaluating a wide range of storage and file allocation possibilities. This paper also presents a proof of concept of a real world implementatio n of a storage-aware scheduler to validate the accuracy of the WorkflowSim extension and the scalability of our scheduler technique. The evaluation on several environments shows promising results up to 69% of makespan improvement on simulated large scale clusters with an error of the WorflowSim extension between 0,9% and 3% comparing with the real infrastructure implementation. (More)

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 173.236.136.203

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Acevedo, C.; Hernández, P.; Espinosa, A. and Mendez, V. (2017). A Data-aware MultiWorkflow Scheduler for Clusters on WorkflowSim. In Proceedings of the 2nd International Conference on Complexity, Future Information Systems and Risk - COMPLEXIS; ISBN 978-989-758-244-8; ISSN 2184-5034, SciTePress, pages 79-86. DOI: 10.5220/0006303500790086

@conference{complexis17,
author={César Acevedo. and Porfidio Hernández. and Antonio Espinosa. and Victor Mendez.},
title={A Data-aware MultiWorkflow Scheduler for Clusters on WorkflowSim},
booktitle={Proceedings of the 2nd International Conference on Complexity, Future Information Systems and Risk - COMPLEXIS},
year={2017},
pages={79-86},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006303500790086},
isbn={978-989-758-244-8},
issn={2184-5034},
}

TY - CONF

JO - Proceedings of the 2nd International Conference on Complexity, Future Information Systems and Risk - COMPLEXIS
TI - A Data-aware MultiWorkflow Scheduler for Clusters on WorkflowSim
SN - 978-989-758-244-8
IS - 2184-5034
AU - Acevedo, C.
AU - Hernández, P.
AU - Espinosa, A.
AU - Mendez, V.
PY - 2017
SP - 79
EP - 86
DO - 10.5220/0006303500790086
PB - SciTePress