Log in
Language:

MERAL Myanmar Education Research and Learning Portal

  • Top
  • Universities
  • Ranking
To
lat lon distance
To

Field does not validate



Index Link

Index Tree

Please input email address.

WEKO

One fine body…

WEKO

One fine body…

Item

{"_buckets": {"deposit": "7fba1629-922e-47d9-934c-f833fdaefd2d"}, "_deposit": {"created_by": 45, "id": "6291", "owner": "45", "owners": [45], "owners_ext": {"displayname": "", "username": ""}, "pid": {"revision_id": 0, "type": "recid", "value": "6291"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/6291", "sets": ["user-uit"]}, "communities": ["uit"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "Efficient Checkpoint Interval for Speculative Execution in MapReduce", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "The MapReduce has become popular in big data\nenvironment due to its efficient parallel processing.\nHowever, MapReduce still has the problem from job\ndelay caused by straggling tasks, which prolong job\ncompletion time. In MapReduce framework, although the\nexisting speculative execution mechanism mitigate\nstragglers, its tasks are slower than their original tasks so\nthis makes job completion time get long when straggling\ntasks occur. So, in this paper, a checkpoint mechanism is\nproposed in order to increase the efficiency of speculative\nexecution of MapReduce, and not to prolong job\ncompletion time in case of straggling tasks. However,\nMapReduce produces too much intermediate data; as a\nresult, checkpoint of every intermediate data can still\ndecrease the performance of MapReduce. So, to avoid this\nproblem, the proposed system evaluates checkpoint\ninterval in order to reduce job completion time in case of\nstragglers. Then, the proposed system defines stragglers\nusing LATE scheduler. The proposed checkpoint interval\nis based on five parameters: expected job completion time\nwithout checkpointing, checkpoint overhead time, rework\ntime, down time and restart time. Experimental results\nshow that the proposed system leads to less completion\ntime, rework time and checkpoint overhead."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "MapReduce"}, {"interim": "straggling task"}, {"interim": "big data"}, {"interim": "checkpoint interval"}, {"interim": "completion time"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2020-11-19"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "Efficient Checkpoint Interval for Speculative Execution in MapReduce.pdf", "filesize": [{"value": "1.9 Mb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensefree": "© 2018 ICAIT", "licensetype": "license_free", "mimetype": "application/pdf", "size": 1900000.0, "url": {"url": "https://meral.edu.mm/record/6291/files/Efficient Checkpoint Interval for Speculative Execution in MapReduce.pdf"}, "version_id": "132576cc-1762-42f9-a2c5-7a5c209b1182"}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "ICAIT-2018", "subitem_c_date": "1-2 November, 2018", "subitem_conference_title": "2nd International Conference on Advanced Information Technologies", "subitem_place": "Yangon, Myanmar", "subitem_session": "Cloud and Distributed Computing", "subitem_website": "https://www.uit.edu.mm/icait-2018/"}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Naychi Nway Nway"}, {"subitem_authors_fullname": "Ei Chaw Htoon"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Conference paper"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2018-11-02"}, "item_title": "Efficient Checkpoint Interval for Speculative Execution in MapReduce", "item_type_id": "21", "owner": "45", "path": ["1605779935331"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000006291", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2020-11-19"}, "publish_date": "2020-11-19", "publish_status": "0", "recid": "6291", "relation": {}, "relation_version_is_last": true, "title": ["Efficient Checkpoint Interval for Speculative Execution in MapReduce"], "weko_shared_id": -1}
  1. University of Information Technology
  2. International Conference on Advanced Information Technologies

Efficient Checkpoint Interval for Speculative Execution in MapReduce

http://hdl.handle.net/20.500.12678/0000006291
http://hdl.handle.net/20.500.12678/0000006291
14a5038b-4875-4262-98a4-3bbd1e47b682
7fba1629-922e-47d9-934c-f833fdaefd2d
None
Preview
Name / File License Actions
Efficient Efficient Checkpoint Interval for Speculative Execution in MapReduce.pdf (1.9 Mb)
© 2018 ICAIT
Publication type
Conference paper
Upload type
Publication
Title
Title Efficient Checkpoint Interval for Speculative Execution in MapReduce
Language en
Publication date 2018-11-02
Authors
Naychi Nway Nway
Ei Chaw Htoon
Description
The MapReduce has become popular in big data
environment due to its efficient parallel processing.
However, MapReduce still has the problem from job
delay caused by straggling tasks, which prolong job
completion time. In MapReduce framework, although the
existing speculative execution mechanism mitigate
stragglers, its tasks are slower than their original tasks so
this makes job completion time get long when straggling
tasks occur. So, in this paper, a checkpoint mechanism is
proposed in order to increase the efficiency of speculative
execution of MapReduce, and not to prolong job
completion time in case of straggling tasks. However,
MapReduce produces too much intermediate data; as a
result, checkpoint of every intermediate data can still
decrease the performance of MapReduce. So, to avoid this
problem, the proposed system evaluates checkpoint
interval in order to reduce job completion time in case of
stragglers. Then, the proposed system defines stragglers
using LATE scheduler. The proposed checkpoint interval
is based on five parameters: expected job completion time
without checkpointing, checkpoint overhead time, rework
time, down time and restart time. Experimental results
show that the proposed system leads to less completion
time, rework time and checkpoint overhead.
Keywords
MapReduce, straggling task, big data, checkpoint interval, completion time
Conference papers
ICAIT-2018
1-2 November, 2018
2nd International Conference on Advanced Information Technologies
Yangon, Myanmar
Cloud and Distributed Computing
https://www.uit.edu.mm/icait-2018/
Back
0
0
views
downloads
See details
Views Downloads

Versions

Ver.1 2020-11-19 16:49:11.335969
Show All versions

Share

Mendeley Twitter Facebook Print Addthis

Export

OAI-PMH
  • OAI-PMH DublinCore
Other Formats
  • JSON

Confirm


Back to MERAL


Back to MERAL