MERAL Myanmar Education Research and Learning Portal
Item
{"_buckets": {"deposit": "5baab3cc-ecd5-4199-a162-5625b1b40422"}, "_deposit": {"id": "5022", "owners": [], "pid": {"revision_id": 0, "type": "recid", "value": "5022"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/5022", "sets": ["1597824175385", "user-ucsy"]}, "communities": ["ucsy"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "Replication Based on Data Locality for Hadoop Distributed File System", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "Replication plays an important role for storage system to improve data availability, throughputand response time for user and control storage cost. Due to different nature of data access pattern, datapopularity is important in replication because of the unstable and unpredictable nature of popular files. Also,replicas placement is important in consideration of system\u0027s performance. In data-parallel applications, datalocality is a key issue and this consequence of this issue occurs the decrement of system’ performance.Therefore, this paper proposes a data locality-based replication for Hadoop Distributed File System (HDFS).In replica allocation, data popularity is considered for maintaining less replicas for unpopular data and also,disk bandwidth, CPU utilization and disk utilization are considered in the proposed replica placementalgorithm in order to get better data locality and more effective storage utilization. Our proposed scheme willbe effective for HDFS."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "Replication"}, {"interim": "Data Locality"}, {"interim": "Data Popularity"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2019-07-16"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "rp100_W1021.pdf", "filesize": [{"value": "1112 Kb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensetype": "license_free", "mimetype": "application/pdf", "size": 1112000.0, "url": {"url": "https://meral.edu.mm/record/5022/files/rp100_W1021.pdf"}, "version_id": "b646e0e9-f888-4c5b-8d52-cd145296e4e5"}]}, "item_1583103131163": {"attribute_name": "Journal articles", "attribute_value_mlt": [{"subitem_issue": "", "subitem_journal_title": "9th International Workshop on Computer Science and Engineering (WCSE 2019), Hong Kong", "subitem_pages": "", "subitem_volume": ""}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "", "subitem_c_date": "", "subitem_conference_title": "", "subitem_part": "", "subitem_place": "", "subitem_session": "", "subitem_website": ""}]}, "item_1583103211336": {"attribute_name": "Books/reports/chapters", "attribute_value_mlt": [{"subitem_book_title": "", "subitem_isbn": "", "subitem_pages": "", "subitem_place": "", "subitem_publisher": ""}]}, "item_1583103233624": {"attribute_name": "Thesis/dissertations", "attribute_value_mlt": [{"subitem_awarding_university": "", "subitem_supervisor(s)": [{"subitem_supervisor": ""}]}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Thu, May Phyo"}, {"subitem_authors_fullname": "Nwe, Khine Moe"}, {"subitem_authors_fullname": "Aye, Kyar Nyo"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Article"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2019-06-15"}, "item_1583159847033": {"attribute_name": "Identifier", "attribute_value": "978-981-14-1684-2"}, "item_title": "Replication Based on Data Locality for Hadoop Distributed File System", "item_type_id": "21", "owner": "1", "path": ["1597824175385"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000005022", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2019-07-16"}, "publish_date": "2019-07-16", "publish_status": "0", "recid": "5022", "relation": {}, "relation_version_is_last": true, "title": ["Replication Based on Data Locality for Hadoop Distributed File System"], "weko_shared_id": -1}
Replication Based on Data Locality for Hadoop Distributed File System
http://hdl.handle.net/20.500.12678/0000005022
http://hdl.handle.net/20.500.12678/0000005022a5f883b7-020b-4373-8d5f-f637666dab8c
5baab3cc-ecd5-4199-a162-5625b1b40422
Name / File | License | Actions |
---|---|---|
![]() |
|
Publication type | ||||||
---|---|---|---|---|---|---|
Article | ||||||
Upload type | ||||||
Publication | ||||||
Title | ||||||
Title | Replication Based on Data Locality for Hadoop Distributed File System | |||||
Language | en | |||||
Publication date | 2019-06-15 | |||||
Authors | ||||||
Thu, May Phyo | ||||||
Nwe, Khine Moe | ||||||
Aye, Kyar Nyo | ||||||
Description | ||||||
Replication plays an important role for storage system to improve data availability, throughputand response time for user and control storage cost. Due to different nature of data access pattern, datapopularity is important in replication because of the unstable and unpredictable nature of popular files. Also,replicas placement is important in consideration of system's performance. In data-parallel applications, datalocality is a key issue and this consequence of this issue occurs the decrement of system’ performance.Therefore, this paper proposes a data locality-based replication for Hadoop Distributed File System (HDFS).In replica allocation, data popularity is considered for maintaining less replicas for unpopular data and also,disk bandwidth, CPU utilization and disk utilization are considered in the proposed replica placementalgorithm in order to get better data locality and more effective storage utilization. Our proposed scheme willbe effective for HDFS. | ||||||
Keywords | ||||||
Replication, Data Locality, Data Popularity | ||||||
Identifier | 978-981-14-1684-2 | |||||
Journal articles | ||||||
9th International Workshop on Computer Science and Engineering (WCSE 2019), Hong Kong | ||||||
Conference papers | ||||||
Books/reports/chapters | ||||||
Thesis/dissertations |