MERAL Myanmar Education Research and Learning Portal
Item
{"_buckets": {"deposit": "2e24fd68-f2d5-4da7-8525-aaf59ef2635a"}, "_deposit": {"created_by": 45, "id": "2925", "owner": "45", "owners": [45], "owners_ext": {"displayname": "", "username": ""}, "pid": {"revision_id": 0, "type": "recid", "value": "2925"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/2925", "sets": ["user-uit"]}, "communities": ["uit"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "Using Efficient Deduplication Method in Large-scale Distributed Storage System", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "Today’s storage systems have a major issue\nfor the long-term storage of massive amounts of\nunstructured data. Availability and reliability are\nthe basic properties of the most storage system.\nReplication which is the simplest redundancy\nscheme can help the storage system to achieve\ncontinuous access. But too much redundancy will\nnot improve the data availability when the\namount of replication reaches a certain point. In\nthis paper, an efficient data deduplication\nmethod in large-scale distributed storage system\nis presented. Since good data indexing is very\nhelpful for duplicate detection, the deduplication\nscheme with Bloom filter array is used for the\nsake of space and look-up efficiency in\ndistributed storage system."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "Unstructured data"}, {"interim": "large-scale distributed storage"}, {"interim": "Bloom filter"}, {"interim": "deduplication"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2020-08-06"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "Using Efficient Deduplication Method in Large-scale Distributed Storage System.pdf", "filesize": [{"value": "568 Kb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensetype": "license_0", "mimetype": "application/pdf", "size": 568000.0, "url": {"url": "https://meral.edu.mm/record/2925/files/Using Efficient Deduplication Method in Large-scale Distributed Storage System.pdf"}, "version_id": "7a7fddfc-0ef7-40da-8abc-5684c38b60c5"}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "ICCA 2013", "subitem_c_date": "26-27 February, 2013", "subitem_conference_title": "11th International Conference on Computer Applications", "subitem_place": "Sedona Hotel, Yangon, Myanmar", "subitem_website": "https://www.ucsy.edu.mm/EleventhIccaN.do"}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Myat Pwint Phyu"}, {"subitem_authors_fullname": "Ni Lar Thein"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Conference paper"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2013-02-27"}, "item_title": "Using Efficient Deduplication Method in Large-scale Distributed Storage System", "item_type_id": "21", "owner": "45", "path": ["1596102355557"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000002925", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2020-08-06"}, "publish_date": "2020-08-06", "publish_status": "0", "recid": "2925", "relation": {}, "relation_version_is_last": true, "title": ["Using Efficient Deduplication Method in Large-scale Distributed Storage System"], "weko_shared_id": -1}
Using Efficient Deduplication Method in Large-scale Distributed Storage System
http://hdl.handle.net/20.500.12678/0000002925
http://hdl.handle.net/20.500.12678/0000002925f9cf4927-86ec-4eed-a119-c140cc6c5f00
2e24fd68-f2d5-4da7-8525-aaf59ef2635a
Name / File | License | Actions |
---|---|---|
Using Efficient Deduplication Method in Large-scale Distributed Storage System.pdf (568 Kb)
|
Publication type | ||||||
---|---|---|---|---|---|---|
Conference paper | ||||||
Upload type | ||||||
Publication | ||||||
Title | ||||||
Title | Using Efficient Deduplication Method in Large-scale Distributed Storage System | |||||
Language | en | |||||
Publication date | 2013-02-27 | |||||
Authors | ||||||
Myat Pwint Phyu | ||||||
Ni Lar Thein | ||||||
Description | ||||||
Today’s storage systems have a major issue for the long-term storage of massive amounts of unstructured data. Availability and reliability are the basic properties of the most storage system. Replication which is the simplest redundancy scheme can help the storage system to achieve continuous access. But too much redundancy will not improve the data availability when the amount of replication reaches a certain point. In this paper, an efficient data deduplication method in large-scale distributed storage system is presented. Since good data indexing is very helpful for duplicate detection, the deduplication scheme with Bloom filter array is used for the sake of space and look-up efficiency in distributed storage system. |
||||||
Keywords | ||||||
Unstructured data, large-scale distributed storage, Bloom filter, deduplication | ||||||
Conference papers | ||||||
ICCA 2013 | ||||||
26-27 February, 2013 | ||||||
11th International Conference on Computer Applications | ||||||
Sedona Hotel, Yangon, Myanmar | ||||||
https://www.ucsy.edu.mm/EleventhIccaN.do |