MERAL Myanmar Education Research and Learning Portal
Item
{"_buckets": {"deposit": "70148bc7-b86e-4db0-8d27-d4ffa9d51a1b"}, "_deposit": {"created_by": 45, "id": "6386", "owner": "45", "owners": [45], "owners_ext": {"displayname": "", "username": ""}, "pid": {"revision_id": 0, "type": "recid", "value": "6386"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/6386", "sets": ["user-uit"]}, "communities": ["uit"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "An Approach of Accessing Small Files on HDFS for Cloud Storage", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "Hadoop distributed file system (HDFS) was originally\ndesigned for large files. When the large number of small\nfiles is accessed, NameNode often becomes the\nbottleneck. The access and storage efficiency is low for\nthe mass small files. In order to solve this issue in\nHDFS, the approach of accessing small files on HDFS\nis proposed. In this approach, all correlated small files\nwill be merged into a larger file based on the\nagglomerative hierarchical clustering mechanism to\nreduce NameNode memory space. Moreover, HDFS\ndoes not take the correlation among files into account\nand it does not provide any prefetching mechanism to\nimprove the I/O performance. A prefetching mechanism\nwill be proposed to improve the efficiency of accessing\nsmall files. This approach will provide small files for\ncloud storage."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "Hadoop distributed files system (HDFS)"}, {"interim": "NameNode"}, {"interim": "Small files"}, {"interim": "prefetching"}, {"interim": "hierarchical agglomerative clustering"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2020-11-20"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "An Approach of Accessing Small Files on HDFS for Cloud Storage.pdf", "filesize": [{"value": "332 Kb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensetype": "license_0", "mimetype": "application/pdf", "size": 332000.0, "url": {"url": "https://meral.edu.mm/record/6386/files/An Approach of Accessing Small Files on HDFS for Cloud Storage.pdf"}, "version_id": "52f5199d-415a-44a6-8944-c5cf38313c3a"}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "ICAIT-2017", "subitem_c_date": "1-2 November, 2017", "subitem_conference_title": "1st International Conference on Advanced Information Technologies", "subitem_place": "Yangon, Myanmar", "subitem_session": "Workshop Session", "subitem_website": "https://www.uit.edu.mm/icait-2017/"}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Khin Su Su Wai"}, {"subitem_authors_fullname": "Julia Myint"}, {"subitem_authors_fullname": "Tin Tin Yee"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Conference paper"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2017-11-02"}, "item_title": "An Approach of Accessing Small Files on HDFS for Cloud Storage", "item_type_id": "21", "owner": "45", "path": ["1605779935331"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000006386", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2020-11-20"}, "publish_date": "2020-11-20", "publish_status": "0", "recid": "6386", "relation": {}, "relation_version_is_last": true, "title": ["An Approach of Accessing Small Files on HDFS for Cloud Storage"], "weko_shared_id": -1}
An Approach of Accessing Small Files on HDFS for Cloud Storage
http://hdl.handle.net/20.500.12678/0000006386
http://hdl.handle.net/20.500.12678/000000638626a1adb4-fc0f-472b-ad30-7cebb60db22b
70148bc7-b86e-4db0-8d27-d4ffa9d51a1b
Name / File | License | Actions |
---|---|---|
![]() |
Publication type | ||||||
---|---|---|---|---|---|---|
Conference paper | ||||||
Upload type | ||||||
Publication | ||||||
Title | ||||||
Title | An Approach of Accessing Small Files on HDFS for Cloud Storage | |||||
Language | en | |||||
Publication date | 2017-11-02 | |||||
Authors | ||||||
Khin Su Su Wai | ||||||
Julia Myint | ||||||
Tin Tin Yee | ||||||
Description | ||||||
Hadoop distributed file system (HDFS) was originally designed for large files. When the large number of small files is accessed, NameNode often becomes the bottleneck. The access and storage efficiency is low for the mass small files. In order to solve this issue in HDFS, the approach of accessing small files on HDFS is proposed. In this approach, all correlated small files will be merged into a larger file based on the agglomerative hierarchical clustering mechanism to reduce NameNode memory space. Moreover, HDFS does not take the correlation among files into account and it does not provide any prefetching mechanism to improve the I/O performance. A prefetching mechanism will be proposed to improve the efficiency of accessing small files. This approach will provide small files for cloud storage. |
||||||
Keywords | ||||||
Hadoop distributed files system (HDFS), NameNode, Small files, prefetching, hierarchical agglomerative clustering | ||||||
Conference papers | ||||||
ICAIT-2017 | ||||||
1-2 November, 2017 | ||||||
1st International Conference on Advanced Information Technologies | ||||||
Yangon, Myanmar | ||||||
Workshop Session | ||||||
https://www.uit.edu.mm/icait-2017/ |