MERAL Myanmar Education Research and Learning Portal
Item
{"_buckets": {"deposit": "b0d19cc6-a14e-4753-a9ea-307e8b9c95d0"}, "_deposit": {"created_by": 45, "id": "6257", "owner": "45", "owners": [45], "owners_ext": {"displayname": "", "username": ""}, "pid": {"revision_id": 0, "type": "recid", "value": "6257"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/6257", "sets": ["user-uit"]}, "communities": ["uit"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "Nowadays, many applications need high reliability pipeline architecture to get faster process and reliable data within short time. Kafka has emerged as one of the important components of real-time processing pipelines in combination with Storm. This paper focuses to develop the real-time big data analytics pipeline architecture for reliability. Real-time data pipelines can be implemented in many ways and it will look different for every business. To develop the pipeline architecture, we create real time big data pipeline by using Apache Kafka and Apache Storm. Kafka and Storm naturally complement each other and their powerful cooperation enables real-time streaming analytics for fast-moving big data. Then, the experiment will be conducted how the processing time decreases with the same messages on the different partitions."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "Messaging"}, {"interim": "Real-time processing"}, {"interim": "Apache Kafka"}, {"interim": "Apache Storm"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2020-11-19"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf", "filesize": [{"value": "1.4 Mb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensefree": "© 2017 ICAIT", "licensetype": "license_free", "mimetype": "application/pdf", "size": 1400000.0, "url": {"url": "https://meral.edu.mm/record/6257/files/Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf"}, "version_id": "de189b8c-c528-4fd6-9b59-0e3f1a4b169f"}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "ICAIT 2017", "subitem_c_date": "1-2 November, 2017", "subitem_conference_title": "1st International Conference on Advanced Information Technologies", "subitem_place": "Yangon, Myanmar", "subitem_session": "Cloud Computing and Big Data Analytics", "subitem_website": "https://www.uit.edu.mm/icait-2017/"}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Thandar Aung"}, {"subitem_authors_fullname": "Aung Htein Maw"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Conference paper"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2017-11-02"}, "item_title": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture", "item_type_id": "21", "owner": "45", "path": ["1605779935331"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000006257", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2020-11-19"}, "publish_date": "2020-11-19", "publish_status": "0", "recid": "6257", "relation": {}, "relation_version_is_last": true, "title": ["Analytics of Reliability for Real-Time Big Data Pipeline Architecture"], "weko_shared_id": -1}
Analytics of Reliability for Real-Time Big Data Pipeline Architecture
http://hdl.handle.net/20.500.12678/0000006257
http://hdl.handle.net/20.500.12678/000000625736b3fa4f-493f-497f-a96a-3686f2b4daae
b0d19cc6-a14e-4753-a9ea-307e8b9c95d0
Name / File | License | Actions |
---|---|---|
Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf (1.4 Mb)
|
© 2017 ICAIT
|
Publication type | ||||||
---|---|---|---|---|---|---|
Conference paper | ||||||
Upload type | ||||||
Publication | ||||||
Title | ||||||
Title | Analytics of Reliability for Real-Time Big Data Pipeline Architecture | |||||
Language | en | |||||
Publication date | 2017-11-02 | |||||
Authors | ||||||
Thandar Aung | ||||||
Aung Htein Maw | ||||||
Description | ||||||
Nowadays, many applications need high reliability pipeline architecture to get faster process and reliable data within short time. Kafka has emerged as one of the important components of real-time processing pipelines in combination with Storm. This paper focuses to develop the real-time big data analytics pipeline architecture for reliability. Real-time data pipelines can be implemented in many ways and it will look different for every business. To develop the pipeline architecture, we create real time big data pipeline by using Apache Kafka and Apache Storm. Kafka and Storm naturally complement each other and their powerful cooperation enables real-time streaming analytics for fast-moving big data. Then, the experiment will be conducted how the processing time decreases with the same messages on the different partitions. | ||||||
Keywords | ||||||
Messaging, Real-time processing, Apache Kafka, Apache Storm | ||||||
Conference papers | ||||||
ICAIT 2017 | ||||||
1-2 November, 2017 | ||||||
1st International Conference on Advanced Information Technologies | ||||||
Yangon, Myanmar | ||||||
Cloud Computing and Big Data Analytics | ||||||
https://www.uit.edu.mm/icait-2017/ |