Log in
Language:

MERAL Myanmar Education Research and Learning Portal

  • Top
  • Universities
  • Ranking
To
lat lon distance
To

Field does not validate



Index Link

Index Tree

Please input email address.

WEKO

One fine body…

WEKO

One fine body…

Item

{"_buckets": {"deposit": "b0d19cc6-a14e-4753-a9ea-307e8b9c95d0"}, "_deposit": {"created_by": 45, "id": "6257", "owner": "45", "owners": [45], "owners_ext": {"displayname": "", "username": ""}, "pid": {"revision_id": 0, "type": "recid", "value": "6257"}, "status": "published"}, "_oai": {"id": "oai:meral.edu.mm:recid/6257", "sets": ["user-uit"]}, "communities": ["uit"], "item_1583103067471": {"attribute_name": "Title", "attribute_value_mlt": [{"subitem_1551255647225": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture", "subitem_1551255648112": "en"}]}, "item_1583103085720": {"attribute_name": "Description", "attribute_value_mlt": [{"interim": "Nowadays, many applications need high reliability pipeline architecture to get faster process and reliable data within short time. Kafka has emerged as one of the important components of real-time processing pipelines in combination with Storm. This paper focuses to develop the real-time big data analytics pipeline architecture for reliability. Real-time data pipelines can be implemented in many ways and it will look different for every business. To develop the pipeline architecture, we create real time big data pipeline by using Apache Kafka and Apache Storm. Kafka and Storm naturally complement each other and their powerful cooperation enables real-time streaming analytics for fast-moving big data. Then, the experiment will be conducted how the processing time decreases with the same messages on the different partitions."}]}, "item_1583103108160": {"attribute_name": "Keywords", "attribute_value_mlt": [{"interim": "Messaging"}, {"interim": "Real-time processing"}, {"interim": "Apache Kafka"}, {"interim": "Apache Storm"}]}, "item_1583103120197": {"attribute_name": "Files", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_access", "date": [{"dateType": "Available", "dateValue": "2020-11-19"}], "displaytype": "preview", "download_preview_message": "", "file_order": 0, "filename": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf", "filesize": [{"value": "1.4 Mb"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensefree": "© 2017 ICAIT", "licensetype": "license_free", "mimetype": "application/pdf", "size": 1400000.0, "url": {"url": "https://meral.edu.mm/record/6257/files/Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf"}, "version_id": "de189b8c-c528-4fd6-9b59-0e3f1a4b169f"}]}, "item_1583103147082": {"attribute_name": "Conference papers", "attribute_value_mlt": [{"subitem_acronym": "ICAIT 2017", "subitem_c_date": "1-2 November, 2017", "subitem_conference_title": "1st International Conference on Advanced Information Technologies", "subitem_place": "Yangon, Myanmar", "subitem_session": "Cloud Computing and Big Data Analytics", "subitem_website": "https://www.uit.edu.mm/icait-2017/"}]}, "item_1583105942107": {"attribute_name": "Authors", "attribute_value_mlt": [{"subitem_authors": [{"subitem_authors_fullname": "Thandar Aung"}, {"subitem_authors_fullname": "Aung Htein Maw"}]}]}, "item_1583108359239": {"attribute_name": "Upload type", "attribute_value_mlt": [{"interim": "Publication"}]}, "item_1583108428133": {"attribute_name": "Publication type", "attribute_value_mlt": [{"interim": "Conference paper"}]}, "item_1583159729339": {"attribute_name": "Publication date", "attribute_value": "2017-11-02"}, "item_title": "Analytics of Reliability for Real-Time Big Data Pipeline Architecture", "item_type_id": "21", "owner": "45", "path": ["1605779935331"], "permalink_uri": "http://hdl.handle.net/20.500.12678/0000006257", "pubdate": {"attribute_name": "Deposited date", "attribute_value": "2020-11-19"}, "publish_date": "2020-11-19", "publish_status": "0", "recid": "6257", "relation": {}, "relation_version_is_last": true, "title": ["Analytics of Reliability for Real-Time Big Data Pipeline Architecture"], "weko_shared_id": -1}
  1. University of Information Technology
  2. International Conference on Advanced Information Technologies

Analytics of Reliability for Real-Time Big Data Pipeline Architecture

http://hdl.handle.net/20.500.12678/0000006257
http://hdl.handle.net/20.500.12678/0000006257
36b3fa4f-493f-497f-a96a-3686f2b4daae
b0d19cc6-a14e-4753-a9ea-307e8b9c95d0
None
Preview
Name / File License Actions
Analytics Analytics of Reliability for Real-Time Big Data Pipeline Architecture.pdf (1.4 Mb)
© 2017 ICAIT
Publication type
Conference paper
Upload type
Publication
Title
Title Analytics of Reliability for Real-Time Big Data Pipeline Architecture
Language en
Publication date 2017-11-02
Authors
Thandar Aung
Aung Htein Maw
Description
Nowadays, many applications need high reliability pipeline architecture to get faster process and reliable data within short time. Kafka has emerged as one of the important components of real-time processing pipelines in combination with Storm. This paper focuses to develop the real-time big data analytics pipeline architecture for reliability. Real-time data pipelines can be implemented in many ways and it will look different for every business. To develop the pipeline architecture, we create real time big data pipeline by using Apache Kafka and Apache Storm. Kafka and Storm naturally complement each other and their powerful cooperation enables real-time streaming analytics for fast-moving big data. Then, the experiment will be conducted how the processing time decreases with the same messages on the different partitions.
Keywords
Messaging, Real-time processing, Apache Kafka, Apache Storm
Conference papers
ICAIT 2017
1-2 November, 2017
1st International Conference on Advanced Information Technologies
Yangon, Myanmar
Cloud Computing and Big Data Analytics
https://www.uit.edu.mm/icait-2017/
Back
0
0
views
downloads
See details
Views Downloads

Versions

Ver.1 2020-11-19 14:18:38.688987
Show All versions

Share

Mendeley Twitter Facebook Print Addthis

Export

OAI-PMH
  • OAI-PMH DublinCore
Other Formats
  • JSON

Confirm


Back to MERAL


Back to MERAL