ログイン サインアップ
言語:

WEKO3

  • トップ
  • ランキング
To
lat lon distance
To

Field does not validate



インデックスリンク

インデックスツリー

メールアドレスを入力してください。

WEKO

One fine body…

WEKO

One fine body…

アイテム

{"_buckets": {"deposit": "c571a6d2-eaa2-4fed-b3b8-c260defdf2d1"}, "_deposit": {"created_by": 7, "id": "6389", "owners": [7], "pid": {"revision_id": 0, "type": "depid", "value": "6389"}, "status": "published"}, "_oai": {"id": "oai:nied-repo.bosai.go.jp:00006389", "sets": []}, "author_link": [], "item_10001_biblio_info_7": {"attribute_name": "書誌情報", "attribute_value_mlt": [{"bibliographicIssueDates": {"bibliographicIssueDate": "2021", "bibliographicIssueDateType": "Issued"}, "bibliographicPageEnd": "34", "bibliographicPageStart": "26", "bibliographic_titles": [{"bibliographic_title": "2021 29TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP 2021)", "bibliographic_titleLang": "en"}]}]}, "item_10001_description_5": {"attribute_name": "抄録", "attribute_value_mlt": [{"subitem_description": "High utilization of HPC system resources under constraints in electric power consumption or I/O workload is one of the primary goals to deal with high demand from application users. Utilization of CPU and memory, which is tightly related to electric power consumption, is counterpart metric of I/O activities in most HPC jobs. Towards higher utilization of HPC systems under restriction in management for electric power consumption and I/O activities, we need to care not to have hot-spots in power consumption or I/O operations because such situation leads to unstable system operation by exceeding capability of electric power supply or the I/O subsystem in such hot-spots. Analysis of a huge scale of log data collected from the K computer has revealed high correlation between I/O activities and CPU and memory utilization in some specific compute node layouts, showing unique characteristics of HPC jobs such as computation intensive or I/O-intensive. It has turned out that classifying jobs in terms of required electric power can divide into two groups, jobs consuming high electric power and I/O-intensive jobs. We have succeeded in job classification by achieving high correctness using machine learning approach, and we have confirmed effectiveness of the classification towards power-aware system operation in our next HPC system, the supercomputer Fugaku.", "subitem_description_language": "en", "subitem_description_type": "Other"}]}, "item_10001_publisher_8": {"attribute_name": "出版者", "attribute_value_mlt": [{"subitem_publisher": "IEEE COMPUTER SOC", "subitem_publisher_language": "en"}]}, "item_10001_relation_14": {"attribute_name": "DOI", "attribute_value_mlt": [{"subitem_relation_type_id": {"subitem_relation_type_id_text": "10.1109/PDP52278.2021.00014"}}]}, "item_10001_source_id_9": {"attribute_name": "ISSN", "attribute_value_mlt": [{"subitem_source_identifier": "1066-6192", "subitem_source_identifier_type": "ISSN"}]}, "item_creator": {"attribute_name": "著者", "attribute_type": "creator", "attribute_value_mlt": [{"creatorNames": [{"creatorName": "Yuichi Tsujita", "creatorNameLang": "en"}]}, {"creatorNames": [{"creatorName": "Atsuya Uno", "creatorNameLang": "en"}]}, {"creatorNames": [{"creatorName": "Ryuichi Sekizawa", "creatorNameLang": "en"}]}, {"creatorNames": [{"creatorName": "Keiji Yamamoto", "creatorNameLang": "en"}]}, {"creatorNames": [{"creatorName": "Fumichika Sueyasu", "creatorNameLang": "en"}]}]}, "item_language": {"attribute_name": "言語", "attribute_value_mlt": [{"subitem_language": "eng"}]}, "item_title": "Job Classification Through Long-Term Log Analysis Towards Power-Aware HPC System Operation", "item_titles": {"attribute_name": "タイトル", "attribute_value_mlt": [{"subitem_title": "Job Classification Through Long-Term Log Analysis Towards Power-Aware HPC System Operation", "subitem_title_language": "en"}]}, "item_type_id": "40001", "owner": "7", "path": ["1670839190650"], "permalink_uri": "https://nied-repo.bosai.go.jp/records/6389", "pubdate": {"attribute_name": "PubDate", "attribute_value": "2023-09-20"}, "publish_date": "2023-09-20", "publish_status": "0", "recid": "6389", "relation": {}, "relation_version_is_last": true, "title": ["Job Classification Through Long-Term Log Analysis Towards Power-Aware HPC System Operation"], "weko_shared_id": -1}
  1. 防災科研関係論文

Job Classification Through Long-Term Log Analysis Towards Power-Aware HPC System Operation

https://nied-repo.bosai.go.jp/records/6389
https://nied-repo.bosai.go.jp/records/6389
1ae8621b-1f6b-4c5f-815e-3e28e678ebf4
Item type researchmap(1)
公開日 2023-09-20
タイトル
言語 en
タイトル Job Classification Through Long-Term Log Analysis Towards Power-Aware HPC System Operation
言語
言語 eng
著者 Yuichi Tsujita

× Yuichi Tsujita

en Yuichi Tsujita

Search repository
Atsuya Uno

× Atsuya Uno

en Atsuya Uno

Search repository
Ryuichi Sekizawa

× Ryuichi Sekizawa

en Ryuichi Sekizawa

Search repository
Keiji Yamamoto

× Keiji Yamamoto

en Keiji Yamamoto

Search repository
Fumichika Sueyasu

× Fumichika Sueyasu

en Fumichika Sueyasu

Search repository
抄録
内容記述タイプ Other
内容記述 High utilization of HPC system resources under constraints in electric power consumption or I/O workload is one of the primary goals to deal with high demand from application users. Utilization of CPU and memory, which is tightly related to electric power consumption, is counterpart metric of I/O activities in most HPC jobs. Towards higher utilization of HPC systems under restriction in management for electric power consumption and I/O activities, we need to care not to have hot-spots in power consumption or I/O operations because such situation leads to unstable system operation by exceeding capability of electric power supply or the I/O subsystem in such hot-spots. Analysis of a huge scale of log data collected from the K computer has revealed high correlation between I/O activities and CPU and memory utilization in some specific compute node layouts, showing unique characteristics of HPC jobs such as computation intensive or I/O-intensive. It has turned out that classifying jobs in terms of required electric power can divide into two groups, jobs consuming high electric power and I/O-intensive jobs. We have succeeded in job classification by achieving high correctness using machine learning approach, and we have confirmed effectiveness of the classification towards power-aware system operation in our next HPC system, the supercomputer Fugaku.
言語 en
書誌情報 en : 2021 29TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP 2021)

p. 26-34, 発行日 2021
出版者
言語 en
出版者 IEEE COMPUTER SOC
ISSN
収録物識別子タイプ ISSN
収録物識別子 1066-6192
DOI
関連識別子 10.1109/PDP52278.2021.00014
戻る
0
views
See details
Views

Versions

Ver.1 2023-09-20 08:10:11.559081
Show All versions

エクスポート

OAI-PMH
  • OAI-PMH JPCOAR
  • OAI-PMH DublinCore
  • OAI-PMH DDI
Other Formats
  • JSON
  • BIBTEX

Confirm


Powered by WEKO3

Change consent settings


Powered by WEKO3

Change consent settings