๐Ÿ‘Ÿ

VANAS: A Visual Analytics Systems for Neural Architecture Search

VANAS: A Visual Analytics System for Neural Architecture Search

Jiwon Choi, Gwon Hong, and Jaemin Jo
Proceedings of HCI KOREA 2022

Abstract

๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์‹ ๊ฒฝ๋ง ๊ตฌ์กฐ ํƒ์ƒ‰(Neural Architecture Search, NAS) ์•Œ๊ณ ๋ฆฌ์ฆ˜์˜ ํƒ์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ๋ถ„์„ํ•˜๊ณ  ์‹œ๊ฐํ™”ํ•˜๋Š” ์‹œ์Šคํ…œ์ธ VANAS ๋ฅผ ์ œ์•ˆํ•œ๋‹ค. ๋ฐฉ๋Œ€ํ•œ ํƒ์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ํšจ์œจ์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ธฐ ์œ„ํ•ด ๊ฐ„์„ ์˜ ์ค‘์š”๋„ ๋ฐ ๊ธฐ์—ฌ๋„๋ฅผ ์ •๋Ÿ‰ํ™”ํ•˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ๊ณ ์•ˆํ•˜๊ณ  ์ด๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์‚ฌ์šฉ์ž์—๊ฒŒ ๊ตฌ์กฐ๋ฅผ ์ถ”์ฒœํ•˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ๊ตฌํ˜„ํ•˜์˜€๋‹ค. ์ด๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ํƒ์ƒ‰ ๊ณต๊ฐ„์— ๋Œ€ํ•œ ์ „๋ฐ˜์ ์ธ ํŠน์ง•์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋Š” ์˜ค๋ฒ„๋ทฐ์™€ ์‹ฌ์ธต ์‹ ๊ฒฝ๋ง ๊ตฌ์กฐ๋ฅผ ์„ค๊ณ„ํ•˜๊ณ  ๋ถ„์„ํ•  ์ˆ˜ ์žˆ๋Š” ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค๋ฅผ ๋””์ž์ธํ•˜์˜€๋‹ค. VANAS ๋ฅผ ํ†ตํ•˜์—ฌ NAS ๋ถ„์•ผ์˜ ํ‘œ์ค€ ๋ฒค์น˜๋งˆํฌ ๋ฐ์ดํ„ฐ ์ค‘ ํ•˜๋‚˜์ธ NAS-Bench-101 ์„ ๋ถ„์„ํ•œ ๊ฒฐ๊ณผ, ์‹ ๊ฒฝ๋ง์„ ๊ตฌ์„ฑํ•˜๋Š” ์ •์  ๋ฐ ๊ฐ„์„ ์˜ ์ค‘์š”๋„๋ฅผ ํ™•์ธํ•˜๊ณ , ์‹œ์Šคํ…œ์ด ์ œ์•ˆํ•˜๋Š” ๊ฐ„์„ ์„ ์ถ”๊ฐ€ํ•˜์—ฌ ์ •ํ™•๋„๋ฅผ ์ ์ง„์ ์œผ๋กœ ๊ฐœ์„ ํ•  ์ˆ˜ ์žˆ์Œ์„ ํ™•์ธํ•˜์˜€๋‹ค.

Tech Stack

Modern Javascript, d3.js, Bootstrap
Jupyter Notebook, Tensorflow, Python

My Work

โ€ข
Research
โ—ฆ
์—ฐ๊ตฌ ์ „๋ฐ˜ (์ฃผ์ €์ž)
โ—ฆ
์ธ๊ณต์ง€๋Šฅ๊ณผ์˜ ์ƒํ˜ธ์ž‘์šฉ์„ ์œ„ํ•œ ๋””์ž์ธ ์‹œ์Šคํ…œ ์„ค๊ณ„
โ—ฆ
NAS Search Space Visualize๋ฅผ ์œ„ํ•œ Metric ์ˆ˜์‹์  ์„ค๊ณ„
โ—ฆ
์‹ ๊ฒฝ๋ง ๊ตฌ์„ฑ์˜ ์„ค๋ช…๋ ฅ์„ ์œ„ํ•œ Metric ์ˆ˜์‹์  ์„ค๊ณ„
โ—ฆ
๋…ผ๋ฌธ ์ž‘์„ฑ ๋ฐ ๋ฐœํ‘œ
โ—ฆ
tfrecord Dataset ๋ถ„์„, ๊ฒฝ๋Ÿ‰ํ™” ๋ฐ JSON ํฌํŒ…
โ—ฆ
Grpah Isomorphism์„ ์œ„ํ•œ Label ๊ธฐ๋ฐ˜์˜ Graph Match Algorithm ๊ณ ์•ˆ
โ€ข
Development
โ—ฆ
๋ฐ”๋‹๋ผ JavaScript๋งŒ ์‚ฌ์šฉํ•œ ์ธํ„ฐํŽ˜์ด์Šค ๊ฐœ๋ฐœ
โ—ฆ
d3 ๊ธฐ๋ฐ˜์˜ Information Visualization ๊ฐœ๋ฐœ
โ€ข
Design
โ—ฆ
์ธ์ง€ ๋ฐฉํ–ฅ๊ณผ Shiendermanโ€™s Visualization Mantra๋ฅผ ๊ณ ๋ คํ•œ ๋””์ž์ธ ๊ตฌ์„ฑ
โ—ฆ
๊ณ„์ธต๊ณผ ์–‘์  ๊ด€๊ณ„๋ฅผ ๊ณ ๋ คํ•œ ์ปฌ๋Ÿฌ ์Šคํ‚ด