[Ubuntu] Embodied AI Simulator ์„ค์น˜ - Habitat

2022. 7. 20. 13:27ยท๐ŸŒŒ OS/Linux-๋ฆฌ๋ˆ…์Šค
728x90
728x90

 

Embodied AI Simulator์˜ 3๋ฒˆ์งธ, Habitat์„ ์„ค์น˜ํ•ด๋ณด์•˜๋‹ค.

 

Habitat-Sim์ด๋ž€?

๊ณ ์„ฑ๋Šฅ ๋ฌผ๋ฆฌ 3D ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ Habitat์€ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๊ธฐ๋Šฅ์„ ์ง€์›ํ•œ๋‹ค.

  • ์‹ค๋‚ด/์™ธ ๊ณต๊ฐ„์˜ 3D ์Šค์บ” (HM3D, MatterPort3D, Gibson, Replica ๋“ฑ์˜ ๋ฐ์ดํ„ฐ์…‹์— ๋Œ€ํ•œ ๋‚ด์žฅ ์ง€์› ํฌํ•จ)
  • ๊ณต๊ฐ„ ๋ฐ ์˜ค๋ธŒ์ ํŠธ๋ณ„ ๊ฐ•์ฒด ๊ฐ์ฒด์˜ CAD ๋ชจ๋ธ (ReplicaCAD, YCB, Google Scanned Objects)
  • ๊ตฌ์„ฑ ๊ฐ€๋Šฅํ•œ ์„ผ์„œ (RGB-D cameras, egomotion sensing)
  • URDF๋กœ ์ž‘์„ฑ๋œ ๋กœ๋ด‡ (Fetch-๋ชจ๋ฐ”์ผ ์กฐ์ž‘๊ธฐ, Franka-๊ณ ์ •๋œ ํŒ”, AlienGo-์‚ฌ์กฑ๋ณดํ–‰ ๋กœ๋ด‡)
  • Bullet์„ ํ†ตํ•œ ๊ฐ•์ฒด์—ญํ•™

Habitat์˜ ์„ค๊ณ„ ์ฒ ํ•™์€ ๋‹ค์–‘ํ•œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๊ธฐ๋Šฅ๋ณด๋‹ค ์‹œ๋ฎฌ๋ ˆ์ด์…˜์˜ ์†๋„๋ฅผ ์šฐ์„ ์‹œํ•˜๋Š” ๊ฒƒ์ด๋‹ค. Matterport3D ๋ฐ์ดํ„ฐ์…‹์—์„œ ์žฅ๋ฉด์„ ๋ Œ๋”๋งํ•  ๋•Œ ๋‹จ์ผ ์Šค๋ ˆ๋“œ์—์„œ ์ดˆ๋‹น ์ˆ˜์ฒœ ํ”„๋ ˆ์ž„(FPS)์„ ๋‹ฌ์„ฑํ•˜๊ณ , ๋‹จ์ผ GPU์—์„œ 10,000 ํ”„๋ ˆ์ž„(FPS) ๋ฉ€ํ‹ฐ ํ”„๋กœ์„ธ์Šค์— ๋„๋‹ฌํ•œ๋‹ค. ์ดˆ๋‹น 8,000 ๋‹จ๊ณ„(SPS) ์ด์ƒ์˜ CAD ์žฅ๋ฉด์—์„œ ๊ฐ ๋‹จ๊ณ„๋Š” 1๊ฐœ์˜ RGB-D ๊ด€์ฐฐ(128*128 pixel)๊ณผ 1/30์ดˆ ๋™์•ˆ ๊ฐ•์ฒด์—ญํ•™์„ ๋ Œ๋”๋งํ•œ๋‹ค. Embodied AI์˜ end-to-end Task๋ฅผ ์œ„ํ•œ ๋ชจ๋“ˆ์‹ ๊ณ ๊ธ‰ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ธ Habitat-Lab๊ณผ ํ•จ๊ป˜ ์‚ฌ์šฉ๋œ๋‹ค.

 


 

Habitat-Sim Installation

Habitat ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” 3๊ฐ€์ง€ ๋ฐฉ๋ฒ•์œผ๋กœ ์„ค์น˜ํ•  ์ˆ˜ ์žˆ๋‹ค.

  1. Conda : ๊ถŒ์žฅ ๋ฐฉ๋ฒ•์œผ๋กœ, ์•ˆ์ •์ ์ธ ๋ฆด๋ฆฌ์ฆˆ๋ฅผ ์ œ๊ณตํ•œ๋‹ค.
  2. Docker : Habitat Challenge๋ฅผ ์œ„ํ•ด 1๋…„์— ํ•œ ๋ฒˆ ์—…๋ฐ์ดํŠธ ๋˜๋Š” ๋ฒ„์ „์ด๋‹ค.
  3. Source : ๋Šฅ๋™์ ์ธ ๊ฐœ๋ฐœ์šฉ์œผ๋กœ ์‚ฌ์šฉ๋œ๋‹ค.
  4. [Veta] PIP : pip install์„ ํ†ตํ•ด Bullet์œผ๋กœ ์ปดํŒŒ์ผํ•œ๋‹ค.

 

๋‹ค์Œ ์ค‘ Conda๋ฅผ ์ด์šฉํ•œ ๋ฐฉ๋ฒ•์œผ๋กœ Habitat์„ ์„ค์น˜ํ•  ๊ฒƒ์ด๋‹ค. Conda๊ฐ€ ์„ค์น˜๋˜์–ด ์žˆ๋‹ค๋Š” ๊ฐ€์ •ํ•˜์— Install์„ ์‹œ์ž‘ํ•œ๋‹ค.

 

 

1) ๊ฐ€์ƒ ํ™˜๊ฒฝ์„ ์ƒ์„ฑํ•œ๋‹ค.

# We require python>=3.7 and cmake>=3.10
$ conda create -n habitat python=3.7 cmake=3.14.0
$ conda activate habitat

 

2) ์˜์กด ํŒจํ‚ค์ง€๋ฅผ ์„ค์น˜ํ•œ๋‹ค. ํ˜„์žฌ ๋ฆฌ๋ˆ…์Šค(์ฝ˜๋‹ค)์˜ ํ™˜๊ฒฝ์— ๋”ฐ๋ผ ์•Œ๋งž์€ ๋ฒ„์ „์„ ์„ค์น˜ํ•ด์•ผ ํ•œ๋‹ค. ๋Œ€๋ถ€๋ถ„์˜ ๊ฒฝ์šฐ, ์•„๋ž˜์™€ ๊ฐ™์ด ์„ค์น˜ํ•˜๋ฉด ๋˜๋‚˜ ์ž‘๋™ํ•˜์ง€ ์•Š๋Š”๋‹ค๋ฉด ๋”๋ณด๊ธฐ๋ž€์˜ ๊ณต์‹ ์‚ฌ์ดํŠธ์—์„œ ๋‹ค๋ฅธ ์„ค์น˜๋ฒ•์„ ์ฐธ์กฐํ•˜๋ฉด ๋œ๋‹ค.

$ conda install habitat-sim -c conda-forge -c aihabitat

 

3) ํ…Œ์ŠคํŒ…์„ ์œ„ํ•ด 3D ์žฅ๋ฉด๊ณผ Object๋ฅผ ๋‹ค์šด๋กœ๋“œํ•œ๋‹ค.

$ python -m habitat_sim.utils.datasets_download --uids habitat_test_scenes --data-path /path/to/data/
$ python -m habitat_sim.utils.datasets_download --uids habitat_example_objects --data-path /path/to/data/

 

4) ๋‹ค์šด๋กœ๋“œํ•œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์„ ์‹คํ–‰ํ•œ๋‹ค.

# C++
habitat-viewer /path/to/data/scene_datasets/habitat-test-scenes/skokloster-castle.glb

# Python
python examples/viewer.py --scene /path/to/data/scene_datasets/habitat-test-scenes/skokloster-castle.glb

 

 

๋”๋ณด๊ธฐ

๊ณต์‹ ์‚ฌ์ดํŠธ: https://aihabitat.org/

 

AI Habitat

A platform for embodied AI research.

aihabitat.org

๊ด€๋ จ Github: https://github.com/facebookresearch/habitat-sim/tree/0c33790059a41076ee3ee9b4f9d7ba10a10eebd1

 

GitHub - facebookresearch/habitat-sim: A flexible, high-performance 3D simulator for Embodied AI research.

A flexible, high-performance 3D simulator for Embodied AI research. - GitHub - facebookresearch/habitat-sim: A flexible, high-performance 3D simulator for Embodied AI research.

github.com

728x90
320x100
์ €์ž‘์žํ‘œ์‹œ (์ƒˆ์ฐฝ์—ด๋ฆผ)

'๐ŸŒŒ OS > Linux-๋ฆฌ๋ˆ…์Šค' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€

[E] conda: command not found  (0) 2022.07.20
[E] CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.  (0) 2022.07.20
[Ubuntu] pip(Python Package Index) ์„ค์น˜ ๋ฐฉ๋ฒ•  (0) 2022.07.18
[Ubuntu] Embodied AI Simulator ์„ค์น˜ - AI2-THOR  (0) 2022.07.18
[Ubuntu] Embodied AI Simulator ์„ค์น˜ - iGibson  (0) 2022.07.18
'๐ŸŒŒ OS/Linux-๋ฆฌ๋ˆ…์Šค' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€
  • [E] conda: command not found
  • [E] CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
  • [Ubuntu] pip(Python Package Index) ์„ค์น˜ ๋ฐฉ๋ฒ•
  • [Ubuntu] Embodied AI Simulator ์„ค์น˜ - AI2-THOR
mxnxeonx
mxnxeonx
"์•„, ์ด๊ฑฐ ๋ญ์˜€๋”๋ผ"๋ฅผ ํ•˜์ง€ ์•Š๊ธฐ์œ„ํ•œ ์ผ๊ธฐ์žฅ.
  • mxnxeonx
    MJ's Development Diary
    mxnxeonx
  • ์ „์ฒด
    ์˜ค๋Š˜
    ์–ด์ œ
    • ๋ถ„๋ฅ˜ ์ „์ฒด๋ณด๊ธฐ (154)
      • ๐Ÿ’ป Language (43)
        • Java : ์ž๋ฐ” (18)
        • Python : ํŒŒ์ด์ฌ (9)
        • ROS : ๋กœ๋ด‡์‹œ์Šคํ…œ (9)
        • Android : ์•ˆ๋“œ๋กœ์ด๋“œ (4)
        • JavaScript : ์ž๋ฐ”์Šคํฌ๋ฆฝํŠธ (2)
      • ๐ŸŒ Environment (19)
        • IDE : ํ†ตํ•ฉ๊ฐœ๋ฐœํ™˜๊ฒฝ (9)
        • Virtual : ๊ฐ€์ƒํ™˜๊ฒฝ (10)
      • โš™ Framework (12)
        • Vue-๋ทฐ (3)
        • Spring-์Šคํ”„๋ง (7)
      • ๐Ÿ’พ DataBase (18)
      • ๐ŸŒŒ OS (36)
        • Linux-๋ฆฌ๋ˆ…์Šค (36)
      • ๐Ÿ’ฌ CI · CD (7)
        • Git : ๊นƒ (7)
      • ๐Ÿ“ƒ ETC (3)
      • ๐Ÿค– AI (4)
  • ๋งํฌ

    • GitHub
  • ์ธ๊ธฐ ๊ธ€

  • ์ตœ๊ทผ ๋Œ“๊ธ€

  • ์ตœ๊ทผ ๊ธ€

  • hELLOยท Designed By์ •์ƒ์šฐ.v4.10.3
mxnxeonx
[Ubuntu] Embodied AI Simulator ์„ค์น˜ - Habitat
์ƒ๋‹จ์œผ๋กœ

ํ‹ฐ์Šคํ† ๋ฆฌํˆด๋ฐ”