TGI does not support `device_map='auto'` yet

Created

Created

2023 Nov 15 16:25

Creator

Creator

Editor

Editor

Edited

Edited

2023 Nov 15 16:25

Refs

Refs

cpu or auto not supported model

Option to use CPU instead

Updated 2023 Sep 6 14:1

Is bert-base-uncased supported？

Updated 2023 Nov 15 16:32


CUDA_VISIBLE_DEVICES=0

Recommendations

////////