TGI does not support `device_map='auto'` yet

Created

Created

2023 Nov 15 16:25

Creator

Creator

Seonglae Cho

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Nov 15 16:25

Refs

Refs

cpu or auto not supported model

Option to use CPU instead

Updated 2023 Sep 6 14:1

Is bert-base-uncased supported？

Updated 2023 Nov 15 16:32

Recommendations

////////