Here's an example using scikit-learn:
from sklearn.feature_extraction.text import TfidfVectorizer
import torch from transformers import AutoTokenizer, AutoModel
last_hidden_state = outputs.last_hidden_state[:, 0, :] The last_hidden_state tensor can be used as a deep feature for the text.
print(X.toarray()) The resulting matrix X can be used as a deep feature for the text.
Код действителен в течение 3 дней