Get data from .pickle

I have a model of Multinomial NB(): text_clf_NB = Pipeline([(‘vect’, CountVectorizer()), (‘tfidf’, TfidfTransformer()), (‘clf’, MultinomialNB()), ]) text_clf_NB.fit(Train_X_NB, Train_Y_NB) I save it to .pickle pickle.dump(text_clf_NB, open("NB_classification.pickle", "wb")) In another case I load this model: clf = pickle.load(open("NB_classification.pickle", "rb")) Can you help me, please, how can I get sparse matrix of Train data? I mean I want… Read More Get data from .pickle

April 7, 2023 MRLeave a comment

Keep model made with TFIDF for predicting new content using Scikit for Python

this is a sentiment analysis model made with tf-idf for feature extraction i want to know how can i save this model and reuse it. i tried saving it this way but when i load it , do same pre-processing on the test text and fit_transform on it it gave an error that the model… Read More Keep model made with TFIDF for predicting new content using Scikit for Python

May 26, 2022 MRLeave a comment

Get individual sentences from TF-IDF

so I used tf-idf on a bunch of sentence, but now I would like to get the TF-IDF vector for an individual sentence back. This is my code. How do I now get the first item in the text matrix? tfidf = TfidfVectorizer( min_df = 5, max_df = 0.95, max_features = 8000 ) tfidf.fit(df_m_a[‘text_final’]) text… Read More Get individual sentences from TF-IDF

May 19, 2022 MRLeave a comment

Add column in pandas vectorized

i have a Term-Frequency matrix saved as a pandas dataframe. 1000 Merkwürdig Mindestens Error … Periode bildet 30 Button 0 0 0 0 0 … 0 0 0 0 1 0 1 0 2 … 0 0 0 0 2 0 0 0 0 … 0 0 0 0 3 0 0 0 0 …… Read More Add column in pandas vectorized

November 17, 2021 MRLeave a comment

Dev solutions

Solutions for development problems

Tag: tf-idf

Get data from .pickle

Keep model made with TFIDF for predicting new content using Scikit for Python

Get individual sentences from TF-IDF

Add column in pandas vectorized