I have a raw data file containig texts of many books. the data formatted as following (sequencial number,book name, text) 0,book_a, " long content" 1,book_b," long content" 2,book_c," long content" how to parser and load the books to a python dicationary {‘id’: 0, ‘book_name’, ‘text’: "full text"} >Solution : I assumed your Raw data file… Read More parsing long raw data in Python

I wrote the code as follws to extract one single pdf file and put the text into a list. how can I modify the code that it iterates over a dictionary of pdf files and their name and create a dictionary and put the name and corresponding text into it? dic = { ‘0R.pdf’:’m1′, ‘2R.pdf’:’m2′,… Read More Iterating over a dictionary of pdf files and their name and create a dictionary and put the name and corresponding text into it

I am trying to count the number of times some words occur in a sentence while controlling for negations. In the example below, I write a very basic code where I count the number of times "w" appear in "txt". Yet, I fail to control for negations like "don’t" and/or "not". w = ["hello", "apple"]… Read More Count words in a sentence controlling for negations

I have a data frame and I want to delete rows that in the column "Phrase", pattern "___" exists. Index PHRASE Label 0 proposed by the president of the 1 1 Living ___ 1 2 "Murder, ___ Wrote" 0 But Imagin that the data fram has 2,000,000 enteries import re df_clean = pd.DataFrame() z =… Read More Delete rows with a certain condition in pandas

I have a text dataset that looks like this. import pandas as pd df = pd.DataFrame({‘Sentence’: [‘Hello World’, ‘The quick brown fox jumps over the lazy dog.’, ‘Just some text to make third sentence!’ ], ‘label’: [‘greetings’, ‘dog,fox’, ‘some_class,someother_class’ ]}) I want to transform this data into something like this. Is there a pythonic way… Read More Pythonic way to create dataset for multilabel text classification

Please help understand what is wrong with the code below. The code works fine if I pass values up to 34. Once I pass 35 or higher, the output is incorrect. tuk=0 if tuk <= 24: print (‘The text is very easy to read.’) elif tuk >= 25 & tuk <= 34: print(‘The text is… Read More Python if/elif statement not working correctly