Hello I have to files: I have this fist file ./j/n:jwillow@gmail.com:Test1 ./n/o:nanofranky@list.ru:Test2 ./j/r:franky@list.ru:Test2 ./j/d:jdmq77@hotmail.com:Test3 ./x/s:xsebastianmenendez@hotmail.com:Test4 ./r/s:rsebastianmenendez@hotmail.com:Test5 ./w/i:willow@gmail.com@gmail.com:Test6 And I want it to match this second file, but the whole email, not just the appearance of the word: willow@gmail.com franky@list.ru jdmq77@hotmail.com sebastianmenendez@hotmail.com So I want the output to be: ./j/r:franky@list.ru:Test2 ./j/d:jdmq77@hotmail.com:Test3 ./w/i:willow@gmail.com@gmail.com:Test6 I try with grep… Read More Grep Match entire email multiple lines

I am parsing 6k csv files to merge them into one. I need this for their joint analysis and training of the ML model. There are too many files and my computer ran out of memory by simply concatenating them. S = ‘’ for f in csv_files: # read the csv file #df = df.append(pd.read_csv(f))… Read More Memory Error when parsing a large number of files

I’m a beginner with regular expressions and am processing data from a pdf and with R. Unfortunately R did not capture the decimal points in the data so I need to replace specific occurrences of white space with periods. I was able to figure out an admittedly heavy handed solution to this problem but suspect… Read More R using regular expressions to replace nth occurrence of white space in strings

I have the following text as given \nOUTPUTFORMAT \n \’org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat\’\nLOCATION\n \’hdfs://nameservice1/user/hive/warehouse/dev_cmt.db/badge\’\nTBLPROPERTIES (\n \’spark.sql.create.version\’=\’2.4.0-cdh6.3.2\’, \n \’spark.sql.sources.schema.numPartCols\’=\’1\’, \n \’spark.sql.sources.schema.numParts\’=\’1\’ I want to delete everything from words LOCATION till beginning of TBLPROPERTIES. I am trying to use regex, but I have been unsuccesful till now. \nOUTPUTFORMAT \n \’org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat\’\nTBLPROPERTIES (\n \’spark.sql.create.version\’=\’2.4.0-cdh6.3.2\’, \n \’spark.sql.sources.schema.numPartCols\’=\’1\’, \n \’spark.sql.sources.schema.numParts\’=\’1\’ Thanks in advance for… Read More delete text and all new line characters between 2 words in pyhton

I have two dataframes with labels, I want to append or concat them at bottom of each other d = {} d[‘first_level’] = pd.DataFrame(columns=[‘idx’, ‘a’, ‘b’, ‘c’], data=[[10, 1, 2, 3], [20, 4, 5, 6]]).set_index(‘idx’) d[‘first_level2’] = pd.DataFrame(columns=[‘idx’, ‘a’, ‘b’, ‘c’], data=[[10, 1, 2, 3], [20, 4, 5, 6]]).set_index(‘idx’) df_final = pd.concat(d, axis=1,) writer =… Read More append several Pandas dataframe on top of each other in the same excel sheet

I have a pandas dataframe that contains only one column which contains a string. I want to apply a function to each row that will split the string by sentence and replace that row with rows generated from the function. Example dataframe: import pandas as pd df = pd.DataFrame(["A sentence. Another sentence. More sentences here.",… Read More How to replace a row in pandas with multiple rows after applying a function?