Someone on this platform has already helped me with generating the following code: col,row = (100,1000) a = np.random.uniform(0,10,size=col*row).round(6).reshape(row,col) mask = (a*1e6+1).astype(int)%10<2 a[mask] += 2e-6 This code ensures that the last decimal is not a 0 or a 9. However, I would like to have no 0’s nor 9’s in all the decimals that are… Read More Replace decimals in floating point numbers
What I want here is for the Nans to ultimately be integer values. Since my dataset is 1000s of columns, I can’t just change a couple of columns to make them integer and when I tried df = df.astype(‘int’) in Dask, after changing the values to 0 floats, for whatever reason, it didn’t work. `… Read More Filling NAs to string 0 and then to int reverts to float
I have a pearson correlation heat map coded, but its showing data from my dataframe which i dont need. is there a way to specify which columns i’d like to include? thanks in advance sb.heatmap(df[‘POPDEN’, ‘RoadsArea’, ‘MedianIncome’, ‘MedianPrice’, ‘PropertyCount’, ‘AvPTAI2015’, ‘PTAL’].corr(), annot=True, fmt=’.2f’) ————————————————————————— TypeError Traceback (most recent call last) <ipython-input-54-832fc3c86e3e> in <module> —-> 1… Read More how to specify data on pearson correlation heatmap?
I have a dataframe column like this: df[‘col_name’].unique() >>>array([-1, ‘Not Passed, On the boundary’, 1, ‘Passed, On the boundary’, ‘Passed, Unclear result’, ‘Passes, Unclear result, On the boudnary’, ‘Rejected, Unclear result’], dtype=object) In this column, if an element contains the word ‘Passed’ as a field or as a substring, then replace the entire field with… Read More Dataframe conditional replacement with intigers
I have panel data and I would like to get the percentage of observations in a column (Size) that are below 1 million. My data is the following: structure(list(Product = c("A", "A", "A", "A", "A", "A", "B", "B", "B", "B", "B", "B", "C", "C", "C", "C", "C", "C"), Date = c("02.05.2018", "04.05.2018", "05.05.2018", "06.05.2018", "07.05.2018",… Read More R: Calculate percentage of observations in a column that are below a certain value for panel data
My code works but it doesn’t bring the header with the names, it only brings the numbers 0 1 … 10 , what can I do ? Utils_db.py def consulta_sql(sql): try: connection = psycopg2.connect(user="postgres", password="postgres", host="localhost", port="5432", database="tb_cliente") cursor = connection.cursor() except (Exception, psycopg2.Error) as error: try: cursor.execute(sql) connection.commit() except (Exception, psycopg2.Error) as error: finally:… Read More Export Postgresql Table to excel with header in Python
I have a df (dataframe A) with over 200k rows with incorrect ids scattered throughout a single column (id). I have a another df (dataframe B) with all the incorrect ids of dataframe A matched with corrected ids. How can I use dataframe B to fix the errors in the id column of dataframe A?… Read More R: Find and replace character in one df col with character from another df
Suppose I have a groupby object (grouped on Col1) like below: Col1 Col2 Col3 Col4 Col5 —————————————- AAA 001 456 846 239 row1 002 374 238 904 row2 003 456 846 239 row3 BBB 001 923 222 398 row1 002 923 222 398 row2 003 755 656 949 row3 CCC 001 324 454 565 row1… Read More Check for duplicate rows for a subset of columns in a Pandas DataFrameGroupBy object
I have a CSV data in which I want to merge every two rows in each of the columns. The code below works fine on other CSVs. However, it returns an error while mutating with this particular dataset. How can I fix this? The purpose is to merge every two rows in each of the… Read More R mutate error while merging every two rows into one
What is the syntax for removing duplicate rows of a pandas dataframe (where all of the columns match)? I tried using: df.drop_duplicates() but it doesn’t work. >Solution : try this df.drop_duplicates(inplace=True) you have to add inplace= True