given this dataframe how can I find where if rows are grouped by first name and last name, the row with type as ‘CA’ get its Value column set to the row with type as ‘GCA’ value? so in this example the first row Alice, Johnson, CA, 25 will have its value changed from 25… Read More Assign values to a grouped by dataframe

I have a pandas dataframe: d = {‘col1’: [‘Date1’, ‘Date1’, ‘Date1’, ‘Date2’, ‘Date2’, ‘Date2’, ‘Date3’, ‘Date3’, ‘Date3’, ‘Date4’, ‘Date4’, ‘Date4’], ‘col2’: [‘Date2’, ‘Date3’, ‘Date4’, ‘Date1’, ‘Date3’, ‘Date4’, ‘Date1’, ‘Date2’, ‘Date4’, ‘Date1’, ‘Date2’, ‘Date3’]} df = pd.DataFrame(data=d) How do I get a unique list of combinations of the values in the columns, like this? I have… Read More Create new dataframe based on distinct combinations of column values in Python

I have a table with data for who viewed a page and who clicked on it. The following code gets me the pivot table below: # users who clicked, by hour and weekday pct = df.pivot_table(columns=[‘weekday’],index=[‘hour’], values=[‘users_who_clicked’,’users_who_viewed’], aggfunc= sum, fill_value=0, margins=True) pct pivot table I’ve been googling and searching here for a solid hour but… Read More Calculate % in Pandas pivot_table?

I have three dfs related to the order from customers, and some steps for preprocessing of that. So, in one df I define some units in the gramaz df. which if we have that in the order, we should delete them. Like, if we have the pepper in the order, we should change that to:… Read More delete the units from an order from customers based on another table

I want to change .append to .concat. I got the following error ValueError: Must pass 2-d input. shape=(1, 2, 2). I looked already at Error "'DataFrame' object has no attribute 'append'" I tried but unfortunately I got the error above. How do I fix this issue? I want to add an empty row between every… Read More Add empty row between every new market

Imagine you have two dataframes in R, for example. Imagine that columns could have any kind of names, not always a or b. Also there could be much more columns, dozens or even hundreds. a <- data.frame( id = seq(1, 4), a = c(0, 0, 1, 1), b = c(3, 3, 1, 1) ) b… Read More R Merge two dataframes with same columns

I have this df: A B C D 1 2 3 4 I want to extract columns 0:1 and 3rd one But first thought would be: X = DS.iloc[:, 0:1:3].values But, this approach does not work >Solution : If really you need to work with ranges, use numpy.r_ to combine them: out = df.iloc[:, np.r_[0:2,3]]… Read More Python: Extract different columns and assign to a new dataframe

I’m currently trying to find the best solution to this problem: I import a csv into Python, some of the cells have values and some don’t. I want to loop through the dataframe and if a cell has a value, append a number to it which is incremented each time a new cell has text.… Read More Prefixing each item in a Pandas DataFrame with an ascending number if it has a value

Assuming for the dataframe df as follows: date actual_value fitted_value predicted_value code 0 2023/8/31 NaN NaN 520.994413 LX0301 1 2023/9/30 NaN NaN 580.967973 LX0301 2 2023/10/31 NaN NaN 650.392867 LX0301 3 2023/8/31 471.459992 520.027310 NaN LX0301 4 2023/9/30 NaN NaN 531.199547 LX0301 5 2023/10/31 NaN NaN 600.053484 LX0301 6 2023/8/31 471.459992 511.902229 NaN LX0301 7… Read More Groupby one column, if the date column are the same, fill in the missing values in the numerical column

Suppose I have a function that does something based on a DataFrame but doesn’t return a value. Something like, writing to a log file, or uploading to a database. def some_func_no_return_value(df): # Do something based on df return # Doesn’t return anything I have some code that does this: for key, df_group in df.groupby(some_column): some_func_no_return_value(df_group)… Read More Can I use pandas `groupby().apply()` to do stuff that doesn't return a value?