Suppose that I have a dataframe which can be created using code below df = pd.DataFrame(data = {‘date’:[‘2021-01-01’, ‘2021-01-02’, ‘2021-01-05′,’2021-01-02’, ‘2021-01-03’, ‘2021-01-05’], ‘product’:[‘A’, ‘A’, ‘A’, ‘B’, ‘B’, ‘B’], ‘price’:[10, 20, 30, 40, 50, 60] } ) df[‘date’] = pd.to_datetime(df[‘date’]) I want to create an empty dataframe let’s say main_df which will contain all dates between… Read More Create Multi-Index empty DataFrame to join with main DataFrame

The code below shows what I would like to do. Is it possible to do it without the iteritems iteration? Basically I have a DataFrame df with a MultiIndex, and I have a smaller, boolean DataFrame sdf, without the MultiIndex. I would to use sdf as a preselection/mask to set values in df. mi =… Read More Pandas DataFrame subselection

Am trying to create a multi-column table, meaning a column has three sub-columns. I tried a solution from this: How to Insert a List of Data into Pandas Multi-Index Dataframe But the thing is that it passes a list, each item in the list corresponds to a column; i want to pass a data frame… Read More Pandas, Multi Column Table

I am calculating concentrations from a file that has separate Date and Time columns. I set the date and time columns as indexes as they are not suppose to change. However when I print the new dataframe it only prints the "date" one time like this: 55… Date Time 2020-12-30 10:37:04 0.000000 … 10:37:07 0.000000… Read More Pandas: Printing all the values from an index

I’m trying to add a third column "Productivity" so every role like Admin would have three sub columns produktiv, unproduktiv and Productivity. Productivity would be calculated as follows: Productivity = Produktiv / (Produktiv + Unproduktiv) * 100 (don’t mind the s, I had to anonymize the data) Here is the output of df.columns Any help… Read More How to add another subcolumn to dataframe with multi-index

What I want to do I have two pandas.DataFrame, df1 and df2. Both have the same columns. All indices in df2 are also found in df1, but there are some indices that only df1 has. Rows with an index that is owned by both df1 and df2, use rows of df2. Rows with an index… Read More Replace values in pandas.DataFrame using MultiIndex

Let’s say we have a MultiIndex DataFrame, and said DataFrame looks something like this: 0 source date row Alpha 01-01 0 0.183436 1 -0.210341 Beta 02-01 0 -0.950784 1 0.259809 How would I go about getting the unique dates as a list in the shown order above? i.e. [’01-01′, ’02-01′] I know I can access… Read More How to access index value(s), preferably by name, in MultiIndex DataFrame?

With the following dataframe df1: 0 1 0 0 8 2 1 13 5 2 11 9 3 4 1 4 83 3 1 0 25 3 1 22 4 2 87 8 3 60 8 4 33 7 How can I consecutively add up two rows from the top of the inner level leaving… Read More How to add up two consecutive rows in a multiindex dataframe repeating the last one in the group if it has an odd number of rows?

I have a multi-index dataframe that is set up as follows: index = pd.MultiIndex.from_product([[‘A’,’B’,’C’], [‘x’,’y’, ‘z’]]) multi_index = pd.DataFrame(np.nan, index=np.arange(10), columns=index) Which produces the following output: A B C x y z x y z x y z 0 NaN NaN NaN NaN NaN NaN NaN NaN NaN 1 NaN NaN NaN NaN NaN NaN… Read More Changing the Values of a Multi-Index Dataframe

I have a dataframe like so dfDictionary = {‘Results’:[‘Home’, ‘Away’, ‘For’, ‘Against’ ], ‘info’:[ ‘-‘, ‘-‘,’-‘,’-‘,], ‘rating’:[ ‘-‘, ‘-‘,’-‘,’-‘,], ‘review’:[ ‘-‘, ‘-‘,’-‘,’-‘,]} dfTable1 = pd.DataFrame(dfDictionary) It looks like below Results info rating review 0 Home – – – 1 Away – – – 2 For – – – 3 Against – – – I created… Read More Remove the column used for index with pd.MultiIndex.from_product