Python: How to validate and append non-existing row in a dataset/dataframe?

January 28, 2023

How can we append a non-existing row/value in a dataset? I have here a sample table with list of names and the objective is to validate first the name if this doesn’t exist and append it to the dataset.

Please see code below for reference:

import pandas as pd


df = pd.DataFrame.from_dict({
    'Name': ['Nik', 'Kate', 'Evan', 'Kyra'],
    'Age': [31, 30, 40, 33],
    'Location': ['Toronto', 'London', 'Kingston', 'Hamilton']
})

df = df.append({'Name':'Jane', 'Age':25, 'Location':'Madrid'}, ignore_index=True)
print(df)

>Solution :

you can check the condition before insering in the dataframe :

import pandas as pd

df = pd.DataFrame.from_dict({
    'Name': ['Nik', 'Kate', 'Evan', 'Kyra'],
    'Age': [31, 30, 40, 33],
    'Location': ['Toronto', 'London', 'Kingston', 'Hamilton']
})

if 'Jane' not in df.Name.values:
    df = df.append({'Name':'Jane', 'Age':25, 'Location':'Madrid'}, ignore_index=True)
    print(df)