Can you track the changes to pickle files with git like you can with csv? If you have a 1GB pickle file and you add 0.1GB to it each day and then push the changes to github, will it push the 0.1GB diff or the entire 1GB file? I need to choose a file type for data storage. Pickle will take up less space, but if it uses more bandwidth I’ll use csv.
>Solution :
You can do it, but for large data files you can try some specialized git-based solutions: