Job description
I will outsource parsing the CSV file, removing duplicates and importing all columns into the database.
In addition, you will need to set up a CRON that will check the CSV once a day at 2 a.m. to see if there are new changes and, if so, update the database.
The biggest challenge is to remove duplicates, which are virtually unrelated. On the other hand, somehow it can certainly be done, because the competition has a similar solution