You need to format the date into a string - as this is a formula then the Excel function you need is TEXT -
TEXT function - Microsoft Support[
^]
e.g.
="INSERT INTO #TEMP VALUES("&A2 &","&B2 &",'"&TEXT(C2,"YYYY-MM-DD")&"','"&TEXT(D2, "YYYY-MM-DD")&"')"