The agreement is of  “Toutes” with “les fins …” as “fin” is feminine. In this case, semaine also feminine, but that does not affect the gender agreement. For instance, it could have been “Toutes les fins de mois …” - mois being masculine.