I only use faster charging if I need a quick top up if my battery is running low.
Otherwise I slow charge.
Fast charge as
@Pugs1957 has said, it won't drain the battery faster.
Thing to try and do is keep the battery cool. So any charging will heat the battery. Long term heating with fast charging will degrade the battery slightly faster than slower charging as the battery won't get heated as much.
Personally I will pop my phones on charge overnight and charge slowly, or in the evening when I don't use it.
Also using the phone while it's charging is not the best thing to do either