I have my screen lock setup with finger prints, and face recognition, try all tipes, patern, password, pin, iris, they all work and unlock the screen.
Problem is that if I swipe only the finger on the screen will unlock the phone too, this me or any person or any place as I don't have the smart lock on.
Can you have another look at your settings to see if Smart Lock is On or Off? Here's a guide to help you
Just a thought here try covering the top of the phone and swipe as mine unlocks all most in a instant as the phone will see your face and unlock the phone or get someone else to try it. :) Please let us know how it goes so we can help you further should the need arise.