A father and daughter who made a “vulnerable” man carry out forced labour for up to five years are jailed.