Previous Owner Took Heavy Deposit From Multiple People

Hi, I recently bought a house from a person who was unable to Pay his home loan. While buying this house I came to know that the owner have rented his house to someone with heavy deposit. While clearing all the dues and taking noc from builder and Bank I made sure the owner pays the heavy deposit back to the person whom he rented his house. Recently I shifted to new house and couple of people came to my house saying they have already given heavy deposit to previous owner to rent this house. What legal rights do I have and does this mean I have to pay dues of previous owner? How can I avoid them coming to me and go to the previous owner with whom they made the agreement. Thanks