Zakah is one of the pillars of Islam and should be paid with integrity by those Muslims upon whom it is obligatory to those who deserve it, hoping for Allah's reward and fearing His punishment.
you were correct to pay the Zakah despite the conditions you mentioned, and you must pay Zakah on the money (Part No. 9; Page No. 188) you lent to this man with the passing of each lunar year.
Zakah is not due on the house you built to live in or on the land the government granted you unless you intend to sell this land and a lunar year has passed from the time you decided to sell it.
the deposits you pay back to the development fund and the other conditions you mentioned do not exempt you from paying Zakah. You must continue paying the Zakah and may Allah reward you with the best reward, and compensate you. Allah (Glorified and Exalted be He) says:
...and whatsoever you spend of anything (in Allâh’s Cause), He will replace it. And He is the Best of providers.
May Allah grant us success. May peace and blessings be upon our Prophet Muhammad, his family, and Companions.