Not only are tax changes making Buy To Let harder but also it is possible lenders may find it harder to lend money to landlords.