Housing will not be the sole determinant in deciding the scale of cuts the Coalition proposes to the nation's migration program, opposition home affairs spokesperson Jonno Duniam says.