Far-right flank of party balks at backing top Republican unless demands met, leaving faction mired in chaos and lower chamber of Congress unable to call votes, swear-in new members