Case had been major factor in rising tensions over the past few weeks in the East Jerusalem neighborhood, which had sparked warnings of a new war between Israel and Hamas