For those living in the village at centre of asylum crisis, it's become an all-encompassing fight since June