Police, pastor work to calm unruly crowd