The rector of the Benefice of Dickleburgh and the Pulhams has been suspended from ministry after it emerged he has been arrested by police.
Rev James Roskelly has been bailed until March 21 of next year pending further enquiries.
The Venerable Jan McFarlane, spokesperson for the Diocese of Norwich, said: “The Revd James Roskelly has been arrested and is helping police with their inquiries.
“Mr Roskelly has been suspended from ministry by the Bishop of Norwich pending the outcome of the police inquiries. We are co-operating fully with the police.
“The Bishop of Thetford and the Archdeacon of Norfolk are working to provide pastoral support and on-going ministry in the parishes, and our prayers are with all concerned.”
A spokesperson for Norfolk Police said: “Norfolk Constabulary can confirm a 58-year-old man from the Harleston area has been arrested in connection with an ongoing investigation.
“He’s been released on police bail until 21 March 2016 pending further enquiries.”
The benefice is made up of churches in Dickleburgh, Pulham Market, Pulham St Mary, Rushall, Starston, Thelveton, Frenze and Shimpling.