Federal prosecutors based in Nashville have withdrawn from the criminal investigation of Tennessee Congressman Andy Ogles.