You are legally entitled to that deduction. If you follow the rules and keep the required documentation, there is no reason to be scared out of taking the deduction. That's the burden that the IRS has set. They aren't going to be able to challenge your claim that you drove some miles for your church calling if it's documented properly. And it's easy to document it properly.