Turns out that the following fields are going to make your bulk api export fail:
- Address fields like:
- Billing Address
- Shipping Address
- Latitude and Longitude fields like:
- BillingLatitude
- BillingLongitude
These are your most common "compound" fields. Once you remove these fields from your export, you should be ok.
Source: https://developer.salesforce.com/docs/atlas.en-us.api.meta/api/compound_fields.htm