--- updatedAt: 2025-10-22T09:37:56.000Z agentTools: projectIndex: https://docs.processout.com/llms.txt --- # Data warehouse exports ProcessOut offers daily exports of your transaction data in a S3 bucket. # Setup 1. ProcessOut gives you a role ARN that can read to the S3 bucket 2. You send to ProcessOut a user ARN 3. ProcessOut enables your user to assume the role 4. You have access to the S3 bucket :tada: # Daily export A daily export is a CSV file containing all the transaction operations that took place during the day. This means that it contains one row per operation, not per transaction. Note that only non-sandbox data is exported. # Bucket format The S3 bucket will contain all the historical daily exports partitioned by date (e.g. `s3://bucket_name/proj_xxx/2025/02/14.csv`). Every day, around 1am (UTC), a new file is added with the previous day's data. # Data format Here is the list of available columns in the exports: * `project_uid`: Unique identifier for the project. * `tx_uid`: Unique identifier for the transaction. * `tx_operation_uid`: Unique identifier for the transaction operation. * `challenge_indicator`: Indicator for whether a challenge was requested during authentication. * `sca_exemption_reason`: Reason for Strong Customer Authentication (SCA) exemption. * `invoice_uid`: Unique identifier for the invoice. * `gateway_configuration_uid`: Unique identifier for the payment gateway configuration. * `gateway_configuration_name`: Name of the payment gateway configuration. * `gateway_operation_uid`: Unique identifier for the gateway operation. * `gateway_name`: Name of the payment gateway used for the transaction. * `type`: Type of transaction operation (e.g. request, authorization, capture, refund). * `has_failed`: Boolean flag indicating if the operation has failed. * `is_attempt`: Boolean flag indicating if the operation is an attempt pre-operation. * `sandbox`: Boolean flag indicating if the transaction was processed in sandbox environment. * `name`: Name associated with the invoice. * `amount`: Transaction amount in the original currency. * `amount_local`: Transaction amount in the project currency. * `currency`: Currency of the transaction. * `gateway_fee`: Fee charged by the payment gateway in the original currency. * `gateway_fee_local`: Fee charged by the payment gateway in the local currency. * `gateway_fee_currency`: Currency in which the gateway fee is charged. * `tx_created_at`: Timestamp indicating when the transaction was created. * `tx_updated_at`: Timestamp indicating when the transaction was last updated. * `created_at`: Timestamp indicating when the operation was created. * `payment_type`: Type of payment method used. * `status`: Current status of the transaction (e.g., pending, succeeded, failed). * `initiation_type`: Type of transaction initiation (MIT or CIT). * `payment_intent`: For a MIT, type of payment flow that generated the transaction. * `error_code`: ProcessOut error code representing the reason of the transaction failure. * `routing_tags`: Tags associated to the routing rules used for routing the transaction. * `metadata`: Additional metadata associated with the operation. * `detail_country`: Country associated with the customer. * `acquirer_name`: Name of the acquiring bank. * `eci`: Electronic Commerce Indicator value for authentication. * `merchant_account_id`: Identifier for the merchant account processing the transaction. * `scheme_id`: Identifier for the card scheme. * `initial_scheme_tx_id`: Scheme ID to use for subsequent CIT/MITs if applicable. * `recommendation_code`: Code representing the gateway's recommendation to retry the transaction. * `recommendation_reason`: Gateway's recommendation to retry the transaction. * `chargeback_reason`: Reason provided for a chargeback. * `card_scheme`: Scheme of the card. * `card_brand`: Brand of the card. * `card_bank`: Issuing bank of the card. * `card_iin`: Issuer Identification Number (first 6-8 digits of the card). * `card_last4`: Last 4 digits of the card number. * `card_cvc_check`: Result of the Card Verification Code check. * `card_co_scheme`: Co-branded scheme associated with the card. * `card_category`: Category of the card (e.g. consumer, business). * `card_country_code`: Country code of the card. * `card_preferred_scheme`: Preferred scheme associated with the card. * `card_created_at`: Timestamp when the card was created. * `tx_metadata`: Additional metadata specific to the transaction. * `card_expires_at`: Expiry date of the card. * `forced_effective_scheme`: Effective scheme used for the transaction, if forced. * `device_channel`: Device channel used for the transaction (e.g. mobile, web). * `is_network_token`: Boolean flag indicating if the card is a network token. * `card_avs_check`: Result of the Address Verification System check. * `card_type`: Type of card (e.g. credit, debit, prepaid). * `tx_three_ds_status`: Status of the 3D Secure authentication. * `tx_three_ds_cres_status`: Status of the challenge response in 3D Secure. * `tx_three_ds_ares_status`: Status of the authentication response in 3D Secure. * `tx_three_ds_challenged`: Boolean flag indicating if the transaction was challenged via 3D Secure. * `tx_three_ds_fingerprinted`: Boolean flag indicating if 3D Secure fingerprinting was performed. * `tx_three_ds_version`: Version of 3D Secure used. * `order_id`: Identifier for the order associated with the transaction. * `error_message`: Gateway's error message. * `card_uid`: Unique identifier for the card. * `card_fingerprint`: Unique fingerprint for the card. * `card_ip_address`: IP address of the card. * `customer_uid`: Unique identifier for the customer. * `customer_ip_address`: IP address of the customer. * `customer_country_code`: Country code of the customer. * `customer_token`: Tokenized representation of the customer. Please note that we may add new columns and re-order existing columns from time to time. Your implementation should handle this case. Existing columns will keep the same names and data format. ## Data sample ```Text CSV "project_uid","tx_uid","tx_operation_uid","challenge_indicator","sca_exemption_reason","invoice_uid","gateway_configuration_uid","gateway_configuration_name","gateway_operation_uid","gateway_name","type","has_failed","is_attempt","sandbox","name","amount","amount_local","currency","gateway_fee","gateway_fee_local","gateway_fee_currency","tx_created_at","tx_updated_at","created_at","payment_type","status","initiation_type","payment_intent","error_code","routing_tags","metadata","detail_country","acquirer_name","eci","merchant_account_id","scheme_id","initial_scheme_tx_id","recommendation_code","recommendation_reason","chargeback_reason","card_scheme","card_brand","card_bank","card_iin","card_last4","card_cvc_check","card_co_scheme","card_category","card_country_code","card_preferred_scheme","card_created_at","tx_metadata","card_expires_at","forced_effective_scheme","device_channel","is_network_token","card_avs_check","card_type","tx_three_ds_status","tx_three_ds_cres_status","tx_three_ds_ares_status","tx_three_ds_challenged","tx_three_ds_fingerprinted","tx_three_ds_version","order_id","error_message","card_uid","card_fingerprint","card_ip_address","customer_uid","customer_ip_address","customer_country_code","customer_token" "proj_xxx","tr_xxx","tr_op_xxx","","","iv_xxx","gway_conf_xxx","***","***","stripe","authorization","true","false","false","***","146.41","146.41","USD","0","0","","2025-01-29 21:35:59.440711","2025-02-11 02:06:01.590407","2025-02-11 02:06:01.590407","card","failed","","","gateway.blocked","[""tag1"", ""tag2""]","{""key1"": ""value1"", ""key2"": ""value2""}","US","***","","***","***","***","","","","visa","visa business","CROSS RIVER BANK","123456","1234","unavailable","","business","US","","2025-01-29 21:28:37.584066","{""key1"": ""value1"", ""key2"": ""value2""}","2029-03-01 01:01:01.000000","","","false","unknown","credit","","","","false","false","0","","Stripe blocked this payment as too risky.","card_xxx","***","***","cust_xxx","***","","tok_xxx" "proj_xxx","tr_xxx","tr_op_xxx","","","iv_xxx","gway_conf_xxx","***","***","checkoutcom","authorization","true","false","false","***","146.41","146.41","USD","0","0","","2025-01-29 21:35:59.440711","2025-02-11 02:06:01.590407","2025-02-11 02:06:00.275722","card","failed","","","card.no-money","[""tag1"", ""tag2""]","{""key1"": ""value1"", ""key2"": ""value2""}","US","***","","***","***","***","02","Try again later.","","visa","visa business","CROSS RIVER BANK","123456","1234","unavailable","","business","US","","2025-01-29 21:28:37.584066","{""key1"": ""value1"", ""key2"": ""value2""}","2029-03-01 01:01:01.000000","","","false","unknown","credit","","","","false","false","0","","Insufficient Funds","card_xxx","***","***","cust_xxx","***","","tok_xxx" "proj_xxx","tr_xxx","tr_op_xxx","","","iv_xxx","gway_conf_xxx","***","***","checkoutcom","request","false","false","false","***","146.41","146.41","USD","0","0","","2025-01-29 21:35:59.440711","2025-02-11 02:06:01.590407","2025-02-11 02:06:00.275700","card","failed","","","","[""tag1"", ""tag2""]","{""key1"": ""value1"", ""key2"": ""value2""}","US","***","","***","***","***","","","","visa","visa business","CROSS RIVER BANK","123456","1234","unavailable","","business","US","","2025-01-29 21:28:37.584066","{""key1"": ""value1"", ""key2"": ""value2""}","2029-03-01 01:01:01.000000","","","false","unknown","credit","","","","false","false","0","","","card_xxx","***","***","cust_xxx","***","","tok_xxx" ```