# S3 CSV file dataset failures

**URL:** <https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716>\
**Category:** Q&A\
**Tags:** error, data-source, s3, Business-Intelligence-Engineer, dataset, quick-sight\
**Created:** [July 13, 2023, 9:02pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716 "2023-07-13T21:02:01Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![ryann.schuessler](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@ryann.schuessler](https://community.amazonquick.com/u/ryann.schuessler)\
**Post date:** [July 13, 2023, 9:02pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/1 "2023-07-13T21:02:02Z")

</div>

Hi! I have a csv file that is stored in a S3 bucket that I would like to create into a dataset. When I create a new dataset and upload, the refresh fails with errors on multiple columns. When I export the error file I notices a lot of fields that are incorrectly placed, ex) an id field should only contain a 5digit number but I see names from other columns in that field.

The csv is created in Alteryx with these output options.

 ![image](https://d1wl4jav5dp96l.cloudfront.net/original/2X/a/a5e0b73a99d39ca1ea52292316ebe64572f7c009.png)

I’m guessing there is an issue with Quick Sight noticing the delimiter and that is why some values are shifted. Also I have some columns that are full sentences that include commas.

Does anybody have a suggestion on how to fix? If I change the delimiter to | or } will Quick Sight notice and upload the csv file?

---

<div class="post-metadata">

**Author:** ![Sanjeeb2022](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/sanjeeb2022/32/20947_2.png) [@Sanjeeb2022](https://community.amazonquick.com/u/Sanjeeb2022)\
**Post date:** [July 14, 2023, 3:09am UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/2 "2023-07-14T03:09:03Z")

</div>

Hi @ryann.schuessler - Can you please share the error details. CSV should work fine in Quick Sight and by default it took the comma separator. You can change the delimiter of the csv file. If possible, please share sample data with error records to analyze in details ( Please mask PII data if there is any).

Regards - Sanjeeb

---

<div class="post-metadata">

**Author:** ![Koushik\_Muthanna](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/koushik_muthanna/32/3290_2.png) [@Koushik\_Muthanna](https://community.amazonquick.com/u/Koushik_Muthanna)\
**Post date:** [July 14, 2023, 7:50am UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/3 "2023-07-14T07:50:10Z")

</div>

hi @ryann.schuessler ,

take a look at the options available in manifest file : [Supported formats for Amazon S3 manifest files - Amazon QuickSight](https://docs.aws.amazon.com/quicksight/latest/user/supported-manifest-file-format.html) and reupload the file.

Regards,  
Koushik

---

<div class="post-metadata">

**Author:** ![ryann.schuessler](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@ryann.schuessler](https://community.amazonquick.com/u/ryann.schuessler)\
**Post date:** [July 14, 2023, 1:04pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/4 "2023-07-14T13:04:13Z")

</div>

Here is the refresh error details  
 ![image](https://d1wl4jav5dp96l.cloudfront.net/original/2X/0/045792a88a8621c3f890c0b441b6f0108aa1188f.png)

This is an example of the output error, in the original csv file all PRD\_IDs are numeric. The fields under PRD\_ID that are text should be under different columns  
 ![image](https://d1wl4jav5dp96l.cloudfront.net/original/2X/a/a48e360c3c845cc7a07a98420fda342f874324ca.png)

---

<div class="post-metadata">

**Author:** ![Koushik\_Muthanna](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/koushik_muthanna/32/3290_2.png) [@Koushik\_Muthanna](https://community.amazonquick.com/u/Koushik_Muthanna)\
**Post date:** [July 14, 2023, 1:28pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/5 "2023-07-14T13:28:25Z")

</div>

check the manifest file for text qualifier.

---

<div class="post-metadata">

**Author:** ![ryann.schuessler](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@ryann.schuessler](https://community.amazonquick.com/u/ryann.schuessler)\
**Post date:** [July 14, 2023, 3:01pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/6 "2023-07-14T15:01:49Z")

</div>

This is the manifest file I am currently using

{  
“fileLocations”: [  
{  
“URIs”: [  
“[https://example/example.csv](https://example/example.csv)”  
]  
}  
],  
“globalUploadSettings”: {  
“textqualifier”: “"”  
}  
}

Do I need to change the text qualifier?

---

<div class="post-metadata">

**Author:** ![ryann.schuessler](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@ryann.schuessler](https://community.amazonquick.com/u/ryann.schuessler)\
**Post date:** [July 14, 2023, 3:06pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/7 "2023-07-14T15:06:28Z")

</div>

![image](https://d1wl4jav5dp96l.cloudfront.net/original/2X/1/19b83edf9ad6aa8c7498a8595d30eca5cd62368e.png)

The text qualifier has a forward slash, for some reason when I copied the file text it got removed in the comment

---

<div class="post-metadata">

**Author:** ![pilloren](https://avatars.discourse-cdn.com/v4/letter/p/dc4da7/32.png) [@pilloren](https://community.amazonquick.com/u/pilloren)\
**Post date:** [October 19, 2023, 10:31am UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/8 "2023-10-19T10:31:10Z")

</div>

Hi Ryann,

Did you manage to solve it? I’m facing the same issue and tried different things but still struggling when import to Spice.  
Thanks!!

---

<div class="post-metadata">

**Author:** ![WLS-D](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/wls-d/32/36109_2.png) [@WLS-D](https://community.amazonquick.com/u/WLS-D)\
**Post date:** [December 12, 2023, 7:28pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/9 "2023-12-12T19:28:05Z")

</div>

Hello @ryann.schuessler, @Sanjeeb2022 , and @Koushik_Muthanna !

@ryann.schuessler Are you still having trouble with this problem, or were you are able to find a solution? If you were able to find a solution could you post it to help the community?

Did you remove that forward slash and were able to solve the problem?

---

<div class="post-metadata">

**Author:** ![ryann.schuessler](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@ryann.schuessler](https://community.amazonquick.com/u/ryann.schuessler)\
**Post date:** [December 13, 2023, 4:10pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/10 "2023-12-13T16:10:04Z")

</div>

Hi! I was not able to find a solution. I had three columns with fields that included long JSON strings. I had to remove them from the dataset in order for it to refresh correctly.

Those fields weren’t necessary for my analysis, but I’m sure I’ll run into this issue again in the future

---

<div class="post-metadata">

**Author:** ![WLS-D](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/wls-d/32/36109_2.png) [@WLS-D](https://community.amazonquick.com/u/WLS-D)\
**Post date:** [December 15, 2023, 4:23pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/11 "2023-12-15T16:23:23Z")

</div>

Hey @ryann.schuessler !

After reading through the full question, I think that it would be beneficial to create a support ticket with AWS. @Koushik_Muthanna do you have any other suggestions?

[Here are the steps to open a support case](https://docs.aws.amazon.com/awssupport/latest/user/case-management.html). If your company has someone who manages your AWS account, you might not have direct access to AWS Support and will need to raise an internal ticket to your IT team or whomever manages your AWS account. They should be able to open an AWS Support case on your behalf.

CC: @pilloren

---

<div class="post-metadata">

**Author:** ![WLS-D](https://d2orw1595917va.cloudfront.net/user_avatar/community.amazonquick.com/wls-d/32/36109_2.png) [@WLS-D](https://community.amazonquick.com/u/WLS-D)\
**Post date:** [December 18, 2023, 4:09pm UTC](https://community.amazonquick.com/t/s3-csv-file-dataset-failures/15716/12 "2023-12-18T16:09:54Z")

</div>

Archived on December 18, 2023, 4:09pm UTC


