How to delete columns from dataset to reduce spice limit

how do i delete columns from a data set to free up spice data, I have recently been hitting the limits on spice and looking to optimize my datasets

Hi @izzycs

Please refer to this community post, which addresses a similar issue - How to remove a column from dataset - #2 by Xclipse

can you share more information on how to delete including screenshots maybe having trouble finding the correct information

Hi @izzycs

The Exclude Fields option in the dataset only hides columns from your analysis views, it does not reduce your SPICE storage usage. The data for those columns is still ingested and stored in SPICE.

To actually free up SPICE space by removing unwanted columns, you have two options:

  1. Custom SQL mode: Open your dataset, click Edit, and switch to the Custom SQL editor. Write a SELECT statement that includes only the columns you need. For example: SELECT column1, column2, column3 FROM your_table

  2. Modify the source view/table: If you’re using the table/view selector, all columns from the source are imported by default. You would need to update the source view or table in your database to exclude the unwanted columns.

Note: Before removing any columns, please ensure that the columns you plan to remove are not being used in any published dashboards or analyses that are shared across users. If a dashboard references a column that no longer exists in the dataset, it will result in errors such as field not found in dataset. We recommend reviewing all dependent dashboards and analyses before making changes.

After making either change, please perform a full SPICE refresh to reclaim the storage. An incremental refresh will not remove the previously stored column data. Data preparation steps - Amazon Quick

Hi @izzycs,

Just checking back in since this thread hasn’t received a response in a while. Was Xclipse’s reply helpful to you and/or were you able to find a solution yourself in the meantime? Please help the community by marking this answer as “Solution” or following up in general within the next 3 business days!

Thank you!

Hi @izzycs,

Since I haven’t received any further updates from you, I’ll treat this inquiry as complete for now. If you have any additional questions, feel free to create a new post in the community and link this discussion for context.

Thanks!