# Dataset too large to import. How can I import certain amount of rows every x hours?

**URL:** <https://community.amazonquick.com/t/dataset-too-large-to-import-how-can-i-import-certain-amount-of-rows-every-x-hours/2750>\
**Category:** Q&A\
**Tags:** spice, quick-sight\
**Created:** [April 3, 2022, 8:03pm UTC](https://community.amazonquick.com/t/dataset-too-large-to-import-how-can-i-import-certain-amount-of-rows-every-x-hours/2750 "2022-04-03T20:03:00Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![hasanm](https://avatars.discourse-cdn.com/v4/letter/h/f6c823/32.png) [@hasanm](https://community.amazonquick.com/u/hasanm)\
**Post date:** [April 3, 2022, 8:03pm UTC](https://community.amazonquick.com/t/dataset-too-large-to-import-how-can-i-import-certain-amount-of-rows-every-x-hours/2750/1 "2022-04-03T20:03:00Z")

</div>

Im trying to load data from a redshift cluster but the import fails because the dataset is too large to be imported using SPICE. (Figure 1)

How can I import…for example…300k rows every hour so that I can slowly build up the dataset to the full dataset?

Maybe doing an incremental refresh is the solution? The problem is I don’t understand what the “Window size” configuration means. Do i put 300000 in this field (Figure 2)?

 ![Screen Shot 2022-04-03 at 4.02.21 PM](https://d1wl4jav5dp96l.cloudfront.net/original/2X/f/f7d5aabf9103281888394764782768e5ba692b89.jpeg)

---

<div class="post-metadata">

**Author:** ![jie](https://avatars.discourse-cdn.com/v4/letter/j/3bc359/32.png) [@jie](https://community.amazonquick.com/u/jie)\
**Post date:** [April 4, 2022, 8:01pm UTC](https://community.amazonquick.com/t/dataset-too-large-to-import-how-can-i-import-certain-amount-of-rows-every-x-hours/2750/2 "2022-04-04T20:01:59Z")

</div>

Hey hasanm,

Thanks for using Quick Sight. I think there are two issues here,

1. get large number of rows into SPICE. Incremental refresh won’t help you in this case. Limits specified here [Data source quotas - Amazon QuickSight](https://docs.aws.amazon.com/quicksight/latest/user/data-source-limits.html#spice-limits) applies to a single dataset no matter you use incremental refresh or not (in total number of rows)

2. For setting up “window size” of incremental refresh, please refer to this doc, [Refreshing SPICE data - Amazon QuickSight](https://docs.aws.amazon.com/quicksight/latest/user/refreshing-imported-data.html#schedule-data-refresh-incremental)

Thanks,