Understand how QuickSight dataset API works, from query modes to versioning, SPICE, and calculations, with all key features explained clearly. Our AWS Support Team is always here to help you.
QuickSight Dataset API – A Complete Guide You Need Today
Amazon QuickSight has changed the way businesses approach analytics. At the heart of this platform lies The QuickSight dataset API, which connects data sources, prepares datasets, and powersdashboards with speed and scale. Instead of overloading readers with filler, let’s dive straight into the most valuable aspects of working with datasets and see how each feature can make your reporting more efficient.
An Overview
Dataset layer – setting the foundation
In the dataset layer, you can bring in data from multiple sources, define join criteria, apply filters at the start, and give user-friendly names to columns. This stage prepares the data for visualization in the analysis layer, and everything that follows builds on this.
Query modes – Direct query vs SPICE
QuickSight datasets can function in two query modes: Direct query and SPICE mode.
- Direct query mode: Every time a dashboard or analysis loads, the queries run directly against the backend data source.
- SPICE mode: On the other hand, QuickSight takes a point-in-time snapshot of the data defined by your joins. This snapshot is stored in the SPICE layer. You can refresh it either on a schedule using the UI or as the last step in your data pipeline with the create-ingestion API call.
Importantly, you can switch between modes at any time without changing the dataset’s metadata. Moreover, SPICE delivers two clear benefits:
- Scale: It can handle 10 or 10K users without adding load to the backend.
- Speed: Built for QuickSight, it ensures dashboards load faster.
Dynamic query generation – smarter queries
When working in Direct query mode, QuickSight builds intelligent queries by pulling only the required tables instead of joining all defined tables. Declaring unique keys in joins helps QuickSight safely drop unused tables from the query, keeping execution faster and lighter.
Custom SQL – full control
Already have a complex query that touches 20 tables? You don’t need to recreate all relationships in the UI. Just plug in your query as a Custom SQL inside the dataset. For live backend sources, this Custom SQL acts like a table and can be joined with others. (Not applicable to file uploads.)
Field folders – organized fields
Large datasets often get messy. With field folders, you can organize fields neatly. You can even create a single nested level, for example, a folder named “Dimensions” with child folders like “Product Dim” or “Date Dim.” The same structure shows up in the analysis layer.
Centralized calculations – consistency across dashboards
Standard calculations that should be accessible to all BI authors can be embedded into the dataset itself. In SPICE datasets, row-level calculations get evaluated at data refresh and stored, reducing load time computation. Aggregate calculations, however, are stored as expressions and evaluated in context during dashboard load.
Dataset as a source – extending datasets
QuickSight allows you to pull one dataset into another and then join it with other sources or files. This is highly useful when you want to enrich a dataset shared with you but don’t have direct editing rights.
Versioning – tracking changes
Every save creates a new dataset version. Then you can revert to earlier ones anytime via Manage > Publishing history. For external version control, extract definitions using the describe-data-set API and store them in your code repository.
[If needed, Our team is available 24/7 for additional assistance.]
Conclusion
The QuickSight dataset API is more than just a connector, it is the foundation of powerful, scalable analytics. With features like SPICE, dynamic queries, field folders, and built-in versioning, it makes managing and analyzing data straightforward. For simple joins or complex SQL, QuickSight datasets deliver speed, scale, and flexibility without compromise.
0 Comments