dsgrid Documentation

Active Development

The dsgrid toolkit is under active development and details are subject to change. Please reach out to the dsgrid team with questions or feedback.

What is dsgrid?

The demand-side grid (dsgrid) toolkit is a Python framework for compiling high-resolution energy demand datasets across multiple dimensions: time, geography, sector, subsector, end use, etc. dsgrid enables researchers, analysts, and planners to integrate diverse energy datasets into cohesive projects suitable for power system analysis, policy evaluation, and energy planning.

For more information, please visit https://www.nrel.gov/analysis/dsgrid.html.

Getting Started by Role

Use Published Data

For: Data Users, Analysts, Researchers

Browse, download and analyze pre-compiled dsgrid datasets for your research or analysis.

Submit a Dataset

For: Dataset Submitters, Modelers

Register and submit your energy demand dataset to a dsgrid project.

Map a Dataset

For: Dataset Mappers, Data Engineers

Transform datasets to different time conventions, geographies, etc.

Manage a Project

For: Project Coordinators, Lead Analysts

Create projects, compile datasets, run queries, and create derived datasets.

Key Features

  • Multi-Dimensional Data: Organize energy data across scenario, geography, time, sector, subsector, enduse, and custom dimensions

  • Flexible Mappings: Map datasets between different dimensional systems with explicit, documented transformations

  • Powerful Queries: Aggregate, filter, and transform data across dimensions to create custom views

  • Big Data Support: Process terabyte-scale datasets using Apache Spark or gigabyte-scale datasets using DuckDB

  • Data Integrity: Validation ensures dataset consistency and project compatibility

  • Registry System: Central metadata management for dimensions, datasets, and projects

Documentation Sections

User Guide

Topic Deep Dives

Advanced Topics

Software Reference

Additional Resources