Data processing scripts¶

The preparation of data in organized into Preprocessing and Data processing. Scripts contained in the Preprocessing include import of raw and basic preparation for later use in scripts of Data processing.

Preprocessing¶

Overview on pre-processing scripts that import data and do basic preparation. Data pre-processing steps partially depend on each other which is shown in the following figure.

Scenario log¶

Prepare logging of data processing: create logging table and respective function that logs changes made to tables.

RenpassG!S¶

Using repassG!S for creating time series of renewable power plants feedin.

_images/ego_dp-pre_bpmn_section_renpassGIS.png

COSMO-CLM grid¶

Import spatial data grid for COSMO-CLM climate data.

Zensus¶

Import Zensus data.

Import data for administrative boundaries from VG250 data set.

_images/ego_dp-pre_bpmn_section_bkg-vg250.png

OpenStreetMap¶

Import OpenStreetMap (OSM) data from Geofabrik data dumps.

Standard load profile¶

Insert standard load profile (SLP) parameters to database table.

Wind potential areas¶

Import wind potential area data from VerNETZen project.

Demand at federal states¶

Insert annual demand data at federal state level for different energy use sectors and disaggregate further.

_images/ego_dp-pre_bpmn_section_demand_federalstate.png

osmTGmod¶

EHV and HV level grid obtained from OSM with osmTGmod.

Power plant data¶

Basic preparation of power plant data.

_images/ego_dp-pre_bpmn_section_supply.png

Data processing¶

The data processing is organized into separate parts which are executed in desired order.

Each of these parts consists of multiple data processing steps that are stored in separate SQL files. The following sections explain what is done in each section, which data is accessed, created or manipulated, and which tables results of each script.