Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • C climix
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 53
    • Issues 53
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 4
    • Merge requests 4
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • climix
  • climix
  • Issues
  • #233
Closed
Open
Created Jul 12, 2021 by Lars Bärring@a001257Developer0 of 7 tasks completed0/7 tasks

Hooks to pre-processor functions

Experience from using Midas in a "production" context shows that reading real-world datasets from CORDEX into midas (by analogy thus also iris) using the vanilla functions of iris causes massive failures because of shortcomings and errors in the metadata. In the wake of perfect metadata climix (and midas) should be equipped with hooks for calling a suitable set of pre-processor functions provided by the user. Tentatively, these functions would handle the following tasks:

  1. Process the list of files supplied as input argument before the files are read.
  2. Supplying constraints to the iris.read_raw() for subsetting the input files.
  3. Process the CubeList immediately after reading and before concatenation.
  4. Process attributes that differ between the individual cubes in the CubeList (and thus prevents concatenation).
  5. Handle the situation that concatenation was not fully successful and did not return one cube only. This should be done in an iterative way until the result is one cube, or fail.
  6. Feed processed attributrtes (from point 4) to the resulting output cube.
  7. Produce a template for the output filename based on the input filenames.
Assignee
Assign to
Time tracking