Spatiotemporal microstructure data are the key results of continuum full-field and atomic-scale computer simulations, as well as cutting-edge diffraction microscopy experiments. Typically represented as voxel, point, line, or finite-element meshes, these data cover a variety of materials information, such as the spatial distribution of crystal defects and their embedding into three-dimensional field quantities like temperature, mechanical stress and strain, or concentration fields of chemical species. Especially when many such time-dependent snapshots are taken, the volume and acquisition velocity can quickly become impractical to work with (GB, TB, or even larger). In addition, the large variety of computer codes within the MSE community, limits interoperability and repurposeability when hand-shaking between different microstructure characterization tools. Here, we aim for infrastructure work that describes crystal defects and their motion embedded in fields across different length and time scales in a code-agnostic representation that can complement existent code-specific outputs. Proof-of-concept workflows are developed, which exemplify how such description and ontology connection can be exported from existent MSE simulation tools, covering continuum-scale crystal plasticity, RX, GG, precipitation, dislocation dynamics, and atomistics.