PUBLIC DATA NOTEBOOK

Small notes for working with open data

A compact reference for dataset formats, provenance, update cadence, and practical validation.

Field notes

Formats

CSV and tabular exports

Record the delimiter, character encoding, null representation, and schema version before comparing snapshots.

Geospatial

Coordinate reference systems

Keep the source CRS with every extract. Reprojection without source metadata makes later checks unreliable.

Provenance

Source and retrieval dates

Store both publication and retrieval time. They answer different questions when a public dataset changes.

Quick dataset check

  1. Identify the publisher and original source.
  2. Capture the license and retrieval date.
  3. Validate encoding, schema, and missing values.
  4. Keep an untouched source snapshot.