🖨️
DataSF | Publishing Process
  • Introduction
  • Why Publish Data?
    • Publishing Data Standards
  • Publishing Specifications
    • Kickoff
      • Breadcrumbs and Inventory
    • Privacy Toolkit
      • Privacy Toolkit Form
    • Security Toolkit
  • Data Pipeline
    • Pipeline Basics
      • Manual Publishing
      • Data Pipeline
      • Common Transformations
  • Metadata
    • Intro to Metadata
      • Metadata Standards
  • Publishing & Maintenance
    • Review & Publishing
    • See our other explainers
Powered by GitBook
On this page
  • Breadcrumbs
  • Inventory
  1. Publishing Specifications
  2. Kickoff

Breadcrumbs and Inventory

PreviousKickoffNextPrivacy Toolkit

Last updated 1 year ago

The steps on this page will be performed by DataSF. We're including it here for the sake of transparency but feel free to skip!

Breadcrumbs

In order to track a dataset through the publishing steps, DataSF has a system called "breadcrumbs" which are included on all workflows. These breadcrumbs are included on teams conversations and our Asana publishing tracker

  • Socrata Dataset: TBC (May end up being a list of related datasets)

  • Teams Conversation: Use to add the thread link

  • Asana Ticket: Use to create the ticket link

  • Airtable Inventory: Find or create an Airtable link immediately. If we end up publishing multiple datasets related to the topic this can become a list.

  • FME Workspace: TBC

  • dbt Model: NA

  • Pull Request: NA

  • Source Data: NA

  • Other Links: NA

Inventory

DataSF currently uses an Airtable base to keep track of all datasets which are candidates for publishing -- whether they are publicly available or not. This system allows us to tie datasets to their data system and track their priority and value.

DataSF will either create a new entry or update an existing one when kicking off the data publishing process.

https://tinyurl.com/app/
https://tinyurl.com/app/